News

PhD defense of Jules Sanchez on “Domain generalization for semantic segmentation of LiDAR data for autonomous vehicles”

This thesis was realized under the direction of François Goulette and Jean-Emmanuel Deschaud of the Center of Robotics of Mines Paris – PSL.

The defense took place on Tuesday 5 December 2023 at Mines Paris – PSL.

Jury members:

  • LANDRIEU Loïc, Chargé de recherche, HDR, École des Ponts ParisTech
  • CHECCHIN Paul, Professeur des universités, Université Clermont Auvergne
  • CHAINE Raphaëlle, Professeur des universités, Université Claude Bernard Lyon 1, LIRIS
  • GOULETTE François, Professeur ENSTA Paris – IP Paris
  • DESCHAUD Jean-Emmanuel, Chargé de recherche HDR, Mines Paris – PSL

https://www.caor.minesparis.psl.eu/wp-content/uploads/2023/12/3DLabelProp-700x400.jpg

Summary of the PhD thesis:

LiDAR perception for autonomous vehicles managed to achieve suitable results on the various online benchmarks in the single-domain framework, that is to say when the training domain is the same as the evaluation domain. From there, the fields of research diversified and focused on questions of transferability, robustness and generalization.

This work focuses on generalization issues for LiDAR semantic segmentation. A global overview of the generalization performances, single-source and multi-source, of existing segmentation methods is carried out. To fairly perform these experiments, a dataset, ParisLuco3D, is created specifically to evaluate generalization.

Furthermore, a new single-source domain generalization method, 3DLabelProp, is proposed. This method differs from existing strategies by exploiting the geometry of the data to perform domain alignment rather than learning strategies. Beyond semantic segmentation, this method is also applied to the task of moving object segmentation.

Congratulations to Jules !!!

https://www.caor.minesparis.psl.eu/wp-content/uploads/2023/12/PXL_20231205_130513053-600x400.jpg
https://www.caor.minesparis.psl.eu/wp-content/uploads/2023/12/PXL_20231205_132808109-600x400.jpg

PhD defense of Pierre Dellenbach on “Exploring LiDAR Odometries through Classical, Deep and Inertial perspectives”

This thesis was realized in collaboration between Mines Paris – PSL and Kitware under the direction of François Goulette and Jean-Emmanuel Deschaud of the Center of Robotics of Mines Paris – PSL, as well as Raphaël Cazorla from Kitware.

The defense took place on Friday 10 November 2023 at Mines Paris – PSL.

https://www.caor.minesparis.psl.eu/wp-content/uploads/2021/03/cticp-400x400.jpg

Summary of the PhD thesis: 3D LiDARs have become increasingly popular in the past decade, notably motivated by the safety requirements of autonomous driving requiring new sensor modalities. Contrary to cameras, 3D LiDARs provide direct, and extremely precise 3D measurements of the environment. This has led to the development of many different mapping and Simultaneous Localization And Mapping (SLAM) solutions leveraging this new modality. These algorithms quickly performed much better than their camera-based counterparts, as evidenced by several open-source benchmarks. One critical component of these systems is LiDAR odometry. A LiDAR odometry is an algorithm estimating the trajectory of the sensor, given only the iterative integration of the LiDAR measurements. The focus of this work is on the topic of LiDAR Odometries. More precisely, we aim to push the boundaries of LiDAR odometries, both in terms of precision and performance. To achieve this, we first explore classical LiDAR odometries in depth, and propose two novel LiDAR odometries, in chapter 3. We show the strength, and limitations of such methods. Then, to address to improve them we first investigate Deep Learning for LiDAR odometries in chapter 4, notably focusing on end-to-end odometries. We show again the limitations of such approaches and finally investigate in chapter 5 fusing inertial and LiDAR measurements.

Congratulations to Pierre !!!

https://www.caor.minesparis.psl.eu/wp-content/uploads/2023/11/PXL_20231110_085554893-scaled-600x400.jpg
https://www.caor.minesparis.psl.eu/wp-content/uploads/2023/11/PXL_20231110_091351078-scaled-600x400.jpg

PhD Defense: “Learned and Hybrid Strategies for Control and Planning of Highly Automated Vehicles”

 

The Centre for Robotics is proud to announce that the PhD Defense of Agapius BOU GHOSN will take place on Friday, September 15th at MINES PARIS.

The subject of the work is:

Learned and Hybrid Strategies for Control and Planning of Highly Automated Vehicles

The PhD has been directed by Arnaud de La Fortelle.

 

To attend:
MINES PARIS
60, Saint-Michel boulevard, Paris, room L109.

 

Jury members:

David FILLIAT, ENSTA Paris

Philippe MARTINET, INRIA Sophia-Antipolis

Christian GERDES, Stanford University

Brigitte D’ANDREA-NOVEL, Mines Paris

Philip POLACK, FAIRMAT

Arnaud DE LA FORTELLE, Heex Technologies

 

Abstract:

The thesis focuses on advancing both theoretically and experimentally toward a better understanding of hierarchical planning and control schemes and propose evaluation protocols for cooperative autonomous driving. Advances regarding more dynamic planning changes, including backup maneuvers that can require higher dynamics than usual driving are expected and also advances regarding learned planning and control schemes. All the contributions will be experimented on real cars.

PhD Defense: “Learning-based algorithms for real-time visual localization of mobile robots”

The Centre for Robotics is proud to announce that the PhD Defense of Arthur MOREAU will take place on Thursday, April 27th at MINES PARIS.

The subject of the work is:

“Learning-based algorithms for real-time visual localization of mobile robots”

This research is the result of a collaboration between our Centre and Huawei France.

The PhD has been directed by Arnaud de La Fortelle, and supervized by Bogdan Stanciulescu.

 

To attend:
MINES PARIS
60, Saint-Michel boulevard, Paris.

 

Jury members:

Valérie GOUET-BRUNET, Research Director, LASTIG – National Institute for Geographical and Forest Information (IGN)

Patric JANSFELT, Full Professor, KTH Royal Institute of Technology, Sweden

Vincent LEPETIT, Research Director, École des ponts ParisTech

Bogdan STANCIULESCU, Associate Professor, MINES PARIS

Arnaud de La Fortelle, HDR, CEO Heex Technologies

Dzmitry TSISHKOU, PhD, Huawei Technologies France

 

Abstract:

This PhD investigates visual-based algorithms for real-time localization of mobile robots. The core objective is to provide a reliable solution to the vehicle relocalization problem in large urban environments using camera images as input. Thanks to computer vision progress and low cost sensors, visual-based localization is an appealing solution, where the best performing methods use structure-based pipelines with high computational cost and memory footprint. On the other hand, learning-based approaches connect images and camera poses in an end-to-end fashion, matching real time embedded processing requirements. This PhD aims to push forward learning-based methods on several aspects: localization accuracy, uncertainty quantification, robustness to real-world conditions and easier adaptation to unseen maps. These limitations can be addressed in many ways: using Bayesian Deep Learning tools to provide uncertainty quantification of the model outputs; adapting the spatial and visual distribution of the training examples to increase robustness and reliability of the learned models; designing better model architecture to take in account geometrical clues within the learning process in order to reach state of the art accuracy for a tiny fraction of the computational cost of classical geometric pipelines. The resulting system is intended to be used as a scalable and reliable localization system for automated vehicles.

PhD Defense: “Smart vehicule trajectory prediction in various autonomous driving scenarios”

Image showing autonomous cars on a roundabout with their trajectories

The Centre for Robotics is proud to announce that the PhD Defense of Thomas GILLES will take place on Friday, April 21st at MINES PARIS.

The subject of the work is:

“Smart vehicule trajectory prediction in various autonomous driving scenarios”

This research is the result of a collaboration between our Centre and Huawei France.

The PhD has been directed by Fabien Moutarde, and supervized by Bogdan Stanciulescu.

 

To attend:
MINES PARIS
60, Saint-Michel boulevard, Paris.

 

Jury members:

Alexandre ALAHI, Assistant Professor, EPFL

Fawzi NASHASHIBI, Research Director, National Institute for Research in Digital Science and Technology (Inria)

David FILLIAT, Full Professor, ENSTA Paris

Anne SPALANZANI, Full Professor, Université Grenoble Alpes (UGA) / National Institute for Research in Digital Science and Technology (Inria)

John FOLKESSON, Associate Professor, KTH Royal Institute of Technology, Sweden

Dzmitry TSISHKOU, PhD, Huawei Technologies France

Fabien MOUTARDE, Full Professor, MINES PARIS

Bogdan STANCIULESCU, Associate Professor, MINES PARIS

 

Abstract:

Recent advances in machine learning methods have enabled tremendous progress in autonomous driving, namely through the perception step thanks to deep learning and deep neural networks, combined with all-around progress in sensors, mapping and proprioception techniques. The focus is now therefore shifting towards the next steps in the autonomous pipeline, where prediction plays an important role. Once the surrounding road agents have been detected and tracked, the driving system needs to predict their future trajectory and plan accordingly to have a collision-less course.
This trajectory prediction must follow multiple requirements. First, it should obviously be accurate and trustworthy, so that its output can be reliably used in the following processes. The future can present multiple possibilities, from which it may not always be possible to disambiguate solely based on past historical data. The forecast must therefore be multimodal, by predicting multiple simultaneous probable futures. Since the prediction is to be made on all surrounding agents, and these agents behaviors are very much influenced by their interactions with each other, the model should take these interactions into account, and its multimodal predictions should be coherent with each other. Finally, for safety and reliability, the trajectory prediction should be easy to interpret, extensively evaluated, able to provide confidence evaluates and designed with its final use in the pipeline in mind.
In the first part of this dissertation, after recapitulating existing non-learning methods for trajectory forecasting, we study different existing representations and approaches for learning-based motion forecasting. We then propose to tackle the trajectory prediction problem using probability heatmaps to facilitate multimodality. We design three different ways of generating these heatmaps and evaluate them against each other and the existing state-of-the-art. We also provide a complete sampling method to extract actual trajectories from these heatmaps, and study the pro and cons of these heatmap methods compared to other commonly used frameworks. In the next chapter, we focus on multi-agent prediction, and more specifically consistent scene-level outputs, for these type of heatmap models through sampling and learned post-processing. Finally, we explore different ways of expanding prediction model evaluation by uncertainty assessment, calibration and cross-dataset generalizability analysis.

PhD defense of Jean Pierre RICHA on “Urban Scene Modeling From 3D Point Clouds and Massive LiDAR Simulation for Autonomous Vehicles”

This thesis was realized in collaboration between Mines Paris – PSL and Ansys under the direction of François Goulette and Jean-Emmanuel Deschaud of the Center of Robotics of Mines Paris – PSL, as well as Nicolas Dalmasso, Nassim Jibai, and David Ganieux from Ansys.

The defense took place on Thursday 08 December 2022 at Mines Paris – PSL.

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/12/MDPI-full-pipeline-new-900x400.png

Summary of the PhD thesis: development of autonomous vehicles and testing can be achieved by simulating the different sensors in a virtual environment. However, manually handcrafted virtual environments fail to generalize to real-world scenes, due to the over-simplified models used in such environments. In this thesis, we propose to reduce this domain gap by leveraging real-world scans of urban scenes in the form of 3D point clouds acquired using a LiDAR sensor mounted on a mobile mapping system. Toward this end, we propose an automatic simulation pipeline. The pipeline introduces an accurate scene modeling method based on semantic adaptive splatting to create the virtual environment and a real-time LiDAR simulation.

Congratulations to Jean-Pierre !!!

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/12/IMG_20221208_141421-scaled-300x200.jpg
https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/12/IMG_20221208_163230-scaled-300x200.jpg
https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/12/IMG_20221208_173925-scaled-300x200.jpg