Point Cloud and 3D Modeling (NPM3D)


We created a website for Datasets and Benchmarks on 3D Point Clouds: https://npm3d.fr/

Research TOPIC NPM3D

NPM3D ("Nuage de Points et Modélisation 3D" in french) is a research topic in Centre for Robotics on 3D Point Clouds (from LiDAR and RGB-D sensors)

Main subjects of the NMP3D research topic are:

  • Terrestrial mobile LiDAR systems
  • LiDAR-only Simultaneous Localization And Mapping (SLAM)
  • 3D Perception for autonomous systems (semantic segmentation, 3D detection)
  • Deep Learning for 3D points clouds
  • Point cloud rendering


Permanent staff:

  • Jean-Emmanuel Deschaud: Associate Professor (Chargé de Recherche HDR), Mines Paris - PSL, jean-emmanuel.deschaud@mines-paristech.fr

External Collaborator:

  • François Goulette: Full Professor, Deputy Director U2IS, ENSTA Paris, francois.goulette@ensta-paris.fr

PhD students:

  • Samir Abou-Haidar (2022-): Deep neural networks on 3D point cloud adapted to embedded architectures. In collaboration with Cyril Joly and CEA LIAE lab (Alexandre Chariot and Mehdi Darouich)
  • Hugo Blanc (2022-): Physico-realistic differentiable rendering of point clouds for interactive visualization of real environments, and applications to cultural heritage. In collaboration with Alexis Paljic.
  • Fabio Elnecave Xavier (2022-): Odometry and 3D Reconstruction of the Close Environment of a Leg Exoskeleton. In collaboration with François Goulette and Wandercraft (Guillaume Burger and Marine Petriaux)
  • Louis Soum-Fontez (2021-): Unsupervised real-time object detection from LiDAR data. In collaboration with François Goulette.
  • Jules Sanchez (2020-): Real-time semantic segmentation and object detection of lidar data for the autonomous vehicle. In collaboration with François Goulette.
  • Pierre Dellenbach (2020-): Self-supervised Deep SLAM on camera and LiDAR data. In collaboration with François Goulette and Kitware (Raphaël Cazorla).

Former PhD students:

  • Jean-Pierre Richa (2019-2022): Urban Scene Modeling From 3D Point Clouds and Massive LiDAR Simulation for Autonomous Vehicles (working now at Outsight as R&D engineer)
  • Sofiane Horache (2019-2022): Pattern comparison on 3D point clouds and application on Celtic coins and objects (working now at TheraPanacea as R&D engineer)
  • David Duque (2018-2021): 3D urban scene understanding by analysis of LiDAR, color and hyperspectral data (working now in the start-up Thecrossproduct as R&D engineer)
  • Hugues Thomas (2016-2019): Learning new representations for 3D point cloud semantization (now Post-Doc at University of Toronto)
  • Xavier Roynard (2015-2019): On-the-fly semantization of 3D point clouds acquired by embedded systems (working now at SAFRAN as R&D engineer)
  • Hassan Bouchiba (2014-2018): Contributions in point-based processing for rendering and simulation in fluid mechanics (now co-founder of the start-up Exwayz)
  • Houssem Nouira (2013-2016): Point cloud refinement with self-calibration of a mobile multi-beam lidar (working now at MENSI/TRIMBLE as R&D engineer)




Domain generalization of 3D semantic segmentation in autonomous driving
J. Sanchez, J.-E. Deschaud, F. Goulette
ICCV, 2023
Paper    Github


MDT3D: Multi-Dataset Training for LiDAR 3D Object Detection Generalization
L. Soum-Fontez, J.-E. Deschaud, F. Goulette
IROS, 2023
Paper    Github


Multi-IMU Proprioceptive State Estimator for Humanoid Robots
F. Elnecave Xavier, G. Burger, M. Petriaux, J.-E. Deschaud, F. Goulette
IROS, 2023


COLA: COarse LAbel pre-training for 3D semantic segmentation of sparse LiDAR datasets
J. Sanchez, J.-E. Deschaud, F. Goulette
ICRA, 2023
Paper    Github



AdaSplats: Adaptive Splatting of Point Clouds for Accurate 3D Modeling and Real-Time High-Fidelity LiDAR Simulation
J. P. Richa, J.-E. Deschaud, F. Goulette, N. Dalmasso
MDPI Remote Sensing, 2022
Paper    Dataset


CT-ICP: Real-time Elastic LiDAR Odometry with Loop Closure
P. Dellenbach, J.-E. Deschaud, B. Jacquet, F. Goulette
ICRA, 2022
Paper    Github



Paris-CARLA-3D: A Real and Synthetic Outdoor Point Cloud Dataset for Challenging Tasks in 3D Mapping
J.-E. Deschaud, D. Duque, J. P. Richa, S. Velasco-Forero, B. Marcotegui, F. Goulette
MDPI Remote Sensing, 2021
Paper    Dataset


Riedones3D: a Celtic Coin Dataset for Registration and Fine-grained Clustering
S. Horache, J.-E. Deschaud, F. Goulette, K. Gruel, T. Lejars, O. Masson
Eurographics Workshop on Graphics and Cultural Heritage, 2021
Paper    Dataset


3D Point Cloud Registration with Multi-Scale Architecture and Self-supervised Fine-tuning
S. Horache, J.-E. Deschaud, F. Goulette
3DV, 2021
Paper    GitHub


What’s in My LiDAR Odometry Toolbox?
P. Dellenbach, J.-E. Deschaud, B. Jacquet, F. Goulette
IROS, 2021
Paper    GitLab


On power Jaccard losses for semantic segmentation
D. Duque-Arias, S. Velasco-Forero, J.-E. Deschaud, F. Goulette, A. Serna, E. Decencière, B. Marcotegui
VISAPP, 2021



Automatic clustering of celtic coins based on 3D Point Cloud Pattern Analysis
S. Horache, F. Goulette, J.-E. Deschaud, T. Lejars, K. Gruel
ISPRS Congress, 2020
Paper    Video


SHREC 2020 Track: 3D Point Cloud Semantic Segmentation for Street Scenes
T. Ku, R. C. Veltkamp, B. Boom, D. Duque-Arias, S. Velasco-Forero, J.-E. Deschaud, F. Goulette, B. Marcotegui, S. Ortega, A. Trujillo, J. Pablo Suárez, J. Miguel Santana, C. Ramírez, K. Akadas, S. Gangisetty
Computer & Graphics, 2020


Computational Fluid Dynamics on 3D Point Set Surfaces
H. Bouchiba, S. Santoso, J.-E Deschaud, L. Rocha-Da-Silva, F. Goulette, T. Coupez
Journal of Computational Physics, 2020



KPConv: Flexible and Deformable Convolution for Point Clouds
H. Thomas, C. R. Qi, J.-E. Deschaud, B. Marcotegui, F. Goulette, L. J. Guibas
ICCV, 2019
Paper    GitHub TensorFlow    GitHub PyTorch


A Graph-based Color Lines model for image analysis
D. Duque-Arias, S. Velasco-Forero, F. Goulette, J.-E. Deschaud, B. Marcotegui
ICIAP, 2019



Paris-Lille-3D: A large and high-quality ground-truth urban point cloud dataset for automatic segmentation and classification
X. Roynard, J.-E. Deschaud, F. Goulette
IJRR, 2018
Paper    Dataset


Classification of Point Cloud for Road Scene Understanding with Multiscale Voxel Deep Network
X. Roynard, J.-E. Deschaud, F. Goulette
Workshop IROS, 2018
Paper    GitHub


Semantic Classification of 3D Point Clouds with Multiscale Spherical Neighborhoods
H. Thomas, J.-E. Deschaud, B. Marcotegui, F. Goulette, Y. Le Gall
3DV, 2018


Raw point cloud deferred shading through screen space pyramidal operators
H. Bouchiba, J.-E. Deschaud, F. Goulette
Short Paper EUROGRAPHICS, 2018
Paper    Video


IMLS-SLAM: scan-to-model matching based on 3D data
J.-E. Deschaud
ICRA, 2018



Point Cloud Refinement with Self-calibration of a mobile multi-beam Lidar Sensor
H. Nouira, J.-E. Deschaud, F. Goulette
The Photogrammetric Record, 2017

Current research projects

  • CIFRE thesis with Wandercraft (2022-2025): to bring near 3D Vision for exoskeletons. Wandercraft Website
  • European project 5GMed (H2020, 2021-2024): to do LiDAR object detection through 5G for automotive and railway cases. Project Website
  • CIFRE thesis with Kitware (2021-2023): to improve LiDAR SLAM. Kitware Website

PAST research projects

  • Research project with ANSYS (2020-2022): simulating LiDAR sensors with real LiDAR data. ANSYS Website
  • FUI24 REPLICA Project (2018-2022) : The REPLICA project was on complement existing simulation platforms with new bricks in order to bridge the gap expected in autonomous vehicle testing. Project Website


We want to thank the sponsors below:

Zulip is an open-source modern team chat app designed to keep both live and asynchronous conversations organized. Zulip Website