Virtual Reality and Augmented Reality


https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/get-ready-to-learn-autonomous-driving-using-VR-864x338.png

Research - VR & AR

We design and evaluate XR environments for industrial, cultural and therapeutic use cases.

Our core scientific contribution is to characterize user experience in XR environments by means of novel metrics at the perceptive and functional levels.

Our objective is to contribute to the understanding of how immersion, interaction, and implemented models influence user experience.


Job Offers

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/Capture-décran-2024-04-11-à-13.53.34-150x150.png
https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/PDF_file_icon-50x65.png

PhD position (36 Months) : Multimodal interaction in XR for the transmission of craft know-how.
The position is currently open (April 11th 2024), starting end 2024, we welcome applications as of now, until filled.

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/casa2019-150x150.png
https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/PDF_file_icon-50x65.png

THIS POSITION HAS BEEN FILLED
Post-doctoral position (12 Months) : XR and optimization models for improving workstation ergonomics
Robotics Center, Mines Paris PSL University. The position has been filled, . We will repost in the usual networks if it reopens.


Current research projects

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/AR-Spectral-Factory-View-300x200.jpghttps://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/AR-Spectral-diagram-200x100.jpg

Adaptive AR in factory settings - in collaboration with Spectral TMS
PhD Thesis of Camille Truong-Allié


https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/Vitruvian_Man_by_Leonardo_da_Vinci-scaled-300x300.jpeg

EMBODXR - Using XR in Physical therapy - in collaboration with ISRP
PhD Thesis of Alexis Berland - Postdoc of Youssouf Ismail Cherifi


https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/frenchtouchfactory-holocap3D-danseur-hiphop-LeMonfortTheatre-1-340x200.jpeg

ITHACA - Immersive Training with Holograms for Arts Cultural and Audiovisual - Funded by Horizon Europe within the CREA-CROSS-2022-INNOVLAB call. In collaboration with Fraunhofer Institute and French Touch Factory 

Former results on the subject : ColibriVR Project - Website


https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/human-robot-collaboration-300x300.jpg

OPERGO-TMS - Optimizing workstation ergonomics using a multimodal approach to reduce musculoskeletal disorders. Funded by the Ministry of Higher Education, Research and Innovation. In collaboration with IMT Mines Alès, UMR EuroMov Digital Health in Motion. Involved researchers : Maryam Boumrah, Alexis Paljic.


People

Permanent staff

Post-doctoral researchers

PhD students

  • Alexis Berland (2023-) : Formation du psychomotricien : modélisation des symptômes moteurs des troubles de la coordination en XR. Etude de l’incarnation de ces symptômes. In collaboration with ISRP and Sorbonne Université.
  • Hugo Blanc (2023-) : Physico-realistic differentiable rendering of point clouds for interactive visualization of real environments. Applications to cultural heritage for the study of archaeological objects and the virtual visit of monuments. In collaboration with Jean-Emmanuel Deschaud
  • Iad Abdul Raouf (2022-) : Relocalisation et fermeture de boucle magnéto-visuelle. In collaboration with Cyril Joly.

Former PhD students:

  • Camille Truong-Allié (2020-2024) : Information balance and density in AR assistance. In collaboration with Spectral
  • Brenda Olivas Padilla  (2019-2023) : Wearable sensing and movement modeling for the monitoring of operators in manufacturing. Coll. with Sotiris Manitsaris.
  • Grégoire Dupont de Dinechin. Towards comfortable virtual reality viewing of virtual environments created from photographs of the real world. 2017-2020
  • Daniele Sportillo. Get ready for automated driving with Mixed Reality. CIFRE Groupe PSA. 2016-2019
  • Florent Taralle. CIFRE SAGEM. Gestural control for mobile robots. 2013-2016
  • Victor Medina. CIFRE Groupe PSA Peugeot Citroën. Visuo-Perceptual validation methods for physically based image synthesis. 2013-2016
  • Fernando da Graça. Perceptive validations of physico-realistic stereoscopic images of materials based on microstructure models. 2012-2015
  • Vincent Weistroffer. Assessing the acceptability of human-robot collaboration using virtual reality. 2011-2014
  • Jean-François Jégo. User-Defined Gestural Interaction for Virtual Reality. 2010-2013
  • Nan Wang. Interaction and visualization techniques for immersive exploration and perception of 3D datasets. 2009-2012
  • Vincent Meyrueis. Interactive shape modifications in virtual reality : applications to product design. 2008-2011
  • Laure Leroy. Stereoscopic picture processing with wavelet transform fo an adapted stereoscopic vision. 2006-2009

PUBLICATIONS

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/real_world_element_placement-150x150.png

AR Authoring: How to Reduce Errors from the Start?
(Best Student Paper Award 2024) Camille Truong-Allié, Martin Herbeth, Alexis Paljic In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - HUCAPP
Paper

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/Capture-decran-2023-05-02-142645-150x150.png

A study of the influence of AR on the perception, comprehension and projection levels of situation awareness
Camille Truong-Allié, Alexis Paljic, Martin Herbeth.
IEEE Conference on Virtual Reality and 3D User Interfaces, 2023.

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/AR-Adaptative-1-Spectral-150x150.png

User Behavior Adaptive AR Guidance for Wayfinding and Tasks Completion.
Camille Truong-Allié, Alexis Paljic, Alexis Roux, Martin Herbeth.
Multimodal Technologies and Interaction, 2021.
Paper

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/lightfield-museum-150x150.png

Impact of View-Dependent Image-Based Effects on Perception of Visual Realism and Presence in Virtual Reality Environments Created Using Multi-Camera Systems.
Grégoire Dupont de Dinechin, Alexis Paljic, Jonathan Tanant
Applied Sciences, MDPI, 2021
Paper

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/colibri2-150x150.png

From Real to Virtual: An Image-Based Rendering Toolkit to Help Bring the World Around Us Into Virtual Reality.
Grégoire Dupont de Dinechin, Alexis Paljic.
2020 IEEE Workshop on Everyday Virtual Reality. 2020
Paper    Github

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/casa2019-150x150.png

Virtual Agents from 360° Video for Interactive Virtual Reality. 
Grégoire Dupont de Dinechin, Alexis Paljic.
International Conference on Computer Animation and Social Agents. 2019
Paper    Video

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/Capture-décran-2022-01-27-à-20.51.09-150x150.png

Automatic Generation of Interactive 3D Characters and Scenes for Virtual Reality from a Single-Viewpoint 360-Degree Video.
Grégoire Dupont de Dinechin, Alexis Paljic.
IEEE VR 2019
Poster

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/on-road-evaluation-XR-trianing-150x150.png

On-Road Evaluation of Autonomous Driving Training.
Daniele Sportillo, Alexis Paljic, Luciano Ojeda.
ACM/IEEE International Conference on Human Robot Interaction, 2019,
Paper Video

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/Capture-décran-2022-01-27-à-21.05.35-150x150.png

Cinematic Virtual Reality With Motion Parallax From a Single Monoscopic Omnidirectional Image.
Grégoire Dupont de Dinechin, Alexis Paljic.
Digital HERITAGE 2018
Paper   Video

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/Autonomous-driving-training-150x150.png

Learn how to operate semi-autonomous vehicles with Extended Reality.
Daniele Sportillo, Alexis Paljic, Luciano Ojeda, Giacomo Partipilo, Philippe Fuchs, et al.
International Workshop on Virtual, Augmented and Mixed Reality for Human-Robot Interaction, 2018
Paper

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/VR-training-Accident-Analysis-and-Prevention-150x150.png

Get ready for automated driving using Virtual Reality
Daniele Sportillo, Alexis Paljic, Luciano Ojeda
Accident Analysis and Prevention, 2018
Paper

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/realistic-vs-6dof-for-driving-training-150x150.png

An immersive Virtual Reality system for semi-autonomous driving simulation: a comparison between realistic and 6-DoF controller-based interaction.
Daniele Sportillo, Alexis Paljic, Mehdi Boukhris, Philippe Fuchs, Luciano Ojeda
International Conference on Computer and Automation Engineering, 2017
Paper

TEACHING

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/3D-Modeling-300x300.jpeg

3D Modeling

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/Photogrammetry-300x300.jpg

Photogrammetry

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/3D-Interaction-300x300.jpg

3D Interaction

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/Programmation-300x300.jpg

3D Interaction Programming

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/Patent-300x300.jpg

Economic models

https://www.caor.minesparis.psl.eu/wp-content/uploads/2022/01/Ethique-300x300.jpg

Ethics