Research Scientist Intern, 3D World Modeling, Robotics and Generative AI (PhD)

About the role

The Meta Reality Labs Research Team brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR. The Surreal Vision group at RL Research is seeking exceptional Research Scientists to research and help build the egocentric machine perception functionalities and digital twins of 3D scenes that will underpin future VR and contextual-AI-enabled AR devices. The research intern will work on cutting edge research problems to innovate novel computer vision and machine learning techniques.

Collaborate with researchers to advance work across multiple research areas, including:

• Developing novel egocentric world models for action-conditioned video synthesis.
• Evaluating different egocentric input modalities (e.g., hand pose, head pose, eye gaze, body pose).
• Establish multimodal generation models including RGB video, 2D/3D flow, and depth maps.
• Curating and post-processing large-scale datasets to enable effective training.
• Investigating the impact of world models on RL algorithms for policy learning.
• Benchmarking against state-of-the-art approaches and compiling results for scientific conference submission.

Our internships are twelve (12) to twenty-four (24) weeks long and we have various start dates throughout the year.