#47 · Primary category: Robotics & Embodied AI Simulation
VLN-CE
Vision-and-Language Navigation in Continuous Environments using Habitat
Project last updated:01/07/25
GitHub Stars
859
Forks
90
Contributors
3
License
MIT
Why we included this project
This repo is the reference implementation for Vision-and-Language Navigation in Continuous Environments (VLN-CE), a research task where an agent follows natural-language instructions while moving freely through a photorealistic 3D scene instead of hopping between predefined nodes. That distinction matters a lot for embodied AI and instruction-following work, and it has made VLN-CE a common ground for comparing models. The code bundles the official baseline agents, training methods, and data loaders for both the Room-to-Room (R2R) and Room-Across-Room (RxR) datasets atop the Habitat simulator, and it anchors the recurring VLN-CE and RxR-Habitat benchmark challenges. If you are building navigation agents, this is a practical starting point that saves you from wiring up dataset downloads, episode management, and evaluation from scratch.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
genesis-world
Simulation platform for general-purpose robotics & embodied AI learning.
lerobot
🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning
ml-agents
The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.
AirSim
Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research
carla
Open-source simulator for autonomous driving research.