Mistral's Robostral Navigate: a state of the art robotics navigation model

ottomengis1 pts0 comments

Robostral Navigate: single-camera AI navigation | Mistral AI

Categories<br>Product

Research

Engineering

Solutions

Company

Featured stories

ASML

CMA CGM

HSBC

BMW

See all

Who we are

About us

Careers

Brand

Connect<br>Community

Partners

Help center

Studio<br>Build, test, and run AI agents and apps.

Forge<br>Train, align, and evaluate custom AI models.

Vibe<br>AI agent for long-horizon work.

Vibe for code<br>Coding agents in the terminal, IDE, and background.

Compute<br>Frontier-scale infrastructure for training and inference.

Pricing

Plans

API pricing

For enterprises

Services

Delivery methodology

Model customization

Industries

Financial services

Public sector & government

Manufacturing

Use cases

Use case overview

Coding

Document intelligence

Speech

Latest models

Mistral OCR 4

Mistral Medium 3.5

Mistral Small 4

Voxtral TTS

Docs

API Reference

Cookbooks

Latest posts

Introducing Robostral Navigate

Leanstral 1.5: Proof Abundance for All

Bringing more control over your connectors

Categories

Product

Research

Engineering

Solutions

Company

Featured stories

ASML

CMA CGM

HSBC

BMW

Who we are

About us

Careers

Brand

Connect

Community

Partners

Help center

Start building

Studio

Vibe

Vibe for Code

Contact sales

← + &minus;<br>Introducing Robostral Navigate

Thinking<br>Summary

Robostral Navigate is an 8B model that enables robots to autonomously navigate complex environments using only a single RGB camera, achieving 76.6% success on unseen R2R-CE benchmarks—outperforming multi-sensor approaches while being more efficient. Built entirely in-house with simulation-trained data and token-efficient techniques, it generalizes across robot types and adapts to real-world obstacles unseen during training. The model combines pointing-based navigation with reinforcement learning for continuous improvement, paving the way for unified embodied AI in robotics.

Today we're introducing Robostral Navigate, our first model built for embodied navigation. It's an 8B model that takes RGB images and a plain-language instruction and moves a robot through an environment:<br>“Leave the lobby, walk through the corridor, enter the supply room, and stop to face the second shelf.”<br>To perform such tasks, other models often employ depth sensors, LiDAR, or several cameras working together. Robostral Navigate uses only one ordinary RGB camera and no depth sensors, yet still achieves 76.6% on R2R-CE (Room-to-Room in Continuous Environments) validation unseen, the benchmark for following instructions in environments held out of training. Consequently, it beats the best single-camera approach by 9.7 points and the best system using depth or multiple cameras by 4.5 points, despite using neither.<br>Navigation<br>Our model is designed for robotic navigation, enabling robots to autonomously navigate complex environments, including offices, residential and commercial buildings, and outdoor settings.

Robostral Navigate running fully autonomously in one long-horizon instruction route through a working office.<br>This technology unlocks numerous applications across manufacturing, delivery, logistics, and hospitality, making it one of the most in-demand capabilities for our customers today. Give Robostral Navigate one instruction and it completes the entire task on its own, moving through a live space full of people and obstacles it was never shown, capable of adapting to any setting.<br>Highlights<br>State-of-the-art performance on R2R-CE

79.4% Success Rate on validation seen

76.6% Success Rate on validation unseen

Operates from a single RGB camera, with no LiDAR or depth sensors

8B model, built in-house and trained entirely in simulation

Runs on wheeled, legged, and flying robots, and generalizes across robot sizes

Robust to differences in camera intrinsics

Token-efficient training via prefix-caching

Success Rate

Oracle Success Rate

Success weighted by path length

Navigation Error

Navigation via pointing<br>Given a task and a history of observations, Robostral Navigate predicts where the robot should move next via pointing: it infers the image coordinates of the target location in the robot's current camera view, together with the desired orientation upon arrival. Unlike commands relying on metric displacements, pointing makes the policy naturally robust to changes in camera intrinsics and world scale.<br>However, this method cannot handle cases where the target location lies outside the current field of view. When pointing does not apply, the model falls back to displacements in the robot's local coordinate frame, such as:<br>"Move 2 meters forward, 1.5 meters to the left, and turn 25 degrees left."<br>Built from the ground up<br>Robostral Navigate is built entirely in-house and does not rely on existing open-source VLMs.<br>The model is initialized from our vision-language model specialized for grounding tasks such as pointing, counting, and object localization. Navigation emerges as a natural extension of these capabilities: once it...

navigate robostral model navigation camera success

Related Articles