RPV: Room Probability Vectors for Indoor Semantic Navigation

1University of Technology Sydney, Robotics Institute

Example episode in the Habitat simulator. Agent is tasked with finding a bed in an unknown scene.

Sensor suite

Graphical overview of our proposed framework. Objects visible by the agent that have a high spatial relationship to the target emit stronger signals. (Figure partially generated using Nano Banana 2).

Abstract

Zero-shot ObjectNav methods increasingly use vision-language priors, but direct object-object similarity in the latent space is often a weak proxy for spatial co-occurrence. We present an analytical, training-free semantic navigation pipeline that mediates object relationships through a compact room lexicon. Each object label is mapped to a CLIP-derived Room Probability Vector (RPV), and object-target co-occurrence is computed from RPV distribution overlap. These scores are projected onto a value map using geodesic flood-fill propagation (Fast Marching Method), with adaptive signal decay, and are used to rank frontiers by semantic score for navigation.

Together, these components form an integrated, training‑free, object‑centric pipeline for open‑vocabulary zero‑shot navigation. Results show that our object-centric approach improves Success Rate (SR) and Success by weighted inverse Path Length (SPL) by a relative 3% and 1.3%, respectively, compared to image-holistic baselines on the HM3D dataset validation split, while preserving interpretability and open-vocabulary flexibility.

Experimentation