RoboTron-Nav: A Unified Framework for Embodied Navigation Integrating Perception, Planning, and Prediction (original) (raw)
Abstract:In language-guided visual navigation, agents locate target objects in unseen environments using natural language instructions. For reliable navigation in unfamiliar scenes, agents should possess strong perception, planning, and prediction capabilities. Additionally, when agents revisit previously explored areas during long-term navigation, they may retain irrelevant and redundant historical perceptions, leading to suboptimal results. In this work, we propose RoboTron-Nav, a unified framework that integrates perception, planning, and prediction capabilities through multitask collaborations on navigation and embodied question answering tasks, thereby enhancing navigation performances. Furthermore, RoboTron-Nav employs an adaptive 3D-aware history sampling strategy to effectively and efficiently utilize historical observations. By leveraging large language model, RoboTron-Nav comprehends diverse commands and complex visual scenes, resulting in appropriate navigation actions. RoboTron-Nav achieves an 81.1% success rate in object goal navigation on the mathrmCHORES\mathrm{CHORES}mathrmCHORES-$\mathbb{S}$ benchmark, setting a new state-of-the-art performance. Project page: this https URL
Submission history
From: Yufeng Zhong [view email]
[v1] Mon, 24 Mar 2025 10:29:47 UTC (3,529 KB)
[v2] Wed, 6 Aug 2025 09:31:48 UTC (2,342 KB)
[v3] Thu, 7 Aug 2025 08:10:12 UTC (2,342 KB)
[v4] Fri, 8 Aug 2025 11:19:25 UTC (2,342 KB)