面向城市场景的无人机视觉语言导航网络
DOI:
CSTR:
作者:
作者单位:

1.贵州大学大数据与信息工程学院 贵阳 550025; 2.贵州大学公共大数据国家重点实验室 贵阳 550025

作者简介:

通讯作者:

中图分类号:

V279;TN99

基金项目:

贵州省科学技术基金资助项目(黔科合基础[2016]1054)、贵州省普通高等学校工程研究中心项目(黔教合KY字[2018]007)资助


UAV vision-and-language navigation network under urban scenarios
Author:
Affiliation:

1.College of Big Data and Information Engineering, Guizhou University, Guiyang 550025, China; 2.State Key Laboratory of Public Big Data, Guizhou University, Guiyang 550025, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对无人机视觉语言导航(unmanned aerial vehicle vision-and-language navigation,UAV-VLN)中多模态特征融合不足、全局环境感知能力有限以及长视距规划性能欠佳的问题,开展了基于历史增强的双尺度混合专家网络方法研究。该方法构建由全局混合专家网络与局部混合专家网络组成的双尺度结构,全局网络融合语言描述与导航地图特征以实现全局语义推理,局部网络结合视觉观测与语言特征以完成细粒度语义感知,从而在不同尺度上增强跨模态信息理解能力。为提升时序建模与长期依赖捕获能力,引入基于矩阵长短期记忆网络(matrix long short-term memory,mLSTM)的历史记忆编码器,实现历史观测与当前状态的动态融合。进一步设计导航目标-进度协同预测模块,通过目标预测头与任务进度预测头联合估计智能体的空间位置与任务阶段,提升导航决策的连续性与可解释性。在城市级UAV-VLN数据集CityNav上进行实验验证,结果显示该方法在导航成功率(success rate,SR)和路径加权导航成功(success weighted by path length,SPL)上分别达到16.42%和18.26%,较基线模型提升10.04%和12.18%,显著增强了智能体在复杂城市场景下的跨模态理解、时序决策与长视距导航推理能力。

    Abstract:

    To address the limitations of unmanned aerial vehicle vision-and-language navigation (UAV-VLN) in multimodal feature fusion, global environment perception and long-distance planning, a history-enhanced dual-scale mixture-of-experts network is proposed. The proposed framework constructs a dual-scale structure composed of a global mixture-of-experts network and a local mixture-of-experts network. Specifically, the global network integrates linguistic descriptions with navigational map features to perform global semantic reasoning, while the local network combines visual observations and linguistic features to enable fine-grained semantic perception, thereby enhancing cross-modal understanding at different scales. To strengthen temporal modeling and long-term dependency capture, a historical memory encoder based on a matrix long short-term memory (mLSTM) network is introduced to dynamically fuse historical observations with the current state. Furthermore, a goal-progress co-prediction module is designed to jointly estimate the agent′s spatial position and task stage through a goal prediction head and a progress prediction head, thereby improving the continuity and interpretability of navigation decisions. Experiments conducted on the city-scale UAV-VLN CityNav dataset demonstrate that the proposed method achieves a success rate (SR) of 16.42% and a success weighted by path length (SPL) of 18.26%, outperforming the baseline model by 10.04% and 12.18%, respectively. These results verify that the proposed approach substantially enhances cross-modal understanding, temporal reasoning and long-distance navigation capability under urban scenarios.

    参考文献
    相似文献
    引证文献
引用本文

王荣虎,刘紫燕.面向城市场景的无人机视觉语言导航网络[J].电子测量技术,2026,49(14):241-252

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-10-15
  • 出版日期:
文章二维码

重要通知公告

①《电子测量技术》期刊收款账户变更公告