基于深度强化学习的卫星跳波束资源分配研究
DOI:
CSTR:
作者:
作者单位:

1.南京信息工程大学电子与信息工程学院 南京 210044; 2.国防科技大学第六十三研究所 南京 210007

作者简介:

通讯作者:

中图分类号:

TN927+.2

基金项目:


Research on resource allocation for satellite beam hopping based on deep reinforcement learning
Author:
Affiliation:

1.School of Electronics and Information Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China; 2.The Sixty-third Research Institute, National University of Defense Technology,Nanjing 210007, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对低轨(lowearthorbit,LEO)卫星跳波束系统中功率、带宽与时隙资源强耦合导致的分配效率低,进而制约用户满意度提升的问题,提出一种基于Rainbow深度Q网络(quality of service,DQN)深度强化学习的LEO卫星跳波束功率-带宽联合分配方案。首先综合考虑信道状态信息、队列状态信息和业务需求等特征构建多维状态空间,以最大化用户满意度为目标建立了时隙、功率和带宽资源联合优化模型。其次,考虑LEO卫星环境下多变的用户需求以及用户状态等信息,采用DQN进行时隙分配的学习以及采用依赖域内点法输出功率分配从而满足用户需求。最后,为实现并加速算法在任务的收敛过程,引入Rainbow DQN算法,通过融合多技术的优化特性,快速生成LEO卫星系统的时隙-功率-带宽联合分配策略。仿真结果表明,所提出的资源分配方案能够优化LEO卫星跳波束系统的功率与带宽联合配置,提升用户满意度与算法训练稳定性,并有效验证多技术融合强化学习在离散动作空间中的应用优势。

    Abstract:

    To address the problem of low allocation efficiency caused by the strong coupling of power, bandwidth and timeslot resources in low earth orbit (LEO) satellite beam hopping systems, which further restricts the improvement of user satisfaction, this paper proposes a joint power-bandwidth allocation scheme for LEO satellite beam hopping systems based on Rainbow deep Q-network (DQN) deep reinforcement learning. First, a multi-dimensional state space is constructed by comprehensively considering features such as channel state information, queue state information and service requirements, and a joint optimization model for timeslot, power and bandwidth resources is established with the goal of maximizing user satisfaction. Second, considering the variable user demands and user states in the LEO satellite environment, the DQN is adopted for timeslot allocation learning, and the trust region interior point method is used to output power allocation to meet user requirements. Finally, to achieve and accelerate the convergence of the algorithm in the task, the Rainbow DQN algorithm is introduced in this paper.By integrating the optimization characteristics of multiple technologies, it rapidly generates the joint timeslot-power-bandwidth allocation strategy for the LEO satellite system. Simulation results show that the proposed resource allocation scheme can optimize the joint power and bandwidth configuration of the LEO satellite beam hopping system, improve user satisfaction and algorithm training stability, and effectively verify the application advantages of multi-technology fusion reinforcement learning in discrete action spaces.

    参考文献
    相似文献
    引证文献
引用本文

帅俊辉,王恒,冯姣,谢世珺.基于深度强化学习的卫星跳波束资源分配研究[J].电子测量技术,2026,49(15):173-184

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-10-23
  • 出版日期:
文章二维码

重要通知公告

①《电子测量技术》期刊收款账户变更公告