Please wait a minute...
Journal of ZheJiang University (Engineering Science)  2026, Vol. 60 Issue (4): 906-914    DOI: 10.3785/j.issn.1008-973X.2026.04.022
    
Joint waveform and phase shift design in integrated sensing and communication systems
Qingqing YANG1,2(),Runpeng TANG1,2,Yi PENG1,2,*()
1. School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
2. Yunnan Provincial Key Laboratory of Computer Science, Kunming University of Science and Technology, Kunming 650500, China
Download: HTML     PDF(2125KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

An irregular topology of reconfigurable intelligent surface (RIS) elements, combined with deep reinforcement learning (DRL) algorithms, was proposed to enhance the capacity of integrated sensing and communication (ISAC) systems. A simulated annealing algorithm was employed to solve the topological structure optimization problem of irregular RIS, ensuring optimal spatial utilization efficiency under a limited number of elements. Under the constraint of sensing beam pattern gain, multi-user interference (MUI) was minimized by two approaches. The first combined the Adam optimizer with traditional gradient descent. The second relied on DRL, where discrete RIS phase shifts and constant-modulus ISAC waveform design were managed by deep Q-network (DQN) and proximal policy optimization (PPO), respectively. Simulation results indicated that the weighted sum rate (WSR) of the irregular RIS-assisted system optimized by DRL increased by 13.3% compared with the conventional RIS scheme. The DRL algorithm also showed stronger capability in suppressing constant-modulus beam energy leakage. These results confirmed the feasibility of jointly optimizing irregular RIS topology and DRL algorithms in integrated sensing and communication systems.



Key wordsintegrated sensing and communication (ISAC)      irregular reconfigurable intelligent surface (RIS)      joint waveform design      phase shift matrix      deep reinforcement learning (DRL)     
Received: 14 May 2025      Published: 19 March 2026
CLC:  TN 929.5  
Fund:  国家自然科学基金资助项目 (62461030);云南省基础研究重点项目 (202401AS070105).
Corresponding Authors: Yi PENG     E-mail: 20090119@kust.edu.cn;12309214@kust.edu.cn
Cite this article:

Qingqing YANG,Runpeng TANG,Yi PENG. Joint waveform and phase shift design in integrated sensing and communication systems. Journal of ZheJiang University (Engineering Science), 2026, 60(4): 906-914.

URL:

https://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2026.04.022     OR     https://www.zjujournals.com/eng/Y2026/V60/I4/906


通信感知一体化系统中的联合波形与相移设计

针对如何在可重构智能表面(RIS)辅助通信感知一体化(ISAC)系统中有效提升系统容量的问题,提出RIS单元的不规则拓扑结构以及深度强化学习(DRL)算法. 采用模拟退火算法用于解决不规则RIS的拓扑优化问题,以提高在有限元件数量下的最优空间利用效率. 在感知波束图增益约束下,分别采用Adam优化器结合传统的梯度下降法与基于DRL的方法来解决最小化用户间干扰(MUI)的问题. 具体而言,DRL方案通过深度Q网络(DQN)与近端策略优化(PPO)这2种算法分别处理RIS的离散相移控制和ISAC的恒模波形设计. 仿真结果表明,基于DRL算法的不规则RIS辅助通感一体化系统的加权和速率(WSR)相较传统RIS方案提升了13.3%. DRL算法在抑制恒模波束能量泄漏方面具有更显著的优势,进一步验证了不规则RIS的拓扑设计和DRL算法在通感一体化系统中协同优化的可行性.


关键词: 通信感知一体化(ISAC),  不规则可重构智能表面(RIS),  联合波形设计,  相移矩阵,  深度强化学习(DRL) 
Fig.1 Model of irregular RIS-assisted integrated sensing and communication system
Fig.2 Deep neural network (DNN)
Fig.3 Schematic diagram of deep reinforcement learning network architecture
仿真参数取值
用户数量$ K $3
感知目标数量Q2
基站天线数量$ M $/根8
系统带宽$ B/\text{MHz} $10
总发射功率$ {P}_{\mathrm{t}}/\text{dBm} $25
噪声功率$ {\sigma }^{2}/\text{dBm} $?170
不规则RIS元件总数$ N_{\mathrm{s}} $128
最小波束图增益$ \varGamma /\mathrm{dBm} $10
误差范围$ \eta $0.01
初始温度$ {T}_{0} $100
温度衰减因子$ a $0.9
一阶矩估计指数衰减$ {\beta }_{1} $0.9
二阶矩估计指数衰减$ {\beta }_{2} $0.999
迭代次数$ {{\mathrm{iter}}}_{\mathrm{Adam}} $400
数值稳定因子$ \varepsilon $0.00 000 001
学习率$ {\alpha }_{\mathrm{SA}}/{\alpha }_{\mathrm{DQN}}/{\alpha }_{\mathrm{PPO}} $0.001/0.001/0.0003
折扣因子$ \gamma $0.99
经验回放池容量$ {D} $100 000
探索率$ {\varepsilon }_{\mathrm{DQN}} $1.00~0.01
裁剪范围$ {\varepsilon }_{\mathrm{PPO}} $0.2
训练回合数100
每回合步骤数8 000
Tab.1 Simulation parameter settings of irregular RIS-assisted integrated sensing and communication system
Fig.4 Weighted sum rate under different RIS topology deployment structures
Fig.5 Instantaneous reward curves for different batch sizes
Fig.6 Instantaneous reward curves under different transmission powers
Fig.7 Average reward curves under different base station transmission powers
Fig.8 Multi-user interference variation plot of proposed algorithm under different quantization levels
Fig.9 Graph of system weighted sum rate versus base station power $ {P}_{\mathrm{t}} $ under different RIS-assisted scenarios using proposed algorithm
Fig.10 Graph of system sum rate versus base station signal-to-noise ratio under different RIS-assisted scenarios using proposed algorithm
Fig.11 Graph of system weighted sum rate versus RIS element number under different RIS assistance using proposed algorithm
Fig.12 Base station beam intensity maps under different schemes
[1]   CUI Z, HU J, CHENG J, et al Multi-domain NOMA for ISAC: utilizing the DOF in the delay-Doppler domain[J]. IEEE Communications Letters, 2022, 27 (2): 726- 730
doi: 10.1109/lcomm.2022.3228873
[2]   PIN TAN D K, HE J, LI Y, et al. Integrated sensing and communication in 6G: motivations, use cases, requirements, challenges and future directions [C]// 1st IEEE International Online Symposium on Joint Communications and Sensing. Dresden: IEEE, 2021: 1–6.
[3]   WU Q, ZHANG R Beamforming optimization for wireless network aided by intelligent reflecting surface with discrete phase shifts[J]. IEEE Transactions on Communications, 2020, 68 (3): 1838- 1851
doi: 10.1109/TCOMM.2019.2958916
[4]   虞湘宾, 于凯, 钱盼盼 面向6G移动通信的可重构智能反射表面技术研究综述[J]. 南京航空航天大学学报, 2023, 55 (5): 745- 756
YU Xiangbin, YU Kai, QIAN Panpan Overview of reconfigurable intelligent surface for 6G mobile communication[J]. Journal of Nanjing University of Aeronautics and Astronautics, 2023, 55 (5): 745- 756
doi: 10.16356/j.1005-2615.2023.05.001
[5]   DI B, ZHANG H, SONG L, et al Hybrid beamforming for reconfigurable intelligent surface based multi-user communications: achievable rates with limited discrete phase shifts[J]. IEEE Journal on Selected Areas in Communications, 2020, 38 (8): 1809- 1822
doi: 10.1109/JSAC.2020.3000813
[6]   NASSAR F, SINGH K, PRAKRIYA S, et al. Robust beamformer design for backscatter-enabled RIS-assisted NOMA ISAC [C]// IEEE International Conference on Communications Workshops. Denver: IEEE, 2024: 608–613.
[7]   CHEN J, WU K, NIU J, et al Spectral and energy efficient waveform design for RIS-assisted ISAC[J]. IEEE Transactions on Communications, 2025, 73 (1): 158- 172
doi: 10.1109/TCOMM.2024.3435030
[8]   ZHANG S, XIAO Z, LIU R, et al Multipath exploitation for fluctuating target detection in RIS-assisted ISAC systems[J]. IEEE Wireless Communications Letters, 2024, 13 (9): 2392- 2396
doi: 10.1109/LWC.2024.3416453
[9]   CHEN K, QI C, DOBRE O A, et al Simultaneous beam training and target sensing in ISAC systems with RIS[J]. IEEE Transactions on Wireless Communications, 2024, 23 (4): 2696- 2710
doi: 10.1109/TWC.2023.3302319
[10]   LYU W, XIU Y, YANG S, et al Energy-efficient cell-free network assisted by hybrid RISs[J]. IEEE Wireless Communications Letters, 2023, 12 (4): 718- 722
doi: 10.1109/LWC.2023.3241644
[11]   ZHU Q, LI M, LIU R, et al Cramér-Rao bound optimization for active RIS-empowered ISAC systems[J]. IEEE Transactions on Wireless Communications, 2024, 23 (9): 11723- 11736
doi: 10.1109/TWC.2024.3384501
[12]   ZHU Q, LI M, LIU R, et al Joint transceiver beamforming and reflecting design for active RIS-aided ISAC systems[J]. IEEE Transactions on Vehicular Technology, 2023, 72 (7): 9636- 9640
doi: 10.1109/TVT.2023.3249752
[13]   ZHANG Y, REN H, PAN C, et al Secure wireless communication in active RIS-assisted DFRC systems[J]. IEEE Transactions on Vehicular Technology, 2025, 74 (1): 626- 640
doi: 10.1109/TVT.2024.3438151
[14]   褚宏云, 杨梦瑶, 黄航, 等 混合智能反射面辅助的通信感知一体化: 高能效波束成形设计[J]. 电子与信息学报, 2024, 46 (6): 2462- 2469
CHU Hongyun, YANG Mengyao, HUANG Hang, et al Hybrid reconfigurable intelligent surface assisted integrated sensing and communication: energy efficient beamforming design[J]. Journal of Electronics and Information Technology, 2024, 46 (6): 2462- 2469
doi: 10.11999/JEIT230699
[15]   SU R, DAI L, TAN J, et al Capacity enhancement for reconfigurable intelligent surface-aided wireless network: from regular array to irregular array[J]. IEEE Transactions on Vehicular Technology, 2023, 72 (5): 6392- 6403
doi: 10.1109/TVT.2023.3236179
[16]   EL-MEADAWY S A, ZHU P, KHALLAF H S Multilayer irregular RIS-assisted wireless communication system performance optimization[J]. IEEE Internet of Things Journal, 2025, 12 (1): 931- 949
[17]   LIU Q, ZHU Y, LI M, et al DRL-based secrecy rate optimization for RIS-assisted secure ISAC systems[J]. IEEE Transactions on Vehicular Technology, 2023, 72 (12): 16871- 16875
doi: 10.1109/TVT.2023.3297602
[18]   ZHU Z, GONG M, CHU Z, et al. DRL-based STAR-RIS-assisted ISAC secure communications [C]// International Conference on Ubiquitous Communication. Xi’an: IEEE, 2023: 127–132.
[19]   MOHAMMED S K, LARSSON E G Per-antenna constant envelope precoding for large multi-user MIMO systems[J]. IEEE Transactions on Communications, 2013, 61 (3): 1059- 1071
doi: 10.1109/TCOMM.2013.012913.110827
[20]   LIU F, ZHOU L, MASOUROS C, et al Toward dual-functional radar-communication systems: optimal waveform design[J]. IEEE Transactions on Signal Processing, 2018, 66 (16): 4264- 4279
doi: 10.1109/TSP.2018.2847648
[21]   STOICA P, LI J, XIE Y On probing signal design for MIMO radar[J]. IEEE Transactions on Signal Processing, 2007, 55 (8): 4151- 4161
doi: 10.1109/TSP.2007.894398
[22]   HU C, DAI L, HAN S, et al Two-timescale channel estimation for reconfigurable intelligent surface aided wireless communications[J]. IEEE Transactions on Communications, 2021, 69 (11): 7736- 7747
doi: 10.1109/TCOMM.2021.3072729
[23]   KIRKPATRICK S, GELATT C D Jr, VECCHI M P Optimization by simulated annealing[J]. Science, 1983, 220 (4598): 671- 680
doi: 10.1126/science.220.4598.671
[24]   HAJEK B Cooling schedules for optimal annealing[J]. Mathematics of Operations Research, 1988, 13 (2): 311- 329
doi: 10.1007/978-1-4612-4808-8_42
[25]   SHI Y, YANG K, JIANG T, et al Communication-efficient edge AI: algorithms and systems[J]. IEEE Communications Surveys and Tutorials, 2020, 22 (4): 2167- 2191
doi: 10.1109/COMST.2020.3007787
[1] Wei ZHOU,Wenjing DOU,Qianqian LI,Rui XU. GSM-OTFS signal detection algorithm based on belief propagation and expectation propagation[J]. Journal of ZheJiang University (Engineering Science), 2024, 58(12): 2609-2618.
[2] Lang-tao HU,Rui YANG,Chong-wen HUANG,Quan-jin LIU,Lei WU,Zhen-kun TAN. Performance optimization of RIS assisted dual-function radar and covert communication system[J]. Journal of ZheJiang University (Engineering Science), 2023, 57(12): 2533-2543.
[3] Jun-jie CHEN,Hong-jun LI,Xiao-jun ZHU. Dynamic deployment algorithm of 5G core network user plane using Benders decomposition[J]. Journal of ZheJiang University (Engineering Science), 2023, 57(3): 625-631.
[4] RONG Zhi-neng, JIN Wen-guang, LUO Yi-xi. Design of wireless network on human motion capture[J]. Journal of ZheJiang University (Engineering Science), 2012, 46(7): 1314-1319.
[5] QIU Qin-long, WU Chun-ming , PING Ling-di , LV Hong-bing. Retransmitting TCP acknowledgement packet and its application
in long term evolution network
[J]. Journal of ZheJiang University (Engineering Science), 2011, 45(9): 1509-1515.
[6] ZHAO Xian-hong, YANG Jun, ZHAO Li-min. Novel nulling forming algorithm based on amplitude perturbation[J]. Journal of ZheJiang University (Engineering Science), 2011, 45(1): 64-67.
[7] CHEN Xun, ZHANG Chao-Yang, LUO Hai-Yan. Joint optimization of power control, channel assignment and scheduling in wireless mesh network[J]. Journal of ZheJiang University (Engineering Science), 2009, 43(8): 1406-1411.