Please wait a minute...
Journal of ZheJiang University (Engineering Science)  2026, Vol. 60 Issue (12): 2673-2682    DOI: 10.3785/j.issn.1008-973X.2026.12.013
    
Bispectral synergetic feature-based multi-sensor fusion navigation for AUV
Chao WEI(),Lingfeng CHEN,Yunong WANG,Shibo LU,Yuanxin XU*()
College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310058, China
Download: HTML     PDF(2819KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

A bispectral synergetic network (BiSN) was proposed for dual-dimensional cooperative feature extraction in the frequency domain in order to overcome the limitation of single temporal dimension representation in characterizing navigation states and capturing sensor interaction characteristics. Time-series signals were converted to frequency domain by using the fast Fourier transform (FFT), and significant frequency components were extracted. The one-dimensional sequence was reshaped into a two-dimensional structure based on frequency and discrete period. This approach enabled the joint exploration of temporal dynamics and cross-sensor interactions. The simulation results demonstrate that the proposed method significantly improves navigation accuracy compared with state-of-the-art models. The proposed model exhibits strong performance in reconstructing missing sensor data, thereby enhancing the robustness of the navigation system.



Key words: autonomous underwater vehicle      AUV navigation      frequency domain      deep learning      data imputation     
Received: 09 November 2025      Published: 21 October 2026
CLC:  U 666  
Fund:  浙江省自然科学基金资助项目(LMS26F010003);国家重点研发计划资助项目(2021YFC2800101).
Corresponding Authors: Yuanxin XU     E-mail: 22331154@zju.edu.cn;xuyx@zju.edu.cn
Cite this article:

Chao WEI,Lingfeng CHEN,Yunong WANG,Shibo LU,Yuanxin XU. Bispectral synergetic feature-based multi-sensor fusion navigation for AUV. Journal of ZheJiang University (Engineering Science), 2026, 60(12): 2673-2682.

URL:

https://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2026.12.013     OR     https://www.zjujournals.com/eng/Y2026/V60/I12/2673


基于频域双维协同特征的AUV多传感器融合导航

为了克服单一时间维度表示对导航状态刻画和传感器交互特性捕捉不足的局限,提出基于频域双维度协同特征提取的模型(BiSN). 该模型通过快速傅里叶变换(FFT)将时域信号转换至频域,提取显著频率分量后,将一维序列重塑为频率-离散周期的二维结构,协同挖掘传感器在时间维度上的变化趋势与多传感器读数之间的关联特征. 仿真实验表明,该方法的导航精度较当前先进模型显著提升. 所提模型在传感器缺失数据填补方面表现出色,增强了导航系统的鲁棒性.


关键词: 水下自主航行器,  AUV导航,  频域,  深度学习,  数据填补 
Fig.1 Diagram of navigation task problem definition
Fig.2 Comparison of time-domain and frequency-domain characteristics of real sensor signals
Fig.3 Overall architecture of BiSN
Fig.4 Schematic diagram of two-dimensional structure reconstruction based on frequency domain analysis
Fig.5 AUV simulation trajectory plan view
模型导航填补1(96步长)填补2(196步长)
RMSEMAEMSEMAEMSEMAE
TimeMixer0.20630.14410.00340.00860.00980.0290
TimeXer0.61140.5154————
TimesNet0.16650.09420.00090.00970.00540.026 0
PatchTST0.18890.12970.001 00.01010.00230.0162
iTransformer0.454 00.2831————
DLinear0.20730.15130.10660.15030.11620.1576
NonstationTransformer0.167 00.09850.00760.02500.00980.0338
FEDformer0.23030.16890.01010.02750.03440.053 0
BiSN0.14440.06860.00040.00770.001 00.0121
Tab.1 Accuracy comparison of models on navigation and imputation tasks using simulation dataset
模型Np/106t/s
导航填补1填补2
TimeMixer0.1212.3219.5880.0021
TimeXer0.023——0.0033
TimesNet0.0450.3570.3860.0071
PatchTST0.0130.0500.1620.0025
iTransformer0.014——0.0019
DLinear0.0080.0040.0040.0018
NonstationTransformer0.1110.1160.1420.0047
FEDformer0.0350.0540.0500.0181
BiSN0.0951.3962.4960.0096
Tab.2 Comparison of parameters and inference time of different model
组合导航填补1填补2
RMSEMAEMSEMAEMSEMAE
time0.16920.09510.00100.01100.00490.0247
sensor0.18610.12620.00070.00850.00150.0143
time+平稳因子0.16860.09560.00090.01070.00480.0245
sensor+平稳因子0.18590.12610.00050.00780.00140.0141
time+sensor0.14680.07180.00050.00870.00120.0129
time+sensor+ 平稳因子0.14440.06860.00040.00770.00100.0121
Tab.3 Ablation results of proposed model with different component configurations
Fig.6 Error comparison between BiSN and TimesNet in navigation tasks
Fig.7 Visualization of navigation trajectories of BiSN and TimesNet
Fig.8 Visualization of data imputation tasks for BiSN, TimesNet and PatchTST
[1]   李洋, 赵鸣, 徐梦瑶, 等 多源信息融合技术研究综述[J]. 智能计算机与应用, 2019, 9 (5): 186- 189
Li Yang, Zhao Ming, Xu Mengyao, et al A survey of research on multi-source information fusion technology[J]. Intelligent Computer and Applications, 2019, 9 (5): 186- 189
doi: 10.3969/j.issn.2095-2163.2019.05.043
[2]   Sun Y, Li J, Xu Y, et al Deep learning versus conventional methods for missing data imputation: a review and comparative study[J]. Expert Systems with Applications, 2023, 227: 120201
doi: 10.1016/j.eswa.2023.120201
[3]   Deraz A A, Badawy O, Elhosseini M A, et al Deep learning based on LSTM model for enhanced visual odometry navigation system[J]. Ain Shams Engineering Journal, 2023, 14 (8): 102050
doi: 10.1016/j.asej.2022.102050
[4]   Zhi Z, Liu D, Liu L A performance compensation method for GPS/INS integrated navigation system based on CNN-LSTM during GPS outages[J]. Measurement, 2022, 188: 110516
doi: 10.1016/j.measurement.2021.110516
[5]   Tng Y, Jiang J, Liu J, et al A GRU and AKF-based hybrid algorithm for improving INS/GNSS navigation accuracy during GNSS outage[J]. Remote Sensing, 2022, 14 (3): 752
doi: 10.3390/rs14030752
[6]   Liu Y, Hu T, Zhang H, et al. iTransformer: inverted Transformers are effective for time series forecasting [C]//The 12th International Conference on Learning Representations, 2024: 1−25.
[7]   Liu Y, Wu H, Wang J, et al. Non-stationary Transformers: exploring the stationarity in time series forecasting [C]//Advances in Neural Information Processing Systems 35. Red Hook, NY: Curran Associates, Inc. , 2022: 9881-9893.
[8]   Nie Y, Nguyen N H, Sinthong P, et al. A time series is worth 64 words: long-term forecasting with Transformers [C]//The 11th International Conference on Learning Representations, 2023: 1−24.
[9]   Hochreiter S, Schmidhuber J Long short-term memory[J]. Neural Computation, 1997, 9 (8): 1735- 1780
doi: 10.1162/neco.1997.9.8.1735
[10]   Lai G, Chang W C, Yang Y, et al. Modeling long- and short-term temporal patterns with deep neural networks [C]//The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. New York: ACM, 2018: 95-104.
[11]   Shen L, Li Z, Kwok J T. Timeseries anomaly detection using temporal hierarchical one-class network [C]//Advances in Neural Information Processing Systems 33. Red Hook, NY: Curran Associates, Inc. , 2020: 13016-13026.
[12]   Bai S, Kolter J Z, Koltun V. Convolutional sequence modeling revisited [C]//Proceedings of the 6th International Conference on Learning Representations Workshop, 2018: 1−20.
[13]   He Y, Zhao J Temporal convolutional networks for anomaly detection in time series[J]. Journal of Physics: Conference Series, 2019, 1213 (4): 042050
doi: 10.1088/1742-6596/1213/4/042050
[14]   Wu H, Hu T, Liu Y, et al. TimesNet: temporal 2D-variation modeling for general time series analysis [C]//The 11th International Conference on Learning Representations, 2023: 1−23.
[15]   Wang S, Wu H, Shi X, et al. TimeMixer: decomposable multiscale mixing for time series forecasting [C]//The 12th International Conference on Learning Representations, 2024: 1−27.
[16]   Wang Y, Wu H, Dong J, et al. TimeXer: empowering Transformers for time series forecasting with exogenous variables [C]//Advances in Neural Information Processing Systems 37. Red Hook, NY: Curran Associates, Inc. , 2024: 469-498.
[17]   Zeng A, Chen M, Zhang L, et al. Are Transformers effective for time series forecasting? [C]//Proceedings of the 37th AAAI Conference on Artificial Intelligence. Washington, DC: AAAI Press, 2023, 37(9): 11121-11128.
[1] Heng YANG,Shaohan WANG,Qing DONG,Keyuan ZHAO,Mingliang YANG. Object pose estimation based on attention enhancement cross-modal multilayer fusion network[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(9): 1872-1880.
[2] Hongbin LIN,Sijin LV,Chenyang WANG,Tianfang CAI,Pengwei LUO. Radial basis network based on residual/gradient Gaussian adaptive sampling[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(5): 1119-1127.
[3] Zixiang LI,Kecheng LU,Haibing CAI,Weishuai XIE,Guangdong ZHANG. Concrete crack detection in dark environments based on biomimetic tactile technology[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(5): 915-925.
[4] Jie WU,Beilin HAN,Yihang ZHANG,Chao ZOU,Lifeng XIN,Shiping HUANG. Method for augmenting crack image datasets via fine-tuning of stable diffusion models[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(5): 926-934.
[5] Xiaochun WU,Ning GUO. Lightweight detection method of water leakage in tunnel based on HMARU-net[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(3): 468-477.
[6] Leping LIN,Liang LI,Ning OUYANG. High spatio-temporal resolution precipitation forecast based on dual-polarization radar[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(3): 574-584.
[7] Minghui YANG,Muyuan SONG,Daxi FU,Yanwei GUO,Xianzhui LU,Wencong ZHANG,Weilong ZHENG. Prediction of shield tunneling-induced soil settlement based on multi-head self-attention-Bi-LSTM model[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(2): 415-424.
[8] Huaping ZHOU,Bin DENG,Kelei SUN,Yongqi ZHANG,Tao WU,Jin WU. High-precision real-time segmentation network for underground track areas[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(2): 332-340.
[9] Tongchun HAN,Zhibo LINGHU,Quanzhen WANG,Jian ZHOU,Jindi YU. CNN-BiLSTM prediction model for embankment settlement based on stratum images and time series data[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(11): 2503-2512.
[10] Ming CAO,Daokuan CHEN,Pengfei YUAN,Jinpeng ZHOU,Kui ZHOU. Real-time optimization method for desktop level 3D printing parameters based on deep learning[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(11): 2355-2363.
[11] Houming WU,Ling CHEN. Bidirectional interleaved pipeline parallelism for accelerating large model training[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(11): 2395-2405.
[12] Xin HU,Xiyue YAN,Yashu CHANG,Hongliang CHENG,Jian XIAO,Shiwei LUO,Liang MA. Context-enhanced multi-target semantic perception algorithm for power defect detection[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(10): 2176-2185.
[13] Zhihang ZHU,Yunfeng YAN,Donglian QI. Image generation for power personnel behaviors based on diffusion model with multimodal prompts[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(1): 43-51.
[14] Yue SUN,Xinglan ZHANG. Targeted adversarial attack method based on dual guidance[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(1): 81-89.
[15] Jizhong DUAN,Haiyuan LI. Multi-scale parallel magnetic resonance imaging reconstruction based on variational model and Transformer[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(9): 1826-1837.