Please wait a minute...
Journal of ZheJiang University (Engineering Science)  2026, Vol. 60 Issue (11): 2503-2512    DOI: 10.3785/j.issn.1008-973X.2026.11.019
    
CNN-BiLSTM prediction model for embankment settlement based on stratum images and time series data
Tongchun HAN1,2(),Zhibo LINGHU1,Quanzhen WANG1,Jian ZHOU1,2,Jindi YU3
1. Research Center of Coastal and Urban Geotechnical Engineering, Zhejiang University, Hangzhou 310058, China
2. Zhejiang Key Laboratory of the Development and Utilization of Underground Space, Hangzhou 310058, China
3. Zhejiang Design Institute of Water Conservancy & Hydro-Electric Power Co., Ltd, Hangzhou 310002, China
Download: HTML     PDF(1237KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

A neural network model integrating multi-source information was proposed to address the challenge of spatiotemporal feature coupling modeling for embankment settlement prediction in soft soil areas with complex stratigraphy. Stratigraphic profile maps were used as the model input. A convolutional neural network (CNN) was employed to extract the spatial distribution characteristics of soil layers. The feature extraction was enhanced with residual connections and a self-attention mechanism. Simultaneously, groundwater level and historical settlement data were combined to form a bivariate time series. This series was modeled using a bidirectional long short-term memory network (BiLSTM). The optimal parameter combination was identified through the Bayesian optimization algorithm. Based on training, validation, and testing results from the measured dataset of the Xixian Datang site, the model achieves a mean absolute error, root mean squared error, and coefficient of determination of 0.028 6 mm, 0.04 mm, and 0.956 9, respectively. These results demonstrate the superiority of the proposed model over comparison models and confirm its effectiveness and engineering application value for surface settlement prediction under complex geological conditions.



Key words: multi-source heterogeneous data fusion      deep learning      embankment settlement prediction      CNN      bidirectional long short-term memory network (BiLSTM)      Bayesian optimization algorithm     
Received: 09 September 2025      Published: 16 October 2026
CLC:  TP 393  
Fund:  国家自然科学基金资助项目(52178360);浙江省水利工程带科研揭榜挂帅项目(RA+202303).
Cite this article:

Tongchun HAN,Zhibo LINGHU,Quanzhen WANG,Jian ZHOU,Jindi YU. CNN-BiLSTM prediction model for embankment settlement based on stratum images and time series data. Journal of ZheJiang University (Engineering Science), 2026, 60(11): 2503-2512.

URL:

https://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2026.11.019     OR     https://www.zjujournals.com/eng/Y2026/V60/I11/2503


基于地层图像与时序数据的CNN-BiLSTM路堤沉降预测模型

为了解决软土地区复杂地层路堤沉降预测中时空特征耦合建模难的问题,提出融合多源信息的神经网络模型. 以地层剖面图为模型输入,采用卷积神经网络(CNN)提取土层的空间分布特征,引入残差连接与自注意力机制加强特征提取;结合地下水位与历史沉降数据构成双变量时间序列,利用双向长短期记忆网络(BiLSTM)建模;通过贝叶斯优化算法寻找最佳参数组合. 基于西险大塘实测数据集上的训练、验证与测试的结果表明,模型的平均绝对误差、均方根误差和决定系数分别达到0.028 6 mm、0.04 mm和0.956 9,优于对比模型,证明了所提模型在复杂地质条件下进行地表沉降预测的有效性和工程应用价值.


关键词: 多源异构数据融合,  深度学习,  路堤沉降预测,  CNN,  双向长短期记忆网络(BiLSTM),  贝叶斯优化算法 
Fig.1 Residual block diagram for enhanced feature extraction in convolutional neural network
Fig.2 Typical settlement trend curve of Xixian Datang embankment
Fig.3 Overall architecture diagram of neural network model integrating multi-source information
Fig.4 Self-attention mechanism diagram for enhancing CNN feature extraction
Fig.5 Training and evaluation of neural network model using 5-fold cross-validation method
模块MAERMSER2
CNN+BiLSTM
(基线模型)
0.0381±0.00510.0571±0.01360.9373±0.0293
CNN+BiLSTM+
SA
0.0363±0.00680.0572±0.01520.9415±0.0172
CNN+BiLSTM+
残差连接
0.0371±0.00390.0595±0.00980.9297±0.0266
CNN+BiLSTM+
SA+残差连接
0.0323±0.00400.0476±0.00840.9591±0.0163
Tab.1 Performance indicator comparison for ablation study of neural network model integrating multi-source information
参数搜索范围最佳值
学习率[1.0×10?5, 1.0×10?2]0.002 2
Dropout率[0.0, 0.5]0.165
LSTM 隐藏单元数[32, 64, 128, ···, 512]256
批量大小[4, 8, 16, 32]8
Tab.2 Optimization range setting and optimal values of neural network model hyperparameters via Bayesian search
Fig.6 Optimization process line chart of model hyperparameter search based on Bayesian optimization algorithm
Fig.7 Hyperparameter importance bar chart of neural network model assessed based on Bayesian optimization results
Fig.8 Analysis of impact of individual hyperparameters on objective function value in Bayesian optimization
Fig.9 Analysis of impact of hyperparameter combination on objective function value in Bayesian optimization
Fig.10 Comparison of settlement prediction values and ground truth of neural network model on testing set
Fig.11 Histogram of settlement prediction error distribution for neural network model on testing set
[1]   ZHANG D M, ZHANG J Z, HUANG H W, et al Machine learning-based prediction of soil compression modulus with application of 1D settlement[J]. Journal of Zhejiang University: Science A, 2020, 21 (6): 430- 444
doi: 10.1631/jzus.A1900515
[2]   ZHANG P, WU H N, CHEN R P, et al A critical evaluation of machine learning and deep learning in shield-ground interaction prediction[J]. Tunnelling and Underground Space Technology, 2020, 106: 103593
doi: 10.1016/j.tust.2020.103593
[3]   SU J, WANG Y, NIU X, et al Prediction of ground surface settlement by shield tunneling using XGBoost and Bayesian optimization[J]. Engineering Applications of Artificial Intelligence, 2022, 114: 105020
doi: 10.1016/j.engappai.2022.105020
[4]   YE X W, JIN T, CHEN Y M Machine learning-based forecasting of soil settlement induced by shield tunneling construction[J]. Tunnelling and Underground Space Technology, 2022, 124: 104452
doi: 10.1016/j.tust.2022.104452
[5]   WU X, FENG Z, LIU J, et al Predicting existing tunnel deformation from adjacent foundation pit construction using hybrid machine learning[J]. Automation in Construction, 2024, 165: 105516
doi: 10.1016/j.autcon.2024.105516
[6]   LIU K, ZHANG J, LIU J, et al Projection of land susceptibility to subsidence hazard in China using an interpretable CNN deep learning model[J]. Science of the Total Environment, 2024, 913: 169502
doi: 10.1016/j.scitotenv.2023.169502
[7]   HONG C, LUO G, CHEN W Safety analysis of a deep foundation ditch using deep learning methods[J]. Gondwana Research, 2023, 123: 16- 26
doi: 10.1016/j.gr.2022.05.015
[8]   傅蕾, 吴惠明, 黄宏伟, 等 基于随机森林和MOPSO-CD的盾构隧道掘进沉降预测与施工参数优化[J]. 隧道建设(中英文), 2025, 45 (Suppl.1): 318- 329
FU Lei, WU Huiming, HUANG Hongwei, et al Settlement prediction and construction parameters optimization induced by shield tunneling based on random forest and multi-objective particle swarm optimization algorithm-crowding distance[J]. Tunnel Construction, 2025, 45 (Suppl.1): 318- 329
doi: 10.3973/j.issn.2096-4498.2025.S1.031
[9]   HU M, LI W, YAN K, et al Modern machine learning techniques for univariate tunnel settlement forecasting: a comparative study[J]. Mathematical Problems in Engineering, 2019, 2019: 7057612
doi: 10.1155/2019/7057612
[10]   KIM D, KWON K, PHAM K, et al Surface settlement prediction for urban tunneling using machine learning algorithms with Bayesian optimization[J]. Automation in Construction, 2022, 140: 104331
doi: 10.1016/j.autcon.2022.104331
[11]   ZHOU X, ZHAO C, BIAN X Prediction of maximum ground surface settlement induced by shield tunneling using XGBoost algorithm with golden-sine seagull optimization[J]. Computers and Geotechnics, 2023, 154: 105156
doi: 10.1016/j.compgeo.2022.105156
[12]   潘林有, 谢新宇 用曲线拟合的方法预测软土地基沉降[J]. 岩土力学, 2004, 25 (7): 1053- 1058
PAN Linyou, XIE Xinyu Observational settlement prediction by curve fitting methods[J]. Rock and Soil Mechanics, 2004, 25 (7): 1053- 1058
doi: 10.3969/j.issn.1000-7598.2004.07.010
[13]   黄广军 Asaoka法预测软土地基沉降时存在的问题和对策[J]. 岩土力学, 2016, 37 (4): 1061- 1065
HUANG Guangjun Problems and their solutions in predicting soft ground settlement based on Asaoka’s method[J]. Rock and Soil Mechanics, 2016, 37 (4): 1061- 1065
doi: 10.16285/j.rsm.2016.04.019
[14]   ZHENG H Q, HU L N, SUN X Y, et al Slope displacement prediction based on multisource domain transfer learning for insufficient sample data[J]. Applied Geophysics, 2024, 21 (3): 496- 504
doi: 10.1007/s11770-022-1003-x
[15]   LONG X, MAO M H, SU T X, et al Machine learning method to predict dynamic compressive response of concrete-like material at high strain rates[J]. Defence Technology, 2023, 23: 100- 111
doi: 10.1016/j.dt.2022.02.003
[16]   WEI X, ZHANG L, YANG H Q, et al Machine learning for pore-water pressure time-series prediction: application of recurrent neural networks[J]. Geoscience Frontiers, 2021, 12 (1): 453- 467
doi: 10.1016/j.gsf.2020.04.011
[17]   SHAN L, LIU Y, TANG M, et al CNN-BiLSTM hybrid neural networks with attention mechanism for well log prediction[J]. Journal of Petroleum Science and Engineering, 2021, 205: 108838
doi: 10.1016/j.petrol.2021.108838
[18]   王启贵, 吴忠明, 陈兴红 基于机器学习LSTM方法的大面积高填土沉降预测[J]. 工程勘察, 2022, 50 (8): 41- 45
WANG Qigui, WU Zhongming, CHEN Xinghong Settlement prediction of large-area high filling soil based on machine learning method with LSTM[J]. Geotechnical Investigation and Surveying, 2022, 50 (8): 41- 45
[19]   梁煜婉, 肖朝昀, 李明广, 等 基于长短时记忆的真空预压地基沉降预测[J]. 上海交通大学学报, 2025, 59 (4): 525- 532
LIANG Yuwan, XIAO Zhaoyun, LI Mingguang, et al Ground settlement prediction by vacuum preloading based on LSTM[J]. Journal of Shanghai Jiao Tong University, 2025, 59 (4): 525- 532
doi: 10.16183/j.cnki.jsjtu.2023.340
[20]   宋牧原, 杨明辉, 陈伟, 等 基于自注意力-循环神经网络模型的盾构引发的土体沉降预测[J]. 岩土力学, 2025, 46 (8): 2613- 2625
SONG Muyuan, YANG Minghui, CHEN Wei, et al Prediction of shield tunneling-induced soil settlement based on self-attention recurrent neural network model[J]. Rock and Soil Mechanics, 2025, 46 (8): 2613- 2625
doi: 10.16285/j.rsm.2024.0980
[21]   詹涛, 黄浩 基于盾构施工进程与时空因素的临近建筑物沉降预测研究[J]. 土木工程学报, 2024, 57 (Suppl.1): 117- 121
ZHAN Tao, HUANG Hao Research on settlement prediction of adjacent buildings based on shield construction process and space-time factors[J]. China Civil Engineering Journal, 2024, 57 (Suppl.1): 117- 121
doi: 10.15951/j.tmgcxb.2024.S06
[22]   尹泉, 周怡, 饶军应 基于深度学习的盾构隧道施工地表沉降预测方法[J]. 中南大学学报: 自然科学版, 2024, 55 (2): 607- 617
YIN Quan, ZHOU Yi, RAO Junying A deep learning-based method for predicting surface settlement induced by shield tunnel construction[J]. Journal of Central South University: Science and Technology, 2024, 55 (2): 607- 617
doi: 10.11817/j.issn.1672-7207.2024.02.014
[23]   LONG W J, YU X X, ZHU M F, et al SHAP-enhanced interpretive MGTWR-CNN-BILSTM-AM framework for predicting surface subsidence: a case study of Shanghai municipality[J]. Scientific Reports, 2025, 15: 19771
doi: 10.1038/s41598-025-95694-4
[24]   HU C, WU Q, LI H, et al Deep learning with a long short-term memory networks approach for rainfall-runoff simulation[J]. Water, 2018, 10 (11): 1543
doi: 10.3390/w10111543
[25]   WU H, XIAO B, CODELLA N, et al. CvT: introducing convolutions to vision transformers [C]// Proceedings of the IEEE/CVF International Conference on Computer Vision. Montreal: IEEE, 2022: 22–31.
[26]   GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus: IEEE, 2014: 580–587.
[27]   YAO G, LEI T, ZHONG J A review of convolutional-neural-network-based action recognition[J]. Pattern Recognition Letters, 2019, 118: 14- 22
doi: 10.1016/j.patrec.2018.05.018
[28]   CONTRERAS S, KACHROO P, AGARWAL S Observability and sensor placement problem on highway segments: a traffic dynamics-based approach[J]. IEEE Transactions on Intelligent Transportation Systems, 2016, 17 (3): 848- 858
doi: 10.1109/TITS.2015.2491282
[29]   GRAVES A. Generating sequences with recurrent neural networks [EB/OL]. (2014–06–05)[2025–08–27]. https://arxiv.org/pdf/1308.0850.
[30]   FU J, LIU J, TIAN H, et al. Dual attention network for scene segmentation [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach: IEEE, 2019: 3141–3149.
[31]   BELLO I, ZOPH B, LE Q, et al. Attention augmented convolutional networks [C]// Proceedings of the IEEE/CVF International Conference on Computer Vision. Seoul: IEEE, 2019: 3285–3294.
[32]   HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 770–778.
[1] Heng YANG,Shaohan WANG,Qing DONG,Keyuan ZHAO,Mingliang YANG. Object pose estimation based on attention enhancement cross-modal multilayer fusion network[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(9): 1872-1880.
[2] Hongbin LIN,Sijin LV,Chenyang WANG,Tianfang CAI,Pengwei LUO. Radial basis network based on residual/gradient Gaussian adaptive sampling[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(5): 1119-1127.
[3] Zixiang LI,Kecheng LU,Haibing CAI,Weishuai XIE,Guangdong ZHANG. Concrete crack detection in dark environments based on biomimetic tactile technology[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(5): 915-925.
[4] Jie WU,Beilin HAN,Yihang ZHANG,Chao ZOU,Lifeng XIN,Shiping HUANG. Method for augmenting crack image datasets via fine-tuning of stable diffusion models[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(5): 926-934.
[5] Xiaochun WU,Ning GUO. Lightweight detection method of water leakage in tunnel based on HMARU-net[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(3): 468-477.
[6] Leping LIN,Liang LI,Ning OUYANG. High spatio-temporal resolution precipitation forecast based on dual-polarization radar[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(3): 574-584.
[7] Minghui YANG,Muyuan SONG,Daxi FU,Yanwei GUO,Xianzhui LU,Wencong ZHANG,Weilong ZHENG. Prediction of shield tunneling-induced soil settlement based on multi-head self-attention-Bi-LSTM model[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(2): 415-424.
[8] Ming CAO,Daokuan CHEN,Pengfei YUAN,Jinpeng ZHOU,Kui ZHOU. Real-time optimization method for desktop level 3D printing parameters based on deep learning[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(11): 2355-2363.
[9] Houming WU,Ling CHEN. Bidirectional interleaved pipeline parallelism for accelerating large model training[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(11): 2395-2405.
[10] Ting QIN,Zhao LI,Yuting YAN,Yafei DU. Convolutional neural network accelerator based on variable-precision systolic-array structure[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(11): 2406-2417.
[11] Xin HU,Xiyue YAN,Yashu CHANG,Hongliang CHENG,Jian XIAO,Shiwei LUO,Liang MA. Context-enhanced multi-target semantic perception algorithm for power defect detection[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(10): 2176-2185.
[12] Yue SUN,Xinglan ZHANG. Targeted adversarial attack method based on dual guidance[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(1): 81-89.
[13] Zhihang ZHU,Yunfeng YAN,Donglian QI. Image generation for power personnel behaviors based on diffusion model with multimodal prompts[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(1): 43-51.
[14] Jizhong DUAN,Haiyuan LI. Multi-scale parallel magnetic resonance imaging reconstruction based on variational model and Transformer[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(9): 1826-1837.
[15] Fujian WANG,Zetian ZHANG,Xiqun CHEN,Dianhai WANG. Usage prediction of shared bike based on multi-channel graph aggregation attention mechanism[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(9): 1986-1995.