Please wait a minute...
浙江大学学报(工学版)  2026, Vol. 60 Issue (5): 1119-1127    DOI: 10.3785/j.issn.1008-973X.2026.05.021
计算机技术、控制工程     
基于残差/梯度高斯自适应采样的径向基网络
林洪彬(),吕思进,王晨阳,蔡天放,骆鹏伟
燕山大学 电气工程学院,河北 秦皇岛 066004
Radial basis network based on residual/gradient Gaussian adaptive sampling
Hongbin LIN(),Sijin LV,Chenyang WANG,Tianfang CAI,Pengwei LUO
School of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China
 全文: PDF(2240 KB)   HTML
摘要:

在求解具有高梯度特征和具有尖锐解的非线性偏微分方程时,物理信息径向基网络(PIRBN)比物理信息神经网络(PINN)更有效. 受自适应有限元方法和增量学习理念的启发,为了进一步提高模型在拟合非线性偏微分方程高梯度处的逼近精度,提出基于残差/梯度高斯自适应采样的径向基网络(G-PIRBN). 在训练过程中,使用当前残差和梯度信息生成高斯混合分布,用于后续特定的高斯分布采样. 将新增采样点与历史数据一起训练,加速损失的网络收敛并提高拟合精度. 非线性弹簧方程、波动方程和扩散方程的逐点绝对误差、均方误差和平均耗时对比实验结果表明,在求解具有高梯度特性的非线性偏微分方程时,G-PIRBN比PINN、PIRBN和EI-Grad的拟合精度更高,拟合速度更快.

关键词: 深度学习残差/梯度高斯自适应采样物理信息径向基网络(PIRBN)自适应采样偏微分方程    
Abstract:

Physics-informed radial basis networks (PIRBNs) were found to be more effective than physics-informed neural networks (PINNs) in solving nonlinear partial differential equations (PDEs) with high-gradient features and sharp solutions. Inspired by adaptive finite element methods and incremental learning ideas, a radial basis network based on residual/gradient Gaussian adaptive sampling (G-PIRBN) was proposed to further improve the approximation accuracy of the model in fitting the high-gradient regions of nonlinear PDEs. During the training process, a Gaussian mixture distribution was generated using the current residual and gradient information, which was utilized for subsequent specific Gaussian distribution sampling. The newly added sampling points were trained together with historical data to accelerate the convergence of network loss and achieve higher fitting accuracy. Experimental results of point-wise absolute error, mean square error, and average time consumption for nonlinear spring equations, wave equations, and diffusion equations demonstrated that G-PIRBN exhibited higher fitting accuracy and faster fitting speed than PINN, PIRBN, and EI-Grad when solving nonlinear PDEs with high-gradient characteristics.

Key words: deep learning    residual/gradient Gaussian adaptive sampling    physics-informed radial basis network (PIRBN)    adaptive sampling    partial differential equation
收稿日期: 2025-03-19 出版日期: 2026-05-06
CLC:  TP 393.1  
基金资助: 河北省自然科学基金资助项目(E2024203225,E2025203237);燕山大学科研培育项目(理工类)(2024LGZD001).
作者简介: 林洪彬(1979—),男,副教授,博士,从事基于深度学习的三维场景理解、无监督学习模式识别研究. orcid.org/0000-0001-6353-8535. E-mail:honphin@ysu.edu.cn
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
作者相关文章  
林洪彬
吕思进
王晨阳
蔡天放
骆鹏伟

引用本文:

林洪彬,吕思进,王晨阳,蔡天放,骆鹏伟. 基于残差/梯度高斯自适应采样的径向基网络[J]. 浙江大学学报(工学版), 2026, 60(5): 1119-1127.

Hongbin LIN,Sijin LV,Chenyang WANG,Tianfang CAI,Pengwei LUO. Radial basis network based on residual/gradient Gaussian adaptive sampling. Journal of ZheJiang University (Engineering Science), 2026, 60(5): 1119-1127.

链接本文:

https://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2026.05.021        https://www.zjujournals.com/eng/CN/Y2026/V60/I5/1119

图 1  重采样示意图
图 2  基于残差/梯度高斯自适应采样的径向基网络框架图
图 3  不同网络的非线性弹簧方程拟合结果和逐点绝对误差
NpMSE
PIRBNEI-GradG-PIRBN
5×108.0×10?42.4×10?59.6×10?6
5×254.5×10?43.2×10?52.3×10?6
20×101.7×10?41.1×10?58.1×10?6
20×253.0×10?57.3×10?71.5×10?7
表 1  不同网络的非线性弹簧方程重采样点数量和均方误差
图 4  不同网络的波动方程拟合结果和逐点绝对误差
NpMSE
PIRBNEI-GradG-PIRBN
5×101.8×10?41.9×10?52.9×10?6
5×258.8×10?55.2×10?68.2×10?7
20×109.8×10?69.8×10?74.4×10?7
20×257.5×10?62.7×10?71.1×10?8
表 2  不同网络的波动方程重采样点数量和均方误差
图 5  不同网络的扩散方程拟合结果和逐点绝对误差
NpMSE
PIRBNDAS-PIRBNEI-GradG-PIRBN
5×105.7×10?45.3×10?51.8×10?52.3×10?6
5×254.3×10?52.4×10?54.8×10?66.2×10?7
20×103.2×10?57.2×10?61.2×10?64.2×10?7
20×256.6×10?68.6×10?77.5×10?89.3×10?9
表 3  不同网络的扩散方程重采样点数量和均方误差
NRBFMSE
PIRBNDAS-PIRBNG-PIRBN
25×308.3×10?28.2×10?31.6×10?3
25×556.3×10?42.4×10?43.8×10?5
50×309.2×10?54.6×10?68.8×10?7
50×556.6×10?68.6×10?79.3×10?9
表 4  不同物理信息径向基网络在不同径向基函数神经元数量下的方程拟合均方误差
方程名称ktt/s
PINNPIRBNEI-GradG-PIRBN
非线性弹簧方程5500357514602323
波动方程5000435680703422
扩展方程5000302464539285
表 5  固定迭代次数下不同网络的方程求解平均耗时
1 VOULODIMOS A, DOULAMIS N, DOULAMIS A, et al Deep learning for computer vision: a brief review[J]. Computational Intelligence and Neuroscience, 2018, 2018 (1): 7068349
doi: 10.1016/bs.host.2023.01.003
2 SUN D, LIANG Y, YANG Y, et al. Research on optimization of natural language processing model based on multimodal deep learning [C]// Proceedings of the IEEE 2nd International Conference on Image Processing and Computer Applications. Shenyang: IEEE, 2024: 1358–1362.
3 RICHTMYER R D, MORTON K W. Difference methods for initial-value problems [M]. New York: [s.n.], 1967.
4 WANG X, YIN Z Y, WU W, et al Neural network-augmented differentiable finite element method for boundary value problems[J]. International Journal of Mechanical Sciences, 2025, 285: 109783
doi: 10.1016/j.ijmecsci.2024.109783
5 YANG C, NIU R, ZHANG P Numerical analyses of liquid slosh by finite volume and lattice Boltzmann methods[J]. Aerospace Science and Technology, 2021, 113: 106681
doi: 10.1016/j.ast.2021.106681
6 RAISSI M, PERDIKARIS P, KARNIADAKIS G E Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations[J]. Journal of Computational Physics, 2019, 378: 686- 707
doi: 10.1016/j.jcp.2018.10.045
7 MUSTAJAB A H, LYU H, RIZVI Z, et al Physics-informed neural networks for high-frequency and multi-scale problems using transfer learning[J]. Applied Sciences, 2024, 14 (8): 3204
doi: 10.3390/app14083204
8 RAMABATHIRAN A A, RAMACHANDRAN P SPINN: sparse, physics-based, and partially interpretable neural networks for PDEs[J]. Journal of Computational Physics, 2021, 445: 110600
doi: 10.1016/j.jcp.2021.110600
9 JAGTAP A D, EM KARNIADAKIS G Extended physics-informed neural networks (XPINNs): a generalized space-time domain decomposition based deep learning framework for nonlinear partial differential equations[J]. Communications in Computational Physics, 2025, 28 (5): 2002- 2041
doi: 10.4208/cicp.oa-2020-0164
10 DOLEAN V, HEINLEIN A, MISHRA S, et al Multilevel domain decomposition-based architectures for physics-informed neural networks[J]. Computer Methods in Applied Mechanics and Engineering, 2024, 429: 117116
doi: 10.1016/j.cma.2024.117116
11 LIU D, WANG Y A Dual-Dimer method for training physics-constrained neural networks with minimax architecture[J]. Neural Networks, 2021, 136: 112- 125
doi: 10.1016/j.neunet.2020.12.028
12 TANG K, WAN X, LIAO Q Deep density estimation via invertible block-triangular mapping[J]. Theoretical and Applied Mechanics Letters, 2020, 10 (3): 143- 148
doi: 10.1016/j.taml.2020.01.023
13 LIU Y, CHEN L, DING J, et al An adaptive sampling method based on expected improvement function and residual gradient in PINNs[J]. IEEE Access, 2024, 12: 92130- 92141
doi: 10.1109/ACCESS.2024.3422224
14 JACOT A, GABRIEL F, HONGLER C. Neural tangent kernel: convergence and generalization in neural networks (invited paper) [C]// Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing. [S.l.]: ACM, 2021: 6.
15 SCABINI L F S, BRUNO O M Structure and performance of fully connected neural networks: emerging complex network properties[J]. Physica A: Statistical Mechanics and Its Applications, 2023, 615: 128585
doi: 10.1016/j.physa.2023.128585
16 BAI J, LIU G R, GUPTA A, et al Physics-informed radial basis network (PIRBN): a local approximating neural network for solving nonlinear partial differential equations[J]. Computer Methods in Applied Mechanics and Engineering, 2023, 415: 116290
doi: 10.1016/j.cma.2023.116290
17 BROOMHEAD D S, LOWE D Multivariable functional interpolation and adaptive networks[J]. Complex System, 1988, 2: 321- 355
18 CHEN C S, NOORIZADEGAN A, YOUNG D L, et al On the selection of a better radial basis function and its shape parameter in interpolation problems[J]. Applied Mathematics and Computation, 2023, 442: 127713
doi: 10.1016/j.amc.2022.127713
19 ZHANG W, HE Y, YANG S A multi-step probability density prediction model based on Gaussian approximation of quantiles for offshore wind power[J]. Renewable Energy, 2023, 202: 992- 1011
doi: 10.1016/j.renene.2022.11.111
20 YOSHIDA I, NAKAMURA T, AU S K Bayesian updating of model parameters using adaptive Gaussian process regression and particle filter[J]. Structural Safety, 2023, 102: 102328
doi: 10.1016/j.strusafe.2023.102328
21 ZHANG C, REZAVAND M, ZHU Y, et al SPHinXsys: an open-source multi-physics and multi-resolution library based on smoothed particle hydrodynamics[J]. Computer Physics Communications, 2021, 267: 108066
doi: 10.1016/j.cpc.2021.108066
[1] 武晓春,郭宁. 基于HMARU-net的隧道渗漏水轻量化检测方法[J]. 浙江大学学报(工学版), 2026, 60(3): 468-477.
[2] 林乐平,李量,欧阳宁. 基于双偏振雷达的高时空分辨率临近降水预报[J]. 浙江大学学报(工学版), 2026, 60(3): 574-584.
[3] 杨明辉,宋牧原,付大喜,郭炎伟,卢贤锥,张文聪,郑伟龙. 基于多头自注意力-Bi-LSTM模型的盾构掘进引发的土体沉降预测[J]. 浙江大学学报(工学版), 2026, 60(2): 415-424.
[4] 朱志航,闫云凤,齐冬莲. 基于扩散模型多模态提示的电力人员行为图像生成[J]. 浙江大学学报(工学版), 2026, 60(1): 43-51.
[5] 孙月,张兴兰. 基于双重引导的目标对抗攻击方法[J]. 浙江大学学报(工学版), 2026, 60(1): 81-89.
[6] 段继忠,李海源. 基于变分模型和Transformer的多尺度并行磁共振成像重建[J]. 浙江大学学报(工学版), 2025, 59(9): 1826-1837.
[7] 王福建,张泽天,陈喜群,王殿海. 基于多通道图聚合注意力机制的共享单车借还量预测[J]. 浙江大学学报(工学版), 2025, 59(9): 1986-1995.
[8] 张弘,张学成,王国强,顾潘龙,江楠. 基于三维视觉的软体机器人实时定位与控制[J]. 浙江大学学报(工学版), 2025, 59(8): 1574-1582.
[9] 王圣举,张赞. 基于加速扩散模型的缺失值插补算法[J]. 浙江大学学报(工学版), 2025, 59(7): 1471-1480.
[10] 章东平,王大为,何数技,汤斯亮,刘志勇,刘中秋. 基于跨维度特征融合的航空发动机寿命预测[J]. 浙江大学学报(工学版), 2025, 59(7): 1504-1513.
[11] 蔡永青,韩成,权巍,陈兀迪. 基于注意力机制的视觉诱导晕动症评估模型[J]. 浙江大学学报(工学版), 2025, 59(6): 1110-1118.
[12] 王立红,刘新倩,李静,冯志全. 基于联邦学习和时空特征融合的网络入侵检测方法[J]. 浙江大学学报(工学版), 2025, 59(6): 1201-1210.
[13] 徐慧智,王秀青. 基于车辆图像特征的前车距离与速度感知[J]. 浙江大学学报(工学版), 2025, 59(6): 1219-1232.
[14] 陈赞,李冉,冯远静,李永强. 基于时间维超分辨率的视频快照压缩成像重构[J]. 浙江大学学报(工学版), 2025, 59(5): 956-963.
[15] 马莉,王永顺,胡瑶,范磊. 预训练长短时空交错Transformer在交通流预测中的应用[J]. 浙江大学学报(工学版), 2025, 59(4): 669-678.