Please wait a minute...
浙江大学学报(工学版)  2026, Vol. 60 Issue (8): 1720-1729    DOI: 10.3785/j.issn.1008-973X.2026.08.011
计算机技术     
基于特征门控融合与小波增强的双编码器息肉分割
梁礼明(),康婷,陈康泉,钟奕
江西理工大学 电气工程与自动化学院,江西 赣州 341000
Dual-encoder polyp segmentation with feature-gated fusion and wavelet enhancement
Liming LIANG(),Ting KANG,Kangquan CHEN,Yi ZHONG
School of Electrical Engineering and Automation, Jiangxi University of Science and Technology, Ganzhou 341000, China
 全文: PDF(2339 KB)   HTML
摘要:

针对结直肠息肉分割任务中病灶区域定位不准、边界细节缺失及小目标息肉易漏检等问题,提出基于特征门控融合与小波增强的双编码器息肉分割网络. 构建PVTv2与Hiera双编码器,提升全局语义感知能力及增强边缘表征能力. 设计特征门控融合模块,对双编码器提取的多层级特征进行自适应筛选和融合,提高网络对息肉区域的区分能力. 建立小波增强特征注入模块,利用小波变换分解高低频信息,强化边缘纹理表达并有效抑制噪声干扰,提升息肉区域的细粒度特征学习能力. 引入多尺度预测模块,结合全局平均池化与自适应加权融合策略,实现精细化分割,提高对形态多变病灶的适应性. 结果表明,所提网络能够为结直肠息肉的计算机辅助诊断提供有力支持.

关键词: 结直肠息肉分割双编码器网络特征门控融合小波增强多尺度预测边界细节增强    
Abstract:

To address the problems of inaccurate lesion localization, missing boundary details, and small polyp omission in colorectal polyp segmentation, a dual-encoder network with feature-gated fusion and wavelet-enhanced modules was proposed. A dual-encoder architecture based on PVTv2 and Hiera was adopted to enhance global semantic awareness and edge representation. A feature-gated fusion module was designed to filter and combine the multi-level features extracted by two encoders adaptively, thereby better distinguishing polyp regions. A wavelet-enhanced injection module was introduced to decompose high-frequency and low-frequency information using wavelet transform, thus strengthening the edge texture expression and reduced noise, supporting fine-grained feature learning. A multi-scale prediction module was introduced by combining global average pooling and adaptive weighted fusion to achieve refined segmentation and improve adaptability to polyps with diverse shapes. Results show that the proposed network provides effective support for computer-aided diagnosis of colorectal polyps.

Key words: colorectal polyp segmentation    dual-encoder network    feature-gated fusion    wavelet enhancement    multi-scale prediction    boundary detail refinement
收稿日期: 2025-06-26 出版日期: 2026-07-16
CLC:  TP 391.4  
基金资助: 国家自然科学基金资助项目(51365017,61463018);江西省自然科学基金资助项目(20192BAB205084);江西省教育厅科学技术研究重点项目(GJJ170491,GJJ2200848).
作者简介: 梁礼明(1967—),男,教授,硕士,从事机器学习和医学影像研究. orcid.org/0009-0004-5278-5249. E-mail:9119890012@jxust.edu.cn
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
作者相关文章  
梁礼明
康婷
陈康泉
钟奕

引用本文:

梁礼明,康婷,陈康泉,钟奕. 基于特征门控融合与小波增强的双编码器息肉分割[J]. 浙江大学学报(工学版), 2026, 60(8): 1720-1729.

Liming LIANG,Ting KANG,Kangquan CHEN,Yi ZHONG. Dual-encoder polyp segmentation with feature-gated fusion and wavelet enhancement. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1720-1729.

链接本文:

https://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2026.08.011        https://www.zjujournals.com/eng/CN/Y2026/V60/I8/1720

图 1  基于特征门控融合与小波增强的双Transformer编码器息肉分割网络框架
图 2  特征门控融合模块
图 3  小波增强特征注入模块
图 4  多尺度预测模块
数据集图像分辨率训练数据测试数据数据类型
CVC-ClinicDB384×28855062图像
Kvasir-SEG尺寸不固定900100图像与掩码
CVC-ColonDB574×5000380图像
ETIS1226×9960196图像
表 1  数据集细节及划分
数据集网络DicemIoUSEPCF2MAE
CVC-
ClinicDB
U-Net0.8230.7550.8340.8390.8270.019
Caranet0.9340.8900.9440.9400.9390.006
MEGANet0.9410.8970.9510.9410.9450.006
SSFormer-S0.9180.8750.9050.9390.9100.007
MSRAFormer0.9240.8740.9450.9200.9320.008
Polyp-PVT0.9370.8890.9490.9360.9450.006
SAM2-UNet0.9140.8600.9160.9200.9140.010
本研究0.9480.9040.9520.9480.9500.006
KvasirU-Net0.8180.7460.8560.8570.8270.055
Caranet0.9220.8720.9150.9410.9210.019
MEGANet0.9160.8660.9130.9390.9120.025
SSFormer-S0.9250.8770.9140.9440.9170.018
MSRAFormer0.9230.8730.9150.9520.9170.024
Polyp-PVT0.9170.8640.9130.9470.9140.023
SAM2-UNet0.9020.8470.9040.9310.9010.029
本研究0.9330.8850.9230.9550.9260.019
表 2  不同网络在CVC-ClinicDB和Kvasir上的对比
数据集网络DicemIoUSEPCF2MAE
CVC-
ColonDB
U-Net0.5120.4440.5230.6210.5100.061
Caranet0.7480.6830.7530.8930.7460.035
MEGANet0.7950.7170.8440.8310.8030.040
SSFormer-S0.7740.6980.7770.8370.7660.036
MSRAFormer0.7820.7070.8030.8740.7870.028
Polyp-PVT0.8080.7270.8210.8490.8090.031
SAM2-UNet0.7290.6560.7440.7860.7310.036
本研究0.8180.7350.8360.8410.8210.026
ETISU-Net0.3980.3350.4820.4390.4290.036
Caranet0.7280.6610.7750.8140.7500.017
MEGANet0.7410.6670.8610.7060.7810.037
SSFormer-S0.7690.6980.8560.7430.8000.016
MSRAFormer0.7500.6790.8110.7450.7770.013
Polyp-PVT0.7870.7060.8670.7740.8200.013
SAM2-UNet0.6820.6020.7480.6680.7100.020
本研究0.7950.7190.8880.7610.8350.014
表 3  不同网络在CVC-ColonDB和ETIS上的对比
图 5  Dice系数变化趋势图
数据集DicemIoUSEPCF2MAE
Polyp0.9630.9300.9630.9640.9630.044
Serrated Adenoma0.9550.9150.9510.9610.9520.056
表 4  锯齿状腺瘤分割指标
图 6  锯齿状腺瘤分割结果
图 7  CVC-ClinicDB和Kvasir数据集上不同网络分割结果
图 8  ETIS和CVC-ColonDB数据集上不同网络分割结果
模型PVTv2Hiera解码器DicemIoUF2
FGFWEFIMSP
M10.9310.8800.934
M20.9170.8610.910
M30.9370.8920.940
M40.9340.8890.941
M50.8830.8320.888
M60.9480.9040.950
表 5  各模块在CVC-ClinicDB数据集上的消融结果
模型PVTv2Hiera解码器DicemIoUF2
FGFWEFIMSP
M10.8080.7240.810
M20.7800.6970.782
M30.7940.7130.809
M40.7960.7150.801
M50.7450.6700.746
M60.8180.7350.821
表 6  各模块在CVC-ColonDB数据集上的消融结果
图 9  消融实验Grad-CAM图
模块参数量/106计算量推理时间/ms
FGF0.1510.0083.98
WEFI0.0370.3792.17
MSP0.0010.0022.01
表 7  模块计算开销与推理延迟
1 ZHAI C, YANG L, LIU Y, et al DBMA-Net: a dual-branch multiattention network for polyp segmentation[J]. IEEE Transactions on Instrumentation and Measurement, 2024, 73: 1- 16
2 GOCERI E Polyp segmentation using a hybrid vision transformer and a hybrid loss function[J]. Journal of Imaging Informatics in Medicine, 2024, 37 (2): 851- 863
3 XIAO B, HU J, LI W, et al CTNet: contrastive transformer network for polyp segmentation[J]. IEEE Transactions on Cybernetics, 2024, 54 (9): 5040- 5053
4 顾正宇, 赖菲菲, 耿辰, 等 基于知识引导的缺血性脑卒中梗死区分割方法[J]. 浙江大学学报: 工学版, 2025, 59 (4): 814- 820
GU Zhengyu, LAI Feifei, GENG Chen, et al Knowledge-guided infarct segmentation of ischemic stroke[J]. Journal of Zhejiang University: Engineering Science, 2025, 59 (4): 814- 820
5 谭婷芳, 蔡万源, 蒋俊正 稀疏分解和图拉普拉斯正则化的图像前景背景分割方法[J]. 浙江大学学报: 工学版, 2024, 58 (5): 979- 987
TAN Tingfang, CAI Wanyuan, JIANG Junzheng Image foreground–background segmentation method based on sparse decomposition and graph Laplacian regularization[J]. Journal of Zhejiang University: Engineering Science, 2024, 58 (5): 979- 987
6 ZHOU L, LIANG L, SHENG X GA-Net: ghost convolution adaptive fusion skin lesion segmentation network[J]. Computers in Biology and Medicine, 2023, 164: 107273
7 QAYOOM A, XIE J, ALI H Polyp segmentation in medical imaging: challenges, approaches and future directions[J]. Artificial Intelligence Review, 2025, 58 (6): 169
8 HU K, CHEN W, SUN Y Z, et al PPNet: pyramid pooling based network for polyp segmentation[J]. Computers in Biology and Medicine, 2023, 160: 107028
9 SHAO H, ZHANG Y, HOU Q. Polyper: boundary sensitive polyp segmentation [EB/OL]. (2023–12–14)[2025–03–09]. https://arxiv.org/abs/2312.08735.
10 YUE G, HAN W, JIANG B, et al Boundary constraint network with cross layer feature integration for polyp segmentation[J]. IEEE Journal of Biomedical and Health Informatics, 2022, 26 (8): 4090- 4099
11 YUE G, ZHUO G, YAN W, et al Boundary uncertainty aware network for automated polyp segmentation[J]. Neural Networks, 2024, 170: 390- 404
12 TRINH Q H. Meta-polyp: a baseline for efficient polyp segmentation [C]// 2023 IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS). [S.l.]: IEEE, 2023: 742–747.
13 JIN Y, HU Y, JIANG Z, et al Polyp segmentation with convolutional MLP[J]. The Visual Computer, 2023, 39 (10): 4819- 4837
14 RATHEESH A, SOMAN P, NAIR M R, et al. Advanced algorithm for polyp detection using depth segmentation in colon endoscopy [C]// 2016 International Conference on Communication Systems and Networks (ComNet). [S.l.]: IEEE, 2016: 179–183.
15 WU H, ZHAO Z, ZHONG J, et al PolypSeg+: a lightweight context-aware network for real-time polyp segmentation[J]. IEEE Transactions on Cybernetics, 2022, 53 (4): 2610- 2621
16 RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation [C]// Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015. [S.l.]: Springer, 2015: 234–241.
17 LIN T Y, DOLLÁR P, GIRSHICK R, et al. Feature pyramid networks for object detection [C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu: IEEE, 2017: 936–944.
18 GUO P, LIU G, LIU H TMPSformer: an efficient hybrid Transformer-MLP network for polyp segmentation[J]. Mobile Networks and Applications, 2024, 29 (4): 1378- 1392
19 JAIN S, ATALE R, GUPTA A, et al CoInNet: a convolution-involution network with a novel statistical attention for automatic polyp segmentation[J]. IEEE Transactions on Medical Imaging, 2023, 42 (12): 3987- 4000
20 ZHOU T, ZHANG Y, CHEN G, et al Edge-aware feature aggregation network for polyp segmentation[J]. Machine Intelligence Research, 2025, 22 (1): 101- 116
21 YIN X, ZENG J, HOU T, et al RSAFormer: a method of polyp segmentation with region self-attention transformer[J]. Computers in Biology and Medicine, 2024, 172: 108268
22 WANG J, HUANG Q, TANG F, et al. Stepwise feature fusion: local guides global [C]// International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham: Springer, 2022: 110–120.
23 LI W, XIONG X, LI S, et al Hybridvps: hybrid-supervised video polyp segmentation under low-cost labels[J]. IEEE Signal Processing Letters, 2023, 31: 111- 115
24 WANG W, XIE E, LI X, et al PVT v2: improved baselines with pyramid vision transformer[J]. Computational Visual Media, 2022, 8 (3): 415- 424
25 XIONG X, WU Z, TAN S, et al. SAM2-UNet: segment anything 2 makes strong encoder for natural and medical image segmentation [EB/OL]. (2024–08–16)[2025–03–09]. https://arxiv.org/abs/2408.08870.
26 HUANG Z, XIE F, QING W, et al MGF-net: multi-channel group fusion enhancing boundary attention for polyp segmentation[J]. Medical Physics, 2024, 51 (1): 407- 418
27 FINDER S E, AMOYAL R, TREISTER E, et al. Wavelet convolutions for large receptive fields [C]// European Conference on Computer Vision. Cham: Springer, 2024: 363–380.
28 GUAN X, ZHOU J, CHEN J, et al EMFF-Net: edge-enhancement multi-scale feature fusion network[J]. IEEE Access, 2025, 13: 25598- 25611
29 梁礼明, 何安军, 李仁杰, 等 跨尺度跨维度的自适应Transformer网络应用于结直肠息肉分割[J]. 光学精密工程, 2023, 31 (18): 2700- 2712
LIANG Liming, HE Anjun, LI Renjie, et al Application of adaptive Transformer network to colorectal polyp segmentation at scales and dimensions[J]. Optics and Precision Engineering, 2023, 31 (18): 2700- 2712
30 LOU A G, GUAN S Y, KO H, et al. CaraNet: context axial reverse attention network for segmentation of small medical objects [EB/OL]. (2022–01–13)[2025–12–22]. https://arxiv.org/abs/2108.07368.
31 BUI N T, HOANG D H, NGUYEN Q T, et al. MEGANet: multi-scale edge-guided attention network for weak boundary polyp segmentation [EB/OL]. (2023–11–05)[2025–03–09]. https://arxiv.org/abs/2309.03329.
32 SHI W T, XU J, GAO P. Ssformer: a lightweight transformer for semantic segmentation [EB/OL]. (2022–08–03)[2025–12–22]. https://arxiv.org/abs/2309.03329.
[1] 柳长源,赵海健,吴海滨,刘佳伟. 面向自动驾驶的轻量化交警手势识别方法[J]. 浙江大学学报(工学版), 2026, 60(8): 1678-1685.
[2] 郭子强,肖璇,陶浩然,王少荣. 全局学习扩展的可见光-红外行人重识别[J]. 浙江大学学报(工学版), 2026, 60(8): 1670-1677.
[3] 徐恺蔚,KHIZER BIN TALIBHafiz,曹衍龙,许源平,许志杰,宋景春. 基于光流和卷积视觉Transformer的轻量级微表情识别[J]. 浙江大学学报(工学版), 2026, 60(7): 1381-1391.
[4] 董绍江,肖涛,吕振鸣,夏浩然,罗家元,孙世政,张霞,刘超. 基于改进RT-DETR的水下色偏环境中小型生物检测[J]. 浙江大学学报(工学版), 2026, 60(7): 1404-1415.
[5] 王平,徐安之,赵洪黎,魏小源,杨富龙. 融合流体自动标注与轻量化YOLOv8n的泥石流实时检测方法[J]. 浙江大学学报(工学版), 2026, 60(7): 1416-1426.
[6] 肖剑,杨小苑,何昕泽,陈林,胡欣. 基于全局信息感知的轻量级螺纹钢表面缺陷检测算法[J]. 浙江大学学报(工学版), 2026, 60(7): 1438-1451.
[7] 吴佰靖,闫光辉,马龙,程文鑫,黄亚宁. 边缘感知和跨尺度特征增强的小目标水漂垃圾检测[J]. 浙江大学学报(工学版), 2026, 60(7): 1452-1463.
[8] 于鑫淼,夏楠,江佳鸿,郝子莹,把云胜. 基于多尺度特征相似性匹配的低照度目标检测[J]. 浙江大学学报(工学版), 2026, 60(7): 1464-1474.
[9] 王铮,张梦君,姜楠,王万良,屠杭垚. 基于多特征融合和牛顿-拉夫逊优化算法的LSTM日径流预测[J]. 浙江大学学报(工学版), 2026, 60(7): 1567-1576.
[10] 于天河,王文龙,刘镛,杨壮壮,侯善冲. 改进的有雾图像中被遮挡车辆及行人识别算法[J]. 浙江大学学报(工学版), 2026, 60(4): 738-750.
[11] 张雪梅,孙颖,张雪英. 基于无监督图对比学习的语音情感识别[J]. 浙江大学学报(工学版), 2026, 60(4): 782-790.
[12] 侯玉珍,沈晓红,李莉,杨明源,张彩明. 基于掩模和非局部注意力的双阶段去雨网络[J]. 浙江大学学报(工学版), 2026, 60(4): 791-799.
[13] 孟昱煜,孔垂乐,火久元,武泽宇. 重构YOLOv11的无人机小目标检测算法[J]. 浙江大学学报(工学版), 2026, 60(2): 303-312.
[14] 陈佳舟,朱肖航,徐阳辉,高崟,鲁一慧,毛真,李胜龙,章超权. 基于深度霍夫投票的建筑点云轻量级表面重建[J]. 浙江大学学报(工学版), 2026, 60(2): 341-350.
[15] 肖剑,何昕泽,程鸿亮,杨小苑,胡欣. 基于多尺度特征增强的航拍小目标检测算法[J]. 浙江大学学报(工学版), 2026, 60(1): 19-31.