Please wait a minute...
Journal of ZheJiang University (Engineering Science)  2026, Vol. 60 Issue (9): 1942-1952    DOI: 10.3785/j.issn.1008-973X.2026.09.011
    
Road segmentation algorithm based on joint orthogonal feature fusion and large kernel separable attention
Yijie TANG1(),Mingen ZHONG1,*(),Bingan YUAN2,Kang FAN3,Jiawei TAN3,Zhiqiang LIN1
1. Key Laboratory of Advanced Design and Manufacturing for Buses in Fujian Province, School of Mechanical and Automotive Engineering, Xiamen University of Technology, Xiamen 361024, China
2. Department of Engineering Physics, Tsinghua University, Be?ing 100084, China
3. School of Aerospace Engineering, Xiamen University, Xiamen 361005, China
Download: HTML     PDF(1960KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

A lightweight road segmentation algorithm for aerial imagery, termed ARSNet, was proposed to address the issue that roads in aerial images often suffer from structural ambiguity and discontinuous edges. An orthogonal feature fusion module (OFFM) was designed to achieve interaction and enhancement among features in different orientations. A context-guided feature aggregation module (C2f-CGA) was introduced to improve the continuity of road boundary and topological structure extraction. Large-kernel separable attention was introduced into the feature spatial pooling module in order to strengthen the collaborative perception of road features across various scales and directions. A layer-adaptive sparse pruning strategy based on weight magnitude was employed to reduce the number of parameters to 22.5×106 with FLOPs controlled at 14.8×109. Experiments conducted on the public Massachusetts and DeepGlobe datasets showed that ARSNet achieved precision of 78.12% and 79.78%, recall of 79.63% and 81.63%, intersection-over-union of 64.85% and 67.88%, and average path length similarity of 74.95% and 75.53%, respectively. ARSNet achieved an inference speed of 178 frames per second while maintaining high accuracy, consistently outperforming a series of state-of-the-art algorithms.



Key wordsaerial imagery      road segmentation      orthogonal feature fusion      context feature-guided aggregation      large kernel separable attention      model pruning     
Received: 06 August 2025      Published: 20 July 2026
CLC:  TP 391  
Fund:  福建省自然科学基金资助项目(2023J011439).
Corresponding Authors: Mingen ZHONG     E-mail: 2421011030@stu.xmut.edu.cn;zhongmingen@xmut.edu.cn
Cite this article:

Yijie TANG,Mingen ZHONG,Bingan YUAN,Kang FAN,Jiawei TAN,Zhiqiang LIN. Road segmentation algorithm based on joint orthogonal feature fusion and large kernel separable attention. Journal of ZheJiang University (Engineering Science), 2026, 60(9): 1942-1952.

URL:

https://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2026.09.011     OR     https://www.zjujournals.com/eng/Y2026/V60/I9/1942


联合正交特征融合与大核可分离注意力的道路分割算法

针对航拍图像中的道路结构模糊、边缘不连贯等特点,提出轻量级道路分割算法ARSNet. 设计正交特征融合模块(OFFM),实现不同方向图像特征间的交互与增强. 构建上下文特征引导聚合模块,提升算法在道路边缘拓扑结构提取时的连贯性. 在特征空间池化操作中引入大核可分离注意力,加强对各种尺度和方向上的道路特征的协同感知能力. 基于神经网络权重幅值进行层自适应稀疏剪枝,将算法参数量降低到22.5×106,FLOPs控制在14.8×109. 在公开数据集Massachusetts与DeepGlobe上的实验结果表明,所提算法的道路分割精确度分别为78.12%和79.78%,召回率为79.63%和81.63%,像素交并比为64.85%和67.88%,平均路径长度相似度达到74.95%和75.53%. ARSNet在保持较高精度的前提下,推理速度达到178帧/s,整体性能优于所对比的主流算法.


关键词: 航拍图像,  道路分割,  正交特征融合,  上下文特征引导聚合,  大核可分离注意力,  模型剪枝 
Fig.1 Overall structure of ARSNet
Fig.2 Schematic diagram of orthogonal feature fusion module
Fig.3 Schematic diagram of context-guided aggregation module
Fig.4 Schematic diagram of large separable kernel attention spatial pooling module
算法名称Massachusetts数据集DeepGlobe数据集参数量/106FLOPs/109FPS/(帧?s?1)
P/%R/%IoU/%APLS/%P/%R/%IoU/%APLS/%
U-Net[18]77.2972.1359.4666.8473.2070.1059.0665.3726.4223.9158
SegNet[19]72.7977.4160.1166.9779.8475.9263.7965.6929.5170.5133
Deeplabv3+[20]75.4777.9762.2567.7678.2076.2462.3365.8654.783.293
D-LinkNet[21]74.5778.8561.7567.9873.5081.3863.3666.0531.133.6145
SDUNet77.5674.5761.3468.0578.4080.4365.9167.8480.2353.350
DSCNet75.8377.4762.2270.1877.0375.9162.7670.594.540.4211
RoadExNet[22]82.4672.8963.1068.8677.7677.1463.5169.3531.133.8138
OARENet[23]77.7975.2361.9667.0579.8876.7064.0469.8471.399.964
FRCFNet[24]76.5976.8463.4767.3477.4878.7365.0967.1112.337.8166
CFRNet[25]77.6377.0663.7772.2978.9378.8966.2871.5136.635.7169
UNetMamba[26]77.0778.3463.8973.1578.4379.3866.2272.2814.825.1171
LCMorph76.9378.5163.5578.5181.0266.3071.9294.6
LightFormer[27]77.5278.6564.2173.9178.8681.3366.7974.4213.723.9172
ARSNet(ours)78.1279.6364.8574.9579.7881.6367.8875.5322.514.8178
Tab.1 Performance comparison results of different algorithms
Fig.5 Comparison of segmentation results of different algorithms on Massachusetts dataset
Fig.6 Comparison of segmentation results of different algorithms on DeepGlobe dataset
方法+OFFM+C2f-CGA+LSKASPMMassachusetts数据集DeepGlobe数据集参数量/106FLOPs/109
P/%R/%IoU/%APLS/%P/%R/%IoU/%APLS/%
基准模型×××77.3272.2659.7171.2973.8272.7660.9671.3328.124.3
a××78.3774.4561.8372.0275.8774.2263.5272.4229.724.8
b××78.1573.4262.3574.0875.7973.3863.9674.6734.827.6
c××78.5173.2262.3072.5379.5573.1663.6872.7428.924.7
d×78.5078.3264.0174.3177.9678.5566.7474.9836.628.5
e×78.5978.2763.8873.7780.0279.3666.9274.1931.226.5
f×78.5677.4564.8274.6179.9978.0767.9675.3836.328.4
g78.6579.9865.1275.3680.2181.9868.4175.9337.329.2
Tab.2 Ablation experiment results
Fig.7 Visual comparison of module ablation experiment on Massachusetts dataset
Fig.8 Visual comparison of module ablation experiment on DeepGlobe dataset
方法Massachusetts数据集DeepGlobe数据集参数量/106FLOPs/109
P/%R/%IoU/%APLS/%P/%R/%IoU/%APLS/%
未剪枝78.6579.9865.1275.3680.2181.9868.4175.9337.329.2
L1[29]74.6275.8861.4771.8376.3577.6864.5872.7822.514.9
Group norm[30]75.5876.9362.3872.0877.6378.7465.4773.5122.815.3
Group hessian[31]74.9676.3961.9571.9276.5378.3164.8972.8722.715.4
Group taylor[32]74.3575.4361.1871.6976.0277.3364.0872.2822.815.1
LAMP78.1279.6364.8574.9579.7881.6367.8875.5322.514.8
Tab.3 Performance comparison of different pruning methods
剪枝率Massachusetts数据集DeepGlobe数据集
IoU/%APLS/%IoU/%APLS/%
065.1275.3668.4175.93
0.165.0975.3168.2275.71
0.265.0575.2868.0375.59
0.364.8574.9567.8875.53
0.464.7174.8865.2173.86
0.562.3472.6361.3270.28
0.660.7570.8956.5566.98
0.754.8365.7850.0860.84
0.847.2658.4937.6349.85
Tab.4 Comparison of pruning rate with IoU and APLS under LAMP pruning method
[1]   QI Y, HE Y, QI X, et al. Dynamic snake convolution based on topological geometric constraints for tubu-lar structure segmentation [C]// IEEE/CVF International Conference on Computer Vision. Paris: IEEE, 2023: 6070-6079.
[2]   王艳军, 唐徐超, 王成, 等 基于道路拓扑关联特征的城乡道路面精细提取网络[J]. 测绘学报, 2025, 54 (1): 75- 89
WANG Yanjun, TANG Xuchao, WANG Cheng, et al Urban and rural road surface extraction network based on topological correlation features[J]. Acta Geodaetica et Cartographica Sinica, 2025, 54 (1): 75- 89
[3]   DEY M, P S P, AITHAL B H. UnetEdge: a transfer learning-based framework for road feature segmentation from high-resolution remote sensing images[J]. Remote Sensing Applications: Society and Environment, 2024, 34: 101160
doi: 10.1016/j.rsase.2024.101160
[4]   LI X, YANG S, MENG F, et al LCMorph: exploiting frequency cues and morphological perception for low-contrast road extraction in remote sensing images[J]. Remote Sensing, 2025, 17 (2): 257
doi: 10.3390/rs17020257
[5]   WANG Y, SEO J, JEON T NL-LinkNet: toward lighter but more accurate road extraction with nonlocal operations[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 1- 5
[6]   YANG M, YUAN Y, LIU G SDUNet: road extraction via spatial enhanced and densely connected UNet[J]. Pattern Recognition, 2022, 126: 108549
doi: 10.1016/j.patcog.2022.108549
[7]   LEE J, PARK S, MO S, et al. Layer-adaptive sparsity for the magnitude-based pruning [EB/OL]. (2020-11-15)[2025-06-05]. https://arxiv.org/pdf/2010.07611.
[8]   YUAN T, HU B REU-Net: a remote sensing image building segmentation network based on residual structure and the edge enhancement attention module[J]. Applied Sciences, 2025, 15 (6): 3026
doi: 10.3390/app15063026
[9]   SUREKHA J N, NEHA G SAR U-Net: spatial attention residual U-Net structure for water body segmentation from remote sensing satellite images[J]. Multimedia Tools and Applications, 2023, 83 (15): 44425- 44454
doi: 10.1007/s11042-023-16965-8
[10]   TERVEN J, CORDOVA-ESPARZA D M, ROMERO-GONZALEZ J A A comprehensive review of Yolo architectures in computer vision: from Yolov1 to Yolov8 and Yolo-NAS[J]. Machine Learning and Knowledge Extraction, 2023, 5 (4): 1680- 1716
doi: 10.3390/make5040083
[11]   范康, 钟铭恩, 谭佳威, 等 联合语义分割和深度估计的交通场景感知算法[J]. 浙江大学学报: 工学版, 2024, 58 (4): 684- 695
FAN Kang, ZHONG Mingen, TAN Jiawei, et al Traffic scene perception algorithm based on joint semantic segmentation and depth estimation[J]. Journal of Zhejiang University: Engineering Science, 2024, 58 (4): 684- 695
[12]   JIN Y H, GAN H Y, LI J, et al ResEff-YOLO: accuracy enhancement of YOLOv8 through integration of ResNet, SPPF, and EfficientHead modules[J]. International Core Journal of Engineering, 2025, 11 (2): 23- 34
[13]   LAU K W, PO L M, REHMAN Y A U Large separable kernel attention: rethinking the large kernel attention design in CNN[J]. Expert Systems with Applications, 2024, 236: 121352
doi: 10.1016/j.eswa.2023.121352
[14]   ZHANG X L, LU L, LUO H Y, et al Improvement in pavement defect scenarios using an improved YOLOv10 with ECA attention, RefConv and WIoU[J]. World Electric Vehicle Journal, 2025, 16 (6): 328
doi: 10.3390/wevj16060328
[15]   MNIH V. Machine Learning for aerial image labeling [D]. Toronto Q12: University of Toronto, 2013.
[16]   DEMIR I, KOPERSKI K, LINDENBAUM D, et al. Deepglobe 2018: A challenge to parse the earth through satellite images [C]// IEEE Conference on Computer Vision and Pattern Recognition Workshops. Salt Lake City: IEEE, 2018: 172–181.
[17]   VAN ETTEN A, LINDENBAUM D, BACASTOW T M. SpaceNet: a remote sensing dataset and challenge series [EB/OL]. (2019-07-15)[2025-06-05]. https://arxiv.org/abs/1807.01232.
[18]   RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation [C]// Medical Image Computing and Computer-Assisted Intervention. Cham: Springer, 2015: 234-241.
[19]   BADRINARAYANAN V, KENDALL A, CIPOLLA R, et al SegNet: a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39 (12): 2481- 2495
[20]   CHEN L, ZHU Y, PAPANDREOU G, et al. Encoder-decoder with atrous separable convolution for semantic image segmentation [C]// European Conference on Computer Vision. Munich: IEEE, 2018: 801–818.
[21]   ZHOU L, ZHANG C, WU M, et al. D-linknet: Linknet with pretrained encoder and dilated convolution for high resolution satellite imagery road extraction [C]// IEEE Conference on Computer Vision and Pattern Recognition Workshop. Salt Lake City: IEEE, 2018: 182–186.
[22]   CHEN H, LI Z, WU J, et al SemiRoadExNet: a semi-supervised network for road extraction from remote sensing imagery via adversarial learning[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2023, 198: 169- 183
doi: 10.1016/j.isprsjprs.2023.03.012
[23]   YANG R, ZHONG Y, LIU Y, et al Occlusion-aware road extraction network for high-resolution remote sensing imagery[J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62: 5619316
[24]   WANG H, BAI L, XUE D, et al FRCFNet: feature reassembly and context information fusion network for road extraction[J]. IEEE Geoscience and Remote Sensing Letters, 2024, 21: 2502805
[25]   XIONG Y, LI L, YUAN D, et al CFRNet: road extraction in remote sensing images based on cascade fusion network[J]. IEEE Geoscience and Remote Sensing Letters, 2024, 21: 6011705
[26]   ZHU E Z, CHEN Z, WANG D K, et al UNetMamba: an efficient UNet-Like Mamba for semantic segmentation of high-resolution remote sensing images[J]. IEEE Geoscience and Remote Sensing Letters, 2025, 22: 6001205
[27]   CHEN S H, YU L J, LIU Z, et al. LightFormer: a lightweight and efficient decoder for remote sensing image segmentation [EB/OL]. (2025-04-15)[2025-06-05]. https://arxiv.org/pdf/2504.10834.
[28]   CARRERAS J Celiac disease Deep Learning image classification using convolutional neural networks[J]. Journal of Imaging, 2024, 10 (8): 200
doi: 10.3390/jimaging10080200
[29]   刘洲峰, 吴文涛, 李环宇, 等 聚类和群智能优化算法的自动剪枝方法[J]. 计算机工程与应用, 2025, 61 (11): 204- 215
LIU Zhoufeng, WU Wentao, LI Huanyu, et al Automatic channel pruning method based on clustering and swarm intelligence optimization algorithm[J]. Computer Engineering and Applications, 2025, 61 (11): 204- 215
[30]   FANG G, MA X, SONG M, et al. Depgraph: towards any structural pruning [C]// IEEE/CVF Conference on Computer Vision and Pattern Recognition. Vancouver: IEEE, 2023: 16091-16101.
[31]   YU S X, YAO Z W, GHOLAMI A, et al. Hessian-aware pruning and optimal neural implant [C]// IEEE/CVF Winter Conference on Applications of Computer Vision. Waikoloa, HI: IEEE, 2022: 3665-3676.
[32]   MOLCHANOV P, MALLYA A, TYREE S, et al. Importance estimation for neural network pruning [C]// IEEE/CVF Conference on Computer Vision and Pattern Recognition. Vancouver: IEEE, 2019: 11264-11272.
[33]   SONG H X, XIE J P, DUAN Y Y, et al CMKD-Net: a cross-modal knowledge distillation method for remote sensing image classification[J]. Advances in Space Research, 2025, 75 (12): 8515- 8534
doi: 10.1016/j.asr.2025.04.009
[1] Kaijun WU,Yunqi ZHENG,Ding WEI,Haixiang YUAN. YOLOv8s based lightweight algorithm for small object detection in aerial imagery[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(9): 1912-1923.
[2] Xiaochun WU,Zining LI. Improved railway worker safety wear detection model based on YOLOv11n[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(9): 1901-1911.
[3] Jun LI,Binbin DING,Weijuan SHI,Lin YANG. Aerial image detection algorithm based on multiscale feature aggregation[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(9): 1890-1900.
[4] Jiuyuan HUO,Hao JIANG,Chen CHANG. Text detection of highway traffic sign based on improved EAST[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(9): 1881-1889.
[5] Hongsheng FU,Yanlong CAO,Junding LUO,Zongzheng ZHANG,Tukun LI,Fang HUANG. Spatial-semantic hierarchical knowledge graph modeling for body-in-white datum design[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(9): 1841-1850.
[6] Guangqiu CHEN,Tianrong REN,Jin DUAN,Dandan HUANG. Cross-modal semantic segmentation algorithm with edge-assisted and multi-level feature fusion[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1782-1791.
[7] Liming LIANG,Ting KANG,Kangquan CHEN,Yi ZHONG. Dual-encoder polyp segmentation with feature-gated fusion and wavelet enhancement[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1720-1729.
[8] Changyuan LIU,Haijian ZHAO,Haibin WU,Jiawei LIU. Lightweight traffic police gesture recognition method for autonomous driving[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1678-1685.
[9] Yebo FAN,Yicheng LI,Yong LIU,Wei ZHANG. Efficient attack model targeting GNN-based rumor detectors[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1739-1748.
[10] Zhe HAN,Qingfang MENG,Qiang ZHANG,Xianglong ZHANG,Yaou ZHAO. Seizure prediction method based on multi-domain feature and GATv2 network[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1760-1769.
[11] Weijia YI,Mengyi LIU,Jianqiu XU. LLM-driven construction of spatial natural language query corpora[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1792-1800.
[12] Ziqiang GUO,Xuan XIAO,Haoran TAO,Shaorong WANG. Global learning-expanded visible-infrared person re-identification[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1670-1677.
[13] Shuxu ZHAO,Qi ZHU,Xiaolong WANG. Reliability-enhanced task deployment method in mobile edge computing environments[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1697-1708.
[14] Kaiwei XU,Hafiz KHIZER BIN TALIB,Yanlong CAO,Yuanping XU,Zhijie XU,Jingchun SONG. Lightweight micro-expression recognition based on optical flow and convolutional vision Transformer[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(7): 1381-1391.
[15] Ping WANG,Anzhi XU,Hongli ZHAO,Xiaoyuan WEI,Fulong YANG. Real-time debris flow detection method combining fluid automatic annotation and lightweight YOLOv8n[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(7): 1416-1426.