Please wait a minute...
Journal of ZheJiang University (Engineering Science)  2025, Vol. 59 Issue (10): 2045-2055    DOI: 10.3785/j.issn.1008-973X.2025.10.005
    
Multi-hole repair method for unordered point cloud models
Yueqiao HOU1(),Chengyan WANG1,Siran HUAI2,Yonghang LI1,Jialin CHEN2,Dapeng TAN1,*()
1. College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China
2. Beijing Changcheng Aeronautical Measurement and Control Technology Research Institute, Aviation Industry Corporation of China, Limited , Beijing 101111, China
Download: HTML     PDF(4599KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

To address the holes of point cloud models generated by data processing, a multi-hole repair method for unordered point clouds was proposed. A density formula for nonuniform data points was proposed to obtain the range of neighborhoods to be projected, and the boundaries were identified by the angular discrimination method using the overall fitting plane as the projection surface. The boundary centers were defined, and the hole boundaries were extracted with the positional relationship among the boundary centers, the boundary, and the boundary neighbors. Points were interpolated using the triangular patch method within the regularized and homogenized projection boundary, and surface reduction hole features were fitted based on the boundary neighborhood. A parametric equation was proposed to fill the point cloud holes, and a multidimensional loop algorithm was designed to realize the automatic repair of multiple holes. The algorithm was analyzed and experimentally validated by a CAD point cloud model and LiDAR measurement data, respectively. Results show that the proposed method leads to an effective reduction of misidentified points at the boundary when the microtome is used as the projection plane, and the repair of unordered point cloud models with multiple holes has been achieved. In experiments for point clouds of different objects, the proposed method achieves a restoration error in the millimeter range.



Key wordsunordered point cloud      hole identification      nonuniform data      parameter mapping equations      multi-hole repair     
Received: 28 September 2024      Published: 27 October 2025
CLC:  TP 274  
  TP 391  
Corresponding Authors: Dapeng TAN     E-mail: student_qiao@163.com;tandapeng@zjut.edu.cn
Cite this article:

Yueqiao HOU,Chengyan WANG,Siran HUAI,Yonghang LI,Jialin CHEN,Dapeng TAN. Multi-hole repair method for unordered point cloud models. Journal of ZheJiang University (Engineering Science), 2025, 59(10): 2045-2055.

URL:

https://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2025.10.005     OR     https://www.zjujournals.com/eng/Y2025/V59/I10/2045


无序点云模型的多孔洞修补方法

针对数据处理产生的点云模型孔洞,提出无序点云的多孔洞修补方法. 推导出不均匀数据点的密度公式得到邻域投影范围,使用角判别法以整体拟合平面为投影面进行边界识别. 定义边界形心,以形心、边界和边界邻域三者之间的位置关系提取孔洞边界. 在规则化与均匀化投影边界内以三角片法插值点,基于边界邻域拟合曲面还原孔洞特征,推导出参数方程进行点云孔洞填充,设计多维循环算法实现多孔洞自动修补. 利用CAD点云模型与激光雷达测量数据分别进行算法分析与实验验证. 结果表明,所提方法有效减少了以微切面为投影面时边界点的错误识别,实现了多个不同孔同时存在时无序点云模型的修补;在针对不同对象的实验中,所提方法的修复误差达到毫米级.


关键词: 无序点云,  孔洞识别,  非均匀数据,  参数映射方程,  多孔洞修补 
Fig.1 Flow chart of hole boundary identification
Fig.2 Illustration of angle discrimination method
Fig.3 Visualization of boundary identification
Fig.4 Visualization of boundary segmentation
Fig.5 Hole boundary identification and location
Fig.6 Flowchart of hole repair for point cloud
Fig.7 Preprocessing of projected boundaries
Fig.8 Point interpolation process using triangular patch method
Fig.9 Point interpolation principle of triangular patch method
Fig.10 Hole-repair results and absolute error
Fig.11 Visualization of multi-hole boundary identification
Fig.12 Visualization of multi-hole repair
Fig.13 Comparison of different hole recognition methods
Fig.14 Comparison of different hole repair methods
Fig.15 Absolute repair error of surface-equation fitting method
Fig.16 LiDAR measurement platform
Fig.17 Car point cloud image
Fig.18 Hole-repair visualization for car point clouds
Fig.19 Original appearance of pipeline and its point cloud image
Fig.20 Hole-repair results and absolute error of pipeline point clouds
[1]   HE Y, MA W, LI Y, et al An octree-based two-step method of surface defects detection for remanufacture[J]. International Journal of Precision Engineering and Manufacturing-Green Technology, 2023, 10 (2): 311- 326
doi: 10.1007/s40684-022-00433-z
[2]   WANG R, AN M, SHAO S, et al Lidar sensor-based object recognition using machine learning[J]. Journal of Russian Laser Research, 2021, 42 (4): 484- 493
doi: 10.1007/s10946-021-09986-x
[3]   PRÜNTE P, SCHOEPFLIN D, SCHÜPPSTUHL T A comparative study of visual identification methods for highly similar engine tubes in aircraft maintenance, repair and overhaul[J]. Sensors, 2023, 23 (15): 6779
doi: 10.3390/s23156779
[4]   WU B, BAI Y, LV K, et al Accurately identifying the defects of bubbles and foreign objects under the protective films of electric vehicle batteries by using 3D point clouds[J]. Measurement Science and Technology, 2024, 35 (9): 095015
doi: 10.1088/1361-6501/ad57e1
[5]   HUANG Y, DA F Three-dimensional face point cloud hole-filling algorithm based on binocular stereo matching and a B-spline[J]. Frontiers of Information Technology and Electronic Engineering, 2022, 23 (3): 398- 408
doi: 10.1631/FITEE.2000508
[6]   CUI L, ZHANG G, WANG J Hole repairing algorithm for 3D point cloud model of symmetrical objects grasped by the manipulator[J]. Sensors, 2021, 21 (22): 7558
doi: 10.3390/s21227558
[7]   KIM Y, NGUYEN C H P, CHOI Y Automatic pipe and elbow recognition from three-dimensional point cloud model of industrial plant piping system using convolutional neural network-based primitive classification[J]. Automation in Construction, 2020, 116: 103236
doi: 10.1016/j.autcon.2020.103236
[8]   ZHANG Q, HOU Z, HUANG L, et al Reparation with moving least squares sampling and extraction of body sizes of beef cattle from unilateral point clouds[J]. Computers and Electronics in Agriculture, 2024, 224: 109208
doi: 10.1016/j.compag.2024.109208
[9]   ATIK M E, DURAN Z 3D facial recognition using local feature-based methods and accuracy assessment[J]. Journal of the Faculty of Engineering and Architecture of Gazi University, 2021, 36 (1): 359- 371
[10]   STRAKOVÁ E, LUKÁŠ D, BOBOVSKÝ Z, et al Matching point clouds with STL models by using the principle component analysis and a decomposition into geometric primitives[J]. Applied Sciences, 2021, 11 (5): 2268
doi: 10.3390/app11052268
[11]   MENG Y, JIANG Y, LI Y, et al Research on point cloud processing and grinding trajectory planning of steel helmet based on 3D scanner[J]. IEEE Access, 2023, 12: 3085- 3097
[12]   YAU H T, YANG T J, JIAN H Z A region-growing algorithm using parallel computing for surface reconstruction from unorganized points[J]. Advances in Engineering Software, 2013, 59: 29- 37
doi: 10.1016/j.advengsoft.2013.03.002
[13]   崔文, 陈辉, 刘万泉 激光三角网格点云孔洞曲面修补方法[J]. 激光与光电子学进展, 2021, 58 (20): 2014002
CUI Wen, CHEN Hui, LIU Wanquan Hole surface repairing for laser triangular mesh point cloud[J]. Laser and Optoelectronics Progress, 2021, 58 (20): 2014002
[14]   李松, 马聪聪, 陆帆, 等 基于多向波前法的岛屿孔洞修补[J]. 中国机械工程, 2019, 30 (20): 2473- 2479
LI Song, MA Congcong, LU Fan, et al Island hole repairing based on multi-directional advancing method[J]. China Mechanical Engineering, 2019, 30 (20): 2473- 2479
[15]   CHEN H, CUI W Holes filling of scattered point cloud based on simplification[J]. Multimedia Tools and Applications, 2022, 81 (11): 14641- 14661
doi: 10.1007/s11042-021-11019-3
[16]   罗年猛, 郑凌锋, 朱林, 等 结合间接邻域的散乱点云三角网格曲面重构[J]. 计算机工程与应用, 2014, 50 (20): 144- 148
LUO Nianmeng, ZHENG Lingfeng, ZHU Lin, et al Surface reconstruction algorithm with indirect neighborhood point set from scattered point cloud[J]. Computer Engineering and Applications, 2014, 50 (20): 144- 148
[17]   LUO N, WANG Q Fast self-repairing region growing surface reconstruction algorithm for unorganised point cloud data[J]. International Journal of Computer Applications in Technology, 2017, 56 (2): 121
doi: 10.1504/IJCAT.2017.087330
[18]   LIN H, WANG W. Feature preserving holes filling of scattered point cloud based on tensor voting [C]// Proceedings of the IEEE International Conference on Signal and Image Processing. Beijing: IEEE, 2016: 402–406.
[19]   兰猗令, 康传利, 王宁, 等 附加增值条件的移动最小二乘法的点云孔洞修补[J]. 红外与激光工程, 2023, 52 (2): 414- 423
LAN Yiling, KANG Chuanli, WANG Ning, et al Additional value-added conditional moving least squares method for point cloud hole repair[J]. Infrared and Laser Engineering, 2023, 52 (2): 414- 423
[20]   张炎, 刘立龙, 何广焕, 等 改进哈里斯鹰优化算法在匹配地面点云孔洞修补中的应用[J]. 测绘通报, 2023, (6): 82- 87
ZHANG Yan, LIU Lilong, HE Guanghuan, et al Application of improved Harris Hawks optimization algorithm in patching cloud holes at matching ground points[J]. Bulletin of Surveying and Mapping, 2023, (6): 82- 87
[21]   ZHANG C, ZHOU H, DUAN J A A method for identifying and repairing holes on the surface of unorganized point cloud[J]. Measurement, 2023, 210: 112575
doi: 10.1016/j.measurement.2023.112575
[22]   DONG T, ZHANG Y, LI M, et al Point cloud repair method via convex set theory[J]. Applied Sciences, 2023, 13 (3): 1830
doi: 10.3390/app13031830
[23]   WEN Z, YU J, YIN L, et al Improved hole repairing algorithm for livestock point clouds based on cubic B-spline for region defining[J]. Measurement, 2022, 190: 110668
doi: 10.1016/j.measurement.2021.110668
[24]   吕富强, 唐诗华, 张炎, 等 SSA-BP神经网络在无人机点云孔洞修补的应用[J]. 测绘通报, 2023, (5): 130- 134
LÜ Fuqiang, TANG Shihua, ZHANG Yan, et al Application of SSA-BP neural network in UAV point cloud hole repair[J]. Bulletin of Surveying and Mapping, 2023, (5): 130- 134
[25]   王春香, 郝林文, 王耀, 等 基于GA-BP神经网络的散乱点云孔洞自动修补[J]. 工程设计学报, 2021, 28 (2): 155- 162
WANG Chunxiang, HAO Linwen, WANG Yao, et al Automatic repair of scattered point cloud hole based on GA-BP neural network[J]. Chinese Journal of Engineering Design, 2021, 28 (2): 155- 162
[26]   DUAN W, ZHANG P, HUANG L, et al Ship hull surface reconstruction from scattered points cloud using an RBF neural network mapping technology[J]. Computers and Structures, 2023, 281: 107012
[27]   FU S Point cloud data hole repair aggregation algorithm based on optimized neural network[J]. Wireless Communications and Mobile Computing, 2022, 2022 (1): 7875422
doi: 10.1155/2022/7875422
[28]   VAN NGUYEN S, LE S T, TRAN M K, et al Filling the holes on 3D heritage object surface based on automatic segmentation algorithm[J]. Expert Systems, 2025, 42 (2): e13749
doi: 10.1111/exsy.13749
[29]   张丽艳, 周儒荣, 周来水 三角网格模型孔洞修补算法研究[J]. 应用科学学报, 2002, 20 (3): 221- 224
ZHANG Liyan, ZHOU Rurong, ZHOU Laishui Research on the algorithm of hole repairing in mesh surfaces[J]. Journal of Applied Sciences, 2002, 20 (3): 221- 224
[30]   FAN J, ZENG J A Levenberg–Marquardt algorithm with correction for singular system of nonlinear equations[J]. Applied Mathematics and Computation, 2013, 219 (17): 9438- 9446
doi: 10.1016/j.amc.2013.03.026
[31]   李绕波, 袁希平, 甘淑, 等 综合多种算法的点云精简优化策略与实验研究[J]. 激光与光电子学进展, 2020, 57 (23): 231402
LI Raobo, YUAN Xiping, GAN Shu, et al Point cloud simplification optimization strategy and experimental research based on multiple algorithms[J]. Laser and Optoelectronics Progress, 2020, 57 (23): 231402
doi: 10.3788/LOP57.231402
No related articles found!