Please wait a minute...
Chinese Journal of Engineering Design  2026, Vol. 33 Issue (2): 159-168    DOI: 10.3785/j.issn.1006-754X.2026.05.201
Theory and Method of Mechanical Design     
Fault classification and prediction of rock drill based on multi-feature time-series labeling Transformer
Nianwen QIN()
China Railway Construction Heavy Industry Corporation Limited, Changsha 410100, China
Download: HTML     PDF(9665KB)
Export: BibTeX | EndNote (RIS)      

Abstract  

In order to tackle the technical bottleneck of predicting jamming and empty drilling faults of rock drills in drill-and-blast tunnel construction, a method of fault classification and prediction of the rock drill based on multi-feature time-series labeling Transformer was proposed. By collecting the key high-frequency while-drilling parameters of the rock drill under various working conditions, and integrating the thresholds of these parameters in the faulty states, a labeled dataset of jamming and empty drillin was constructed. A multi-feature time-series labeling strategy was designed to convert raw data into sequences of embedding vectors with temporal relationships. Building upon this, a multi-head self-attention mechanism was employed to mine long-term dependencies among the multiple features. Combined with a feedforward neural network and a dynamic slicing optimization strategy, and enhanced by residual connections and layer normalization, a time-prospective Transformer model was constructed. This model ultimately achieved the dual functions of fault classification and prediction. The experimental results demonstrated that the proposed method achieved an accuracy of 93.233% in the classification and prediction of jamming and empty drilling faults of the rock drill, significantly outperforming comparative models such as CNN (convolutional neural network), LSTM (long short-term memory), CNN-LSTM, RNN (recurrent neural network), and iTransformer. Visualization results of features using t-SNE (t-distribution stochastic neighbour embedding) revealed superior intra-class clustering and inter-class separation characteristics for the proposed model. Furthermore, it exhibited the lowest training loss and an inference time of merely 0.014 6 s, meeting the real-time warning requirements. The research results provide a reliable technical approach for classifying and predicting the faults of rock drills under complex geological conditions.



Key wordsmulti-feature time-series labeling      fault prediction      high-frequency while-drilling parameters of rock drill      Transformer model     
Received: 22 September 2025      Published: 28 April 2026
CLC:  TP 18  
Cite this article:

Nianwen QIN. Fault classification and prediction of rock drill based on multi-feature time-series labeling Transformer. Chinese Journal of Engineering Design, 2026, 33(2): 159-168.

URL:

https://www.zjujournals.com/gcsjxb/10.3785/j.issn.1006-754X.2026.05.201     OR     https://www.zjujournals.com/gcsjxb/Y2026/V33/I2/159


基于多特征时序标记Transformer的凿岩机故障分类与预测

为了突破钻爆法隧道施工中凿岩机卡钻与空打故障预测的技术瓶颈,提出了一种基于多特征时序标记Transformer的故障分类与预测方法。通过采集多工况下凿岩机关键高频随钻参数,结合参数在故障状态下的阈值,构建了带标签的卡钻与空打数据集;设计了多特征时序标记策略,将原始数据转换为具有时序关系的嵌入向量序列;在此基础上,采用多头自注意力机制挖掘多特征间的长时依赖关系,并通过前馈神经网络与动态切片优化策略,以及引入残差连接与层归一化,构建了具有时间前瞻性的Transformer模型,最终实现了故障分类与预测双重功能。实验结果表明:所提出的方法对凿岩机卡钻与空打故障分类与预测的准确率达93.233%,显著优于CNN (convolutional neural net, 卷积神经网络)、LSTM(long short-term memory, 长短期记忆网络)、CNN-LSTM、RNN(recurrent neural network, 循环神经网络)及iTransformer等对比模型;t-SNE(t-distribution stochastic neighbour embedding,t分布随机近邻嵌入)特征可视化结果表明其具有更优的类内聚集与类间分离特性;模型训练损失最小,收敛速度最快,推理时间仅为0.014 6 s,能满足实时预警需求。研究结果为实现复杂地质条件下凿岩机故障的分类与预测提供了可靠的技术手段。


关键词: 多特征时序标记,  故障预测,  凿岩机高频随钻参数,  Transformer模型 
Fig.1 Framework for fault classification and prediction based on multi-feature time-series labeling Transformer
Fig.2 Process of fault classification and prediction of rock drill based on multi-feature time-series labeling Transformer
参数单位
冲击压力MPa
推进压力MPa
回转压力MPa
推进速度m/min
水流量L/min
Table 1 Key while-drilling parameters of rock drill
Fig.3 Division of fault precursor data
Fig.4 While-drilling parameters of rock drill in Chada Tunnel
参数数值
多头注意力模块:注意力头数4
多头注意力模块:隐层神经元数128
多头注意力模块:Dropout率0.2
多特征时序标记:batch_size32
多特征时序标记:时间片段长度4.5
多特征时序标记:子序列个数5
多特征时序标记:num_features15
多特征时序标记:d_model64
前向神经网络:隐层神经元数32
学习率0.001
优化器Adam
Table 2 Parameter settings for multi-feature time-series labeling Transformer model
模型A/%R/%
CNN87.65386.927
LSTM88.71788.036
CNN-LSTM89.23688.592
RNN88.60187.814
iTransformer90.12589.471
多特征时序标记Transformer93.23392.133
Table 3 Comparison of performance indicators of each model
Fig.5 Result of t-SNE visualization from different models
Fig.6 Model training loss values
模型参数量/个推理时间/s
CNN32 8690.004 2
LSTM53 8290.064 0
CNN-LSTM74 1490.088 0
RNN41 5860.016 2
iTransformer103 4290.030 4
多特征时序标记Transformer69 8930.014 6
Table 4 Comparison of parameter quantity and inference time of models
 
 
[[1]]   陈晓, 张奇志, 王鑫, 等. 基于ISSA-SVM的钻井卡钻事故预测[J]. 科学技术与工程, 2024, 24(8): 3207-3214.
CHEN X, ZHANG Q Z, WANG X, et al. Prediction of drilling jam accidents based on ISSA-SVM[J]. Science Technology and Engineering, 2024, 24(8): 3207-3214.
[[2]]   刘子豪, 宋先知, 朱硕, 等. 基于VC-SVM与粒子群算法的卡钻智能预测方法[J]. 石油机械, 2024, 52(10): 1-11.
LIU Z H, SONG X Z, ZHU S, et al. Intelligent prediction method of pipe sticking based on VC-SVM and particle swarm optimization[J]. China Petroleum Machinery, 2024, 52(10): 1-11.
[[3]]   张涛, 夏鹏, 李军, 等. 基于井下参数的SCNGO-SVM卡钻预警方法研究[J]. 石油机械, 2025, 53(1): 20-27, 36.
ZHANG T, XIA P, LI J, et al. Research on SCNGO-SVM sticking warning method based on downhole parameters[J]. China Petroleum Machinery, 2025, 53(1): 20-27, 36.
[[4]]   苏晓眉, 张涛, 李玉飞, 等. 基于K-Means聚类算法的沉砂卡钻预测方法研究[J]. 钻采工艺, 2021, 44(3): 5-9.
SU X M, ZHANG T, LI Y F, et al. Research on the sticking prediction method based on K-Means clustering algorithm[J]. Drilling & Production Technology, 2021, 44(3): 5-9.
[[5]]   耿晓光, 马飞, 李叶林, 等. 液压凿岩机防空打装置的特性分析与优化设计[J]. 制造业自动化, 2014, 36(16): 150-153.
GENG X G, MA F, LI Y L, et al. Characteristic analysis and optimization design of anti-empty impact equipment for hydraulic rock drill[J]. Manufacturing Automation, 2014, 36(16): 150-153.
[[6]]   田文元, 姚鹏, 朱春霞, 等. 液压凿岩机活塞防空打装置的设计研究[J]. 工程机械, 2007, 38(1): 48-50, 98.
TIAN W Y, YAO P, ZHU C X, et al. Design and research on a device preventing piston from idle impact for hydraulic rock drill[J]. Construction Machinery and Equipment, 2007, 38(1): 48-50, 98.
[[7]]   LIU X J, JIN Y W, YAO S, et al. Hydraulic fault prediction of integrated transmission system based on LSTM[J]. Journal of Physics: Conference Series, 2024, 2724(1): 012016.
[[8]]   LU J Z, TAN L J, JIANG H Y. Review on convolutional neural network (CNN) applied to plant leaf disease classification[J]. Agriculture, 2021, 11(8): 707.
[[9]]   ROSTAMIAN A, O’HARA J G. Event prediction within directional change framework using a CNN-LSTM model[J]. Neural Computing and Applications, 2022, 34(20): 17193-17205.
[[10]]   FANG B L, XU L, LUO Y J, et al. A method for short-term electric load forecasting based on the FMLP-iTransformer model[J]. Energy Reports, 2024, 12: 3405-3411.
[[11]]   LI K W, YU X Y, OU S F, et al. Fault location in distribution network based on RNN and transfer learning[J]. International Journal of High Speed Electronics and Systems, 2025, 34(2): 2440043.
[[12]]   SHEN H Y, LIU Y F, ZHAO Q Y, et al. Optimized GRU-based voltage fault prediction method for lithiumion battery packs in real-life[J]. Quality and Reliability Engineering International, 2025, 41(3): 1108-1122.
[[13]]   LIN H, LIU G N, WU J J, et al. Deterring the gray market: product diversion detection via learning disentangled representations of multivariate time series[J]. INFORMS Journal on Computing, 2023, 36(2): 571-586.
[[14]]   孙子健, 汤健, 乔俊飞. 面向工业过程难测参数建模的双窗口概念漂移检测[J]. 控制理论与应用, 2021, 38(12): 1979-1992.
SUN Z J, TANG J, QIAO J F. Double window concept drift detection method for modeling of difficult-to-measure parameter in industrial processes[J]. Control Theory & Applications, 2021, 38(12): 1979-1992.
[[15]]   傅世元, 高欣, 张浩, 等. 基于元学习动态选择集成的电力调度数据异常检测方法[J]. 电网技术, 2022, 46(8): 3248-3256.
FU S Y, GAO X, ZHANG H, et al. Anomaly detection for power dispatching data based on meta-learning dynamic ensemble selection[J]. Power System Technology, 2022, 46(8): 3248-3256.
[[16]]   刘庭亭, 何志琴. 基于IZOA结合最小交叉熵的图像分割算法[J]. 电子测量技术, 2025, 48(16): 40-53.
LIU T T, HE Z Q. Based on IZOA combined with minimum cross-entropy image segmentation algorithm[J]. Electronic Measurement Technology, 2025, 48(16): 40-53.
[[17]]   王金金. 基于改进Transformer和跨模态自监督学习的轴承故障诊断方法研究[D]. 开封: 河南大学, 2024.
WANG J J. Research on bearing fault diagnosis method based on improved transformer and cross-modal self-supervised learning[D]. Kaifeng: Henan University, 2024.
[[18]]   卓仁杰. 针对数据分布差异的图像处理方法研究及应用[D]. 成都: 电子科技大学, 2025.
ZHUO R J. Research and application of image processing method aiming at data distribution difference[D]. Chengdu: University of Electronic Science and Technology of China, 2025.
[[19]]   杜义康. 基于集成学习技术的隧道围岩智能分级方法研究[J]. 四川建筑, 2021, 41(4): 88-91, 94.
DU Y K. Research on intelligent classification method of tunnel surrounding rock based on integrated learning technology[J]. Sichuan Architecture, 2021, 41(4): 88-91, 94.
[[20]]   张朝晖. 基于Transformer与元学习的小样本滚动轴承故障诊断研究[D]. 秦皇岛: 燕山大学, 2024.
ZHANG Z H. Research on few-shot rolling bearing fault diagnosis based on transformer and meta-learning[D]. Qinhuangdao: Yanshan University, 2024.
[1] Kaisong WANG,Yiming WEI,Wei TANG,Xuhua GUO,Zhaoyang LI,Jun ZOU. Fault prediction method of pipeline blockage in wet spray trolley pumping system based on CNN-LSTM-Attention model[J]. Chinese Journal of Engineering Design, 2025, 32(6): 759-768.