Please wait a minute...
工程设计学报
Chinese Journal of Engineering Design  2019, Vol. 26 Issue (3): 245-251    DOI: 10.3785/j.issn.1006-754X.2019.03.001
Design Theory and Methodology     
Design and implementation of monitoring method for CNC machine tool operating data based on Storm flow processing
SUN Shun-miao1, HE Yan1, WU Peng-cheng1, WANG Le-xiang1, LING Jun-jie1, LI Jun2
1.College of Mechanical Engineering, Chongqing University, Chongqing 400044, China
2.Shaanxi Hanjiang Machine Tool Co., Ltd., Hanzhong 723003, China
Download: HTML     PDF(855KB)
Export: BibTeX | EndNote (RIS)      

Abstract  

Aiming at the problem that the operating data of CNC (computer numerical control）machine tool are too heterogeneous to be processed in real time, a monitoring method for CNC machine tool operating data based on Storm flow processing technology is proposed. The method used big-data real-time computing framework Storm as the core, and obtained operating data of CNC machine tool through external sensors and communication protocol based on CNC system. Kafka was used as a message queue to upload operating data to Storm, and then real-time analysis services such as data statistics, data anomaly detection and so on were carried out in Storm framework. The analysis results were stored in the database, and the visual display of the analysis results was realized. The monitoring method based on Storm flow processing was tested in the actual production environment. The experiment results showed that the method could realize real-time monitoring and processing of CNC machine tool operating data, and had the advantages of strong real-time computing ability and high scalability. The advantages of this method were more significant when dealing with relatively complex CNC machine tool operating data monitoring services. The research provides a new idea for the monitoring of CNC machine tool operating data， and the monitoring method has a wide application prospect in engineering.

Key words： CNC (computer numerical control） machine tool      flow processing      big data     
Received: 21 December 2018      Published: 28 June 2019
CLC:  TG 659  
Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors
SUN Shun-miao
HE Yan
WU Peng-cheng
WANG Le-xiang
LING Jun-jie
LI Jun
Cite this article:

SUN Shun-miao, HE Yan, WU Peng-cheng, WANG Le-xiang, LING Jun-jie, LI Jun. Design and implementation of monitoring method for CNC machine tool operating data based on Storm flow processing. Chinese Journal of Engineering Design, 2019, 26(3): 245-251.

URL:

https://www.zjujournals.com/gcsjxb/10.3785/j.issn.1006-754X.2019.03.001     OR     https://www.zjujournals.com/gcsjxb/Y2019/V26/I3/245


基于Storm流处理的数控机床运行数据监测方法的设计与实现

针对目前数控机床运行数据种类多、数量大且难以实现实时处理的问题，提出一种基于Storm流处理技术的数控机床运行数据监测方法。该方法采用实时大数据计算框架Storm作为核心，通过外置传感器和数控系统通信协议获取数控机床运行数据。使用Kafka作为消息队列将机床运行数据上传给Storm，然后在Storm框架中进行数据统计、数据异常检测等实时分析业务，之后将分析结果存储于数据库中，并实现分析结果的可视化展示。在实际生产环境中对基于Storm流处理的监测方法进行测试，实验结果表明：该方法能够实现对数控机床运行数据的实时监测与处理，具有强实时计算能力、高扩展性的优点;并且在处理相对复杂的数控机床运行数据监测业务时，该方法的优势更显著。研究结果为数控机床运行数据监测提供了新思路，该监测方法具有广阔的工程应用前景。


关键词： 数控机床,  流处理,  大数据 

1 NAIMIA I, WESTREICHD J. Big data: a revolution that will transform how we live, work and think[J]. Mathematics & Computer Education, 2014, 47(17): 181-183.
2 SHVACHKOK, KUANGH, RADIAS, et al. The Hadoop distributed file system[C]//26th IEEE Symposium on Mass Storage Systems and Technologies, Nevada, May3-7, 2010. doi:10.1109/msst.2010.5496972
3 ZHANGJie, GAOLiang, QINWei, et al. Big-data-driven operational analysis and decision-making methodology in intelligent workshop[J]. Computer Integrated Manufacturing Systems, 2016, 22(5): 1220-1228.
4 GUOXing. The development of CNC machine condition intelligent monitoring system[D]. Jinan: Shandong University, School of Mechanical Engineering, 2016: 9-11.
5 PENGBo. Research on energy consumption analysis platform based on the internet of things and big data[D]. Beijing: Beijing Jiaotong University, School of Electronic Information Engineering, 2017: 45-46.
6 ZHUANGXue-yin, ZHANGLi, WENGXiao-qi, et al. Real-time stream data processing framework for complex equipment condition monitoring[J]. Computer Integrated Manufacturing Systems, 2013, 19(12): 2929-2939.
7 LEIYa-guo, JIAFeng, KONGDe-tong, et al. Opportunities and challenges of machinery intelligent fault diagnosis in big data era[J]. Journal of Mechanical Engineering, 2018, 54(5): 94-104.
8 TOSHNIWALA, TANEJAS, SHUKLAA, et al. Storm @Twitter[C]// Proceedings of the 2014 ACM Sigmod International Conference on Management of Data, New York, Jun. 22-27, 2014.
9 SAMZA. Apache Samza [EB/OL]. (2015-11-15). http://samza.apache.org/.
10 ZAHARIAM, DAS T, LIH, et al. Discretized streams: an efficient and fault-tolerant model for stream processing on large clusters[C]// Proceedings of the 4th USENIX Conference on Hot Topics in Cloud Computing, Boston, Jun. 12-13, 2012.
11 CARBONEP, KATSIFODIMOSA, EWENS, et al. Apache flinkTM：stream and batch processing in a single engine[J]. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering, 2015, 36(4): 28-38.
12 ZHANGY, RENS, LIUY, et al. A big data analytics architecture for cleaner manufacturing and maintenance processes of complex products[J]. Journal of Cleaner Production, 2017, 142（Part 2）: 626-641. doi:10.1016/j.jclepro.2016.07.123
13 RANJANR. Streaming big data processing in datacenter clouds[J]. IEEE Cloud Computing, 2014, 1(1): 78-83.doi:10.1109/mcc.2014.22
14 SUNDa-wei, ZHANGGuang-yan, ZHENGWei-min. Big data stream computing: technologies and instances[J]. Journal of Software, 2014, 25(4): 839-862.
15 LEIBIUSKYJ, EISBRUCHG, SIMONASSID. Getting started with storm[M]. Sebastopol: O'Reilly Media, Inc, 2012: 5-9.
16 CHINTAPALLIS, DAGITD, EVANSB, et al. Benchmarking streaming computation engines: Storm, flink and spark streaming[C]//2016 IEEE International, Chicago, May23-27, 2016. doi:10.1109/ipdpsw.2016.138
17 NEUMEYERL, ROBBINSB, NAIRA, et al. S4: distributed stream computing platform[C]// 2010 IEEE International Conference on Data Mining Workshops, Sydney, Dec. 13, 2010. doi:10.1109/icdmw.2010.172
18 WANGDe-wen, YANGLi-ping. Stream processing method and condition monitoring anomaly detection for big data in smart grid[J]. Automation of Electric Power Systems, 2016, 40(14):122-128.
[1] SI Guang-yao, WANG Kai, LI Wen-qiang, LI Yan, MOU Liang. Research on product demand analysis method based on Big Data and rough set[J]. Chinese Journal of Engineering Design, 2016, 23(6): 521-529.