Please wait a minute...
工程设计学报
工程设计学报  2019, Vol. 26 Issue (3): 245-251    DOI: 10.3785/j.issn.1006-754X.2019.03.001
设计理论与方法学     
基于Storm流处理的数控机床运行数据监测方法的设计与实现
孙顺苗1, 何彦1, 吴鹏程1, 王乐祥1, 凌俊杰1, 李军2
1.重庆大学 机械工程学院， 重庆 400044
2.陕西汉江机床有限公司， 陕西 汉中 723003
Design and implementation of monitoring method for CNC machine tool operating data based on Storm flow processing
SUN Shun-miao1, HE Yan1, WU Peng-cheng1, WANG Le-xiang1, LING Jun-jie1, LI Jun2
1.College of Mechanical Engineering, Chongqing University, Chongqing 400044, China
2.Shaanxi Hanjiang Machine Tool Co., Ltd., Hanzhong 723003, China
 全文: PDF(855 KB)   HTML
摘要：

针对目前数控机床运行数据种类多、数量大且难以实现实时处理的问题，提出一种基于Storm流处理技术的数控机床运行数据监测方法。该方法采用实时大数据计算框架Storm作为核心，通过外置传感器和数控系统通信协议获取数控机床运行数据。使用Kafka作为消息队列将机床运行数据上传给Storm，然后在Storm框架中进行数据统计、数据异常检测等实时分析业务，之后将分析结果存储于数据库中，并实现分析结果的可视化展示。在实际生产环境中对基于Storm流处理的监测方法进行测试，实验结果表明：该方法能够实现对数控机床运行数据的实时监测与处理，具有强实时计算能力、高扩展性的优点;并且在处理相对复杂的数控机床运行数据监测业务时，该方法的优势更显著。研究结果为数控机床运行数据监测提供了新思路，该监测方法具有广阔的工程应用前景。
关键词： 数控机床;  流处理;  大数据    
Abstract:

Aiming at the problem that the operating data of CNC (computer numerical control）machine tool are too heterogeneous to be processed in real time, a monitoring method for CNC machine tool operating data based on Storm flow processing technology is proposed. The method used big-data real-time computing framework Storm as the core, and obtained operating data of CNC machine tool through external sensors and communication protocol based on CNC system. Kafka was used as a message queue to upload operating data to Storm, and then real-time analysis services such as data statistics, data anomaly detection and so on were carried out in Storm framework. The analysis results were stored in the database, and the visual display of the analysis results was realized. The monitoring method based on Storm flow processing was tested in the actual production environment. The experiment results showed that the method could realize real-time monitoring and processing of CNC machine tool operating data, and had the advantages of strong real-time computing ability and high scalability. The advantages of this method were more significant when dealing with relatively complex CNC machine tool operating data monitoring services. The research provides a new idea for the monitoring of CNC machine tool operating data， and the monitoring method has a wide application prospect in engineering.
Key words: CNC (computer numerical control） machine tool    flow processing    big data
收稿日期: 2018-12-21 出版日期: 2019-06-28
CLC:  TG 659  
基金资助:

国家科技重大专项资金资助项目(2017ZX04019001)
通讯作者: 何彦（1981—），女，重庆人，教授，博士生导师，博士，从事装备智能化、绿色设计与制造等研究，E-mail: heyan811@163.com，http://orcid.org/ 0000-0002-6287-1130     E-mail: heyan811@163.com
作者简介: 孙顺苗(1995—)，男，湖南邵阳人，硕士生，从事智能制造研究，E-mail:smsun@cqu.edu.cn，https://orcid.org/0000-0002-5010-6327
服务　　
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章　　
孙顺苗
何彦
吴鹏程
王乐祥
凌俊杰
李军

引用本文:

孙顺苗, 何彦, 吴鹏程, 王乐祥, 凌俊杰, 李军. 基于Storm流处理的数控机床运行数据监测方法的设计与实现[J]. 工程设计学报, 2019, 26(3): 245-251.

SUN Shun-miao, HE Yan, WU Peng-cheng, WANG Le-xiang, LING Jun-jie, LI Jun. Design and implementation of monitoring method for CNC machine tool operating data based on Storm flow processing. Chinese Journal of Engineering Design, 2019, 26(3): 245-251.

链接本文:

https://www.zjujournals.com/gcsjxb/CN/10.3785/j.issn.1006-754X.2019.03.001    或    https://www.zjujournals.com/gcsjxb/CN/Y2019/V26/I3/245

1 NAIMIA I, WESTREICHD J. Big data: a revolution that will transform how we live, work and think[J]. Mathematics & Computer Education, 2014, 47(17): 181-183.
2 SHVACHKOK, KUANGH, RADIAS, et al. The Hadoop distributed file system[C]//26th IEEE Symposium on Mass Storage Systems and Technologies, Nevada, May3-7, 2010. doi:10.1109/msst.2010.5496972
3 ZHANGJie, GAOLiang, QINWei, et al. Big-data-driven operational analysis and decision-making methodology in intelligent workshop[J]. Computer Integrated Manufacturing Systems, 2016, 22(5): 1220-1228.
4 GUOXing. The development of CNC machine condition intelligent monitoring system[D]. Jinan: Shandong University, School of Mechanical Engineering, 2016: 9-11.
5 PENGBo. Research on energy consumption analysis platform based on the internet of things and big data[D]. Beijing: Beijing Jiaotong University, School of Electronic Information Engineering, 2017: 45-46.
6 ZHUANGXue-yin, ZHANGLi, WENGXiao-qi, et al. Real-time stream data processing framework for complex equipment condition monitoring[J]. Computer Integrated Manufacturing Systems, 2013, 19(12): 2929-2939.
7 LEIYa-guo, JIAFeng, KONGDe-tong, et al. Opportunities and challenges of machinery intelligent fault diagnosis in big data era[J]. Journal of Mechanical Engineering, 2018, 54(5): 94-104.
8 TOSHNIWALA, TANEJAS, SHUKLAA, et al. Storm @Twitter[C]// Proceedings of the 2014 ACM Sigmod International Conference on Management of Data, New York, Jun. 22-27, 2014.
9 SAMZA. Apache Samza [EB/OL]. (2015-11-15). http://samza.apache.org/.
10 ZAHARIAM, DAS T, LIH, et al. Discretized streams: an efficient and fault-tolerant model for stream processing on large clusters[C]// Proceedings of the 4th USENIX Conference on Hot Topics in Cloud Computing, Boston, Jun. 12-13, 2012.
11 CARBONEP, KATSIFODIMOSA, EWENS, et al. Apache flinkTM：stream and batch processing in a single engine[J]. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering, 2015, 36(4): 28-38.
12 ZHANGY, RENS, LIUY, et al. A big data analytics architecture for cleaner manufacturing and maintenance processes of complex products[J]. Journal of Cleaner Production, 2017, 142（Part 2）: 626-641. doi:10.1016/j.jclepro.2016.07.123
13 RANJANR. Streaming big data processing in datacenter clouds[J]. IEEE Cloud Computing, 2014, 1(1): 78-83.doi:10.1109/mcc.2014.22
14 SUNDa-wei, ZHANGGuang-yan, ZHENGWei-min. Big data stream computing: technologies and instances[J]. Journal of Software, 2014, 25(4): 839-862.
15 LEIBIUSKYJ, EISBRUCHG, SIMONASSID. Getting started with storm[M]. Sebastopol: O'Reilly Media, Inc, 2012: 5-9.
16 CHINTAPALLIS, DAGITD, EVANSB, et al. Benchmarking streaming computation engines: Storm, flink and spark streaming[C]//2016 IEEE International, Chicago, May23-27, 2016. doi:10.1109/ipdpsw.2016.138
17 NEUMEYERL, ROBBINSB, NAIRA, et al. S4: distributed stream computing platform[C]// 2010 IEEE International Conference on Data Mining Workshops, Sydney, Dec. 13, 2010. doi:10.1109/icdmw.2010.172
18 WANGDe-wen, YANGLi-ping. Stream processing method and condition monitoring anomaly detection for big data in smart grid[J]. Automation of Electric Power Systems, 2016, 40(14):122-128.
[1] 姜晓飞, 张冠伟, 胡永秀, 张大卫. 数控机床整机动态特性评价方法[J]. 工程设计学报, 2020, 27(2): 135-145.
[2] 司光耀, 王凯, 李文强, 李彦, 牟亮. 基于大数据和粗糙集的产品需求分析方法研究[J]. 工程设计学报, 2016, 23(6): 521-529.
[3] 杨晓京,傅中裕. UG集成环境下数控机床虚拟样机的实现[J]. 工程设计学报, 2007, 14(3): 204-209.
[4] 李兴兰, 张友根, 陶以政, 潘振显. 基于RS一485／422网络的Windows98／95环境下远程数据传输系统[J]. 工程设计学报, 2001, 8(1): 48-52.