Please wait a minute...
JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE)
Energy and Mechanical Engineering     
PC-based open control platform design of integration of machine vision and motion control
LIU Ya nan, NI He peng, ZHANG Cheng rui WANG Yun fei; SUN Hao chun
1. School of Mechanical Engineering, Shandong University, Jinan 250061, China;
2. Key Laboratory of High Efficiency and Clean Mechanical Manufacturing, Shandong University, Jinan 250061, China                   
Download:   PDF(1274KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

A real-time sub-system taking advantage of Windows real-time extension software KRTS (Kithara real-time suite) was realized on a multi-core CPU computer in order to conveniently integrate motion control with machine vision, simplify motion control system as well as cost less. Real-time tasks ran in real time sub-system and other tasks ran in Windows in parallel. In this way, standard network cards instead of motion control cards and image capture cards were used to transfer data of motion control and images. The solution which integrated motion control with machine vision was proposed and achieved standardization, commonality and network as a motion control platform. The maximum response time of the system was 36.96 μs through test. A vision-guided high speed DELTA sorting system was developed based on the platform.



Published: 23 July 2016
CLC:  TP 242  
Cite this article:

LIU Ya nan, NI He peng, ZHANG Cheng rui WANG Yun fei; SUN Hao chun. PC-based open control platform design of integration of machine vision and motion control. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(7): 1381-1386.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2016.07.022     OR     http://www.zjujournals.com/eng/Y2016/V50/I7/1381


基于PC的运动视觉一体化开放控制平台设计

为了更方便地在运动控制系统中集成机器视觉,简化系统复杂程度,节约控制系统成本,借助Windows操作系统的实时拓展套件KRTS(Kithara real-time suite),在一台多核PC上,建立运行实时任务的实时子系统.该系统能够与运行非实时任务的Windows系统并行运行. 使用通用的以太网卡进行运动控制数据与图像数据的传输,取代了运动控制卡、图像采集卡等专用硬件. 开发了运动控制与机器视觉一体化解决方案,实现了控制平台的标准化、通用性和网络化,系统最大实时响应时间为3696 μs. 基于该平台,开发了视觉引导的DELTA高速分拣系统.

[1]周延佑. 迅速占领市场是机床数控产业的紧迫任务[J]. 中国机械工程, 1998, 9(5): 11-13.
ZHOU Yanyou. To gain rapidly greater market share is the urgent task for national CNC system industry [J]. China Mechanical Engineering, 1998, 9(5): 11-13.
[2]武洪恩. 基于Windows的开放结构控制平台及应用研究[D]. 济南:山东大学, 2007.
WU Hongen. Research on Windowsbased open architecture platform in motion control and its application [D]. Jinan: Shandong University, 2007.
[3] PAN L D, HUANG X H, MOHAMMAD A. A PCbased open architecture controller for robot [J]. Information Technology Journal,2004, 3(3): 296-302.
[4] OLIVERIA A, DE P E, MONERO U. An Openarchitecture robot controller applied to interaction tasks [M]. \[S.l.\]: INTECH Open Access Publisher, 2010: 99-112.
[5] XU X M, LI Y, SUN J H, et al. Research and development of open CNC system based on PC and motion controller [J]. Procedia Engineering, 2012, 29(1): 1845-1850.
[6]张文昌. Delta高速并联机器人视觉控制技术及视觉标定技术研究[D]. 天津:天津大学, 2012.
ZHANG Wenchang. Control technique and kinematic calibration of Delta robot based on computer vision [D]. Tianjin: Tianjin University, 2012.
[7] 郎需林,靳东,张承瑞,等. 基于实时以太网的DELTA并联机械手控制系统设计[J]. 机器人, 2013, 35(5): 576581.
LANG Xulin, JIN Dong, ZHANG Chengrui, et al. Control system design of DELTA parallel manipulator based on realtime Ethernet [J]. Robot, 2013, 35(5): 576-581.
[8] Kithara Software, Kithara realtime suite [EB/OL]. 20160301. http:∥www.kithara.de/.
[9] WU Y W, YANG Y, HUA L L. Research and improvement of Linux realtime performance [M]. Berlin: Springer, 2012: 555-559.
[10] WANG K, ZHANG C R, DING X Z, et al. A new realtime Ethernet for numeric control [C]∥8th World Congress on Intelligent Control and Automation (WCICA). Jinan: IEEE, 2010: 4137-4141.
[11] 张承瑞,王金江. 基于标准以太网的实时同步网络及其工作方法[P].中国, CN2007100133130. 2007-08-15.
ZHANG Chengrui, WANG Jinjiang. Realtime synchronous network and its working method based on standard network [P]. China, CN2007100133130. 2007-08-15.
[12] LI R F, LIN S Y, CHEN J. Embedded motion controller design based on RTEX network [C]∥5th International Conference on Intelligent HumanMachine System and Cybernetics (IHMSC). Hangzhou: IEEE, 2013: 326-329.
[13] ROBBINS R. Machine visions GigE vision standard [J]. Control Engineering, 2009, 6(56): 56.
[14] SHIMON Y, CARLOS E P, PETER N. Industrial communication protocols [M]. Berlin:Springer, 2009: 981-999.
[15] 王云飞,郎需林,张承瑞,等. 高速并联机械手最优加减速控制算法研究[J]. 机械设计与制造, 2014(11): 85-88.
WANG Yunfei, LANG Xulin, ZHANG Chengrui, et al. The optimal accelerationdeceleration control research of highspeed parallel manipulator [J]. Machinery Design and Manufacture, 2014(11): 85-88.
[16] 姬帅. 网络化运动控制系统的关键技术研究[D]. 济南:山东大学, 2014.
JI Shuai. Research on the key technologies of networked motion control system [D]. Jinan: Shandong University, 2014.
[17] MVTec Software GmbH, building visions for business [EB/OL]. 20160301.http:∥www.halcon.com/.
[18] SHI B P, KIM H S, SONG C Y, et al. Dynamics modeling of a deltatype parallel robot [C]∥ 44th International Symposium on Robotics (ISR). Seoul: IEEE, 2013: 15.
[19] WANG K, ZHANG C R, XU X, et al. A CNC system based on realtime Ethernet and Windows NT [J]. International Journal of Advanced Manufacturing Technology, 2013, 65(9/12): 1383-1395.
[20] BECKHOFF. New automation technology[EB/OL]. 20160301. http: ∥www. beckhoff.com. en/english/.

[1] GAO De-dong, LI Qiang, LEI Yong, XU Fei, BAI Hui-quan. Geometric approximation approach based research on kinematics of bevel-tip flexible needles[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2017, 51(4): 706-713.
[2] TANG Zhi-dong, YUN Chao. Quick action coupling technology in full-automatic quick coupling device: a review[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2017, 51(3): 461-470.
[3] ZHANG Yong tao, SONG Zhi wei, WANG Yi, NIAN Shan po. Robot position and rotation calibration method based on precision of spatial mesh[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(10): 1980-1986.
[4] XU Xian jin, WU Long hui, YANG Xiao jun, TANG Liang, YANG Yong feng. Magnetic driving method of inspection robot for HVDC transmission lines[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(10): 1937-1945.
[5] ZHU Yu shi, YANG Can jun, WU Shi jun, XU Xiao le, ZHOU Pu zhe, SHAN Xin. Steering performance of underwater glider in water column monitoring[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(9): 1637-1645.
[6] JIA Song min, LU Ying bin, WANG Li jia, LI Xiu zhi, XU Tao. Mobile robot human tracking using hierarchical features[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(9): 1677-1683.
[7] DING Xia qing, DU Zhuo yang, LU Yi qing, LIU Shan. Visual trajectory planning for mobile robots based on hybrid artificial potential field[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(7): 1298-1306.
[8] ZHANG A long, ZHANG Ming, QIAO Ming jie, ZHU Wei dong, MEI Biao. Base frame calibration of circumferential splice drilling system based on visual measurement[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(6): 1080-1087.
[9] JIANG Wen ting, GONG Xiao jin, LIU Ji lin. Incremental large scale dense semantic mapping[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(2): 385-391.
[10] HUANG Qi wei, ZHANG Ming, QU Wei wei, LU Xian gang, KE Ying lin. Posture optimization and smoothness for robot drilling[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(12): 2261-2268.
[11] LI Wei, ZHAO Zhi gang, SHI Guang tian, MENG Jia dong. Solutions of kinematics and dynamics for parallel cable driven system with multi robots[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(10): 1916-1923.
[12] MA Zi ang, XIANG Zhi yu. Calibration and 3D reconstruction with omnidirectional ranging by optic flow camera[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(9): 1651-1657.
[13] HE Xue-jun, WANG Jin, LU Guo-dong, CHEN Li.
Optimization of robot image drawing sequence based on ant colony algorithm
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(6): 1139-1145.
[14] YUAN Kang-zheng, ZHU Wei-dong, CHEN Lei, XUE Lei, QI Wen-gang. Approach for calibrating position of displacement sensor mounted on robot end-effector[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(5): 829-834.
[15] DENG Xue-lei, YANG Can-jun, BI Qian, FAN Jin-chang, SHANG Wei-yan. Optimize control strategy for servo-driven leg robots[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(4): 638-643.