Please wait a minute...
工程设计学报
Chinese Journal of Engineering Design  2021, Vol. 28 Issue (1): 14-24    DOI: 10.3785/j.issn.1006-754X.2021.00.003
Innovative Design     
Virtual reality aided maintenance training based on real-time assembly state perception and intuitive interaction
YAO Shou-wen1, HU Zi-ran1, LIU Bo-wen2, DING Jia1, CHANG Fu-xiang1, LI Li-hui1
1.School of Mechanical Engineering， Beijing Institute of Technology， Beijing 100081， China
2.Hebei Yiling Machinery Manufacturing General Factory， Shijiazhuang 050305， China
Download: HTML     PDF(4402KB)
Export: BibTeX | EndNote (RIS)      

Abstract  In order to improve positioning accuracy of parts in virtual maintenance training, enrich human-computer interaction functions, reflect the closer to actual operation processes, and improve training quality of operator, the assembly constraint perception and establishment algorithm was analyzed based on virtual reality aided technology. The correct assembly constraint could be established in real time according to the current assembly state. Based on intuitive interactions, the multi-mode guidance method of “tutor & teaching assistant” was established. The unmarked interaction operation modes of virtual hand and virtual tools were developed in Unity3D environment. The virtual environment stereoscopic visualization was realized by HMD （head-mounted display）. A virtual maintenance training system was developed and its test was performed taking a washing machine as the object. The results showed that this system could make the positioning of assembly relation of parts more accurate, simulate more realistic disassembly processes and help operator complete tasks better through intuitive interaction, which can eliminate shortage of actual training and greatly improve the maintenance training cost-effectiveness ratio.

Received: 11 June 2019      Published: 25 February 2021
CLC:  TH 17  
  TP 391.1  
Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors
Cite this article:

YAO Shou-wen, HU Zi-ran, LIU Bo-wen, DING Jia, CHANG Fu-xiang, LI Li-hui. Virtual reality aided maintenance training based on real-time assembly state perception and intuitive interaction. Chinese Journal of Engineering Design, 2021, 28(1): 14-24.

URL:

https://www.zjujournals.com/gcsjxb/10.3785/j.issn.1006-754X.2021.00.003     OR     https://www.zjujournals.com/gcsjxb/Y2021/V28/I1/14


基于实时装配状态感知和直观性交互的虚拟现实辅助维修训练

为了提高虚拟维修训练时零件的定位精度，丰富人机交互功能，反映贴近实际的操作过程，提高操作者的训练质量，基于虚拟现实辅助技术，研究了装配约束感知与建立算法，可实现根据当前的装配状态实时建立正确的装配约束。基于直观性交互建立了“导师&助教”多模式指导方法。在Unity3D环境中开发了虚拟手、虚拟工具的无标记交互操作方式，并通过HMD（head-mounted display， 头盔显示器）实现虚拟环境的立体可视化。开发了虚拟维修训练系统，并以某型号洗衣机为对象进行了测试。结果表明，该系统不仅可使零件的装配关系定位更加精确，模拟出更真实的拆装过程，还可以通过直观性交互帮助操作者更好地完成任务，消除了实装训练的不足，大大提升了维修训练的效费比。
[1] Yan-kun QI,Hong WANG,Yong HE,Lü XIONG. Research on multi-component dual-objective group maintenance for electric multiple unit considering maintenance site[J]. Chinese Journal of Engineering Design, 2022, 29(2): 168-175.
[2] LIU Yong-jiang, PENG Xuan-lin, TANG Xiong-hui, LI Hua, QI Zi-mei. Resonance failure analysis and optimal design of axial cooling fan[J]. Chinese Journal of Engineering Design, 2021, 28(2): 203-209.
[3] YANG Yuan, LI Fang, HOU Zhong-Yuan, YANG Lei. The analysis and evaluation for a multi-unit system maintenance correlation[J]. Chinese Journal of Engineering Design, 2011, 18(2): 82-86.