Please wait a minute...
Chinese Journal of Engineering Design  2021, Vol. 28 Issue (3): 296-304    DOI: 10.3785/j.issn.1006-754X.2021.00.031
Design Theory and Method     
Prediction of natural gesture interaction time for VR placement task
YAN Bao-ming, PAN Wei-jie, Lü Jian, WANG Yi, ZHAO Ze-yu
Key Laboratory of Advanced Manufacturing Technology of the Ministry of Education, Guizhou University, Guiyang 550025, China
Download: HTML     PDF(1642KB)
Export: BibTeX | EndNote (RIS)      

Abstract  In order to accurately simulate the placement task of users in VR (virtual reality) environment and avoid the low placement accuracy caused by the shaking of interaction devices, the interaction was carried out by using natural gestures. A prediction method of natural gesture interaction time for VR placement task based on improved Fitts Law was proposed. Firstly, the interaction logic of "gesture interaction-VR environment-VR interaction task" was constructed to establish the semantic mapping relationship between natural gesture and interaction task; secondly, according to the design principle of natural gesture, the natural gesture interaction experiment for VR placement task was carried out; then, combined with the characteristics of VR placement task, the moving distance, target tolerance and the size of the moving object were integrated into the classical Fitts Law, and the prediction model of natural gesture interaction time based on improved Fitts Law was established; finally, the regression analysis of the experimental data was carried out. It was found that the correlation coefficient R2=0.515 by fitting based on the classical Fitts Law, and there was a large deviation between the predicted value and the real value of interaction time, which indicated that the classical Fitts Law was not suitable to predict the natural gesture interaction time for VR placement task; the correlation coefficient R2=0.970 based on improved Fitts Law, and the predicted value of interaction time was consistent with the real value, which showed that improved Fitts Law had good applicability and could accurately predict the natural gesture interaction time for VR placement task. The research results enrich the VR interaction mode, and can provide guidance for the design of human-computer interaction interface in VR environment.

Received: 28 June 2020      Published: 28 June 2021
CLC:  TP 391  
Cite this article:

YAN Bao-ming, PAN Wei-jie, Lü Jian, WANG Yi, ZHAO Ze-yu. Prediction of natural gesture interaction time for VR placement task. Chinese Journal of Engineering Design, 2021, 28(3): 296-304.

URL:

https://www.zjujournals.com/gcsjxb/10.3785/j.issn.1006-754X.2021.00.031     OR     https://www.zjujournals.com/gcsjxb/Y2021/V28/I3/296


面向VR放置任务的自然手势交互时间的预测

为了在虚拟现实(virtual reality,VR)环境中准确模拟用户的放置任务和避免由交互设备抖动等因素导致的放置精度低的问题,利用自然手势进行交互,并提出一种基于改进Fitts定律的面向VR放置任务的自然手势交互时间的预测方法。首先,构建了“手势交互—VR环境—VR交互任务”的交互逻辑,建立了自然手势与交互任务之间的语义映射关系;其次,根据自然手势设计原则,进行了面向VR放置任务的自然手势交互实验;然后,结合VR放置任务的特点,将移动距离、目标物容差和移动物体大小融入经典Fitts定律,建立了基于改进Fitts定律的自然手势交互时间预测模型;最后,对实验数据进行回归分析。回归分析结果显示:基于经典Fitts定律拟合得到的相关系数R2=0.515,交互时间的预测值与真实值存在较大偏差,表明经典Fitts定律不适用于面向VR放置任务的自然手势交互时间的预测;基于改进Fitts定律拟合得到的相关系数R2=0.970,交互时间的预测值与真实值相吻合,表明改进Fitts定律具有良好的适用性,可准确预测面向VR放置任务的自然手势交互时间。研究结果丰富了VR交互方式,并可为VR环境中人机交互界面的设计提供指导。
[1] LAI Quan-bao, TAO Qing, HU Yu-ge, MENG Qing-feng. Multi-gesture accurate recognition based on artificial fish swarm algorithm-extreme learning machine[J]. Chinese Journal of Engineering Design, 2021, 28(6): 671-678.
[2] NI Zi-jian, LI Wen-qiang, TANG Zhong. Ontology semantic mining and functional semantic retrieval method based on network representation learning[J]. Chinese Journal of Engineering Design, 2021, 28(5): 539-547.
[3] WANG Hong-shen, LIU Min, QIANG Hui-ying. Three-dimensional model classification and retrieval algorithm based on polar radius surface moment and HMM[J]. Chinese Journal of Engineering Design, 2021, 28(4): 407-414.
[4] WANG Chun-xiang, JI Kang-hui, WANG Yao, LIU Liu. Review of research on segmentation algorithm in rapid prototyping technology[J]. Chinese Journal of Engineering Design, 2021, 28(4): 399-406.
[5] XU Yong-ming, TANG Yi-fan, ZHANG Sheng, SHI Jian-xun, YU Yun-zhong, ZHANG Zheng. Simulation and experimental research on automatic straightening of power cable[J]. Chinese Journal of Engineering Design, 2021, 28(3): 329-334.
[6] WANG Chun-xiang, HAO Lin-wen, WANG Yao, ZHOU Guo-yong, JI Kang-hui, LIU Liu. Automatic repair of scattered point cloud hole based on GA-BP neural network[J]. Chinese Journal of Engineering Design, 2021, 28(2): 155-162.
[7] ZHANG Shi-miao, SHAO Hong-yu, CHEN Chen, CHEN Yong-liang. Service matching method for surplus sheet material resource in cloud manufacturing environment[J]. Chinese Journal of Engineering Design, 2021, 28(2): 121-131.
[8] CHEN Yang, REN Cheng-zu, DENG Xiao-fan, CHEN Guang, JIN Xin-min. Research on rotating motion of cylindrical roller based on double-disc straight groove grinding[J]. Chinese Journal of Engineering Design, 2021, 28(2): 179-189.
[9] YAO Shou-wen, HU Zi-ran, LIU Bo-wen, DING Jia, CHANG Fu-xiang, LI Li-hui. Virtual reality aided maintenance training based on real-time assembly state perception and intuitive interaction[J]. Chinese Journal of Engineering Design, 2021, 28(1): 14-24.
[10] DENG Xiao-fan, REN Cheng-zu, CHEN Yang, CHEN Guang, CAI Zhi-jie, HE Ying-lun. Research on material selection of lapping tools for double-disc and linear-groove lapping method based on friction and wear experiment[J]. Chinese Journal of Engineering Design, 2020, 27(6): 720-728.
[11] WANG Wei, ZHANG Kai-yan, LIU Ya-chuan, HUANG Yu-chun. Research on two-step alignment method for 3-D point cloud and its application[J]. Chinese Journal of Engineering Design, 2020, 27(5): 560-567.
[12] LI Meng. Design of online lane line recognition system based on machine vision[J]. Chinese Journal of Engineering Design, 2020, 27(4): 498-507.
[13] LI Dian-lun, HUANG Hua, DENG Wen-qiang. Optimization design of structure of the hydrostatic guideway of NC machine tool[J]. Chinese Journal of Engineering Design, 2020, 27(4): 448-455.
[14] ZHANG Fan, CHU Shao-wei, JI Na-ye. Chinese Braille encoding design for mobile terminal with variable-friction tactile[J]. Chinese Journal of Engineering Design, 2020, 27(2): 154-161.
[15] SHANG Jun-zhi, YANG Bo, MA Ning, GAO Chang-qing. Analysis of dimension data transfer process in product change design[J]. Chinese Journal of Engineering Design, 2020, 27(1): 1-12.