Please wait a minute...
浙江大学学报（理学版）
Journal of ZheJIang University(Science Edition)  2016, Vol. 43 Issue (7): 225-232    DOI:
    
Application of gaze tracking in human computer interaction
FENG Cheng-zhi, SHEN Mo-wei
State Key Laboratory of Industrial Psychology, Zhejiang University, Hangzhou 310028, China
Download: HTML ( )    PDF(205KB)
Export: BibTeX | EndNote (RIS)      

Abstract  

Key words： human computer interaction      multimodal user interface      gaze tracking      hidden markov model      neural network     
Received: 26 February 2001      Published: 01 July 2016
CLC:  TB18  
  B849  
Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors
FENG Cheng-zhi
SHEN Mo-wei
Cite this article:

FENG Cheng-zhi, SHEN Mo-wei. Application of gaze tracking in human computer interaction. Journal of ZheJIang University(Science Edition), 2016, 43(7): 225-232.

URL:

https://www.zjujournals.com/sci/     OR     https://www.zjujournals.com/sci/Y2016/V43/I7/225


视线跟踪技术及其在人机交互中的应用

人们在观察外部世界时眼睛总是与其它人体活动自然协调地工作,并且眼动所需的认知负荷很低,人眼的注视包含着当前的任务状况以及人的内部状态等信息,因此眼注视是一种非常好的能使人机对话变得简便、自然的候选输入通道.本文介绍了视线跟踪的基本手段、方法和技术,对视线跟踪作为人机交互通道所具有的特点进行了讨论,并指出了其在人机交互领域中的应用及前景.

关键词： 人机交互,  多通道用户界面,  视线跟踪,  隐马尔可夫模型,  神经网络 
[1]李茂贞,戴国忠,董士海.多通道界面模型与关键技术[J].计算机科学,1997,24(1):1-4.LI Mao-zhen,DAI Guo-zhong,DONG Shi-hai.Multimodal interface model and key technology[J].Computer Science,1997,24(1):1-4.
[2]STIEFELHAGEN R,YANG J.Gaze tracking for multimodal human-computer interaction[A].In Proceedings of International Conf.on Acoustics,Speech,and Signal Processing[C].Germany: Munich,1997.
[3]STIEFELHAGEN R,FINKE M,YANG J,et al.From gaze to focus of attention[J].Lecture Notes in Computer Science,1999,1614: 761-768.
[4]STIEFELHAGEN R,YANG J,WAIBEL A.A model-based gaze tracking system[J].International Journal on Artificial Intelligence Tools,1997,6(2):193-209.
[5]KLINKER G J,SHAFER S A,KANADE T.Using a color reflection model to separate highlights from object color[A].Proc.Ist International Conference on Computer Vision[C].London,1987.
[6]YANG J,LU W,WAIBEL A.Skin-color modeling and adaptation[J].Proceedings of ACCV'98,1998,2: 687-694.
[7]DE MENTHON,DANIEL F,DAVIS L S.Model based object pose in 25 lines of code[J].International Journal of Computer Vision,1995,15(1): 123-141.
[8]RABINER L R.A tutorial on hidden markov models and selected applications in speech recognition[J].Proceedings of the IEEE,1989,77(2):257-286.
[9]BALUJA S,POMERLEAU P.Non-intrusive gaze tracking using artificial neural networks[J].Advances in Neural Information Processing systems,1994,6:753-760.
[10]SALVUCCI D D,ANDERSON J R.Intelligent gaze-added interface[A].CHI 2000 Conference Proceedings[C].Netherlands: ACM Press,2000.
[11]TANRIVERDI V,JACOB J K.Interacting with eye movements in virtual environments[A].CHI 2000 Conference Proceedings[C].Netherlands: ACM Press,2000.
[12]BARFIELD W,FURNESS T A.Virtual Environments and Advanced Interface Design[M].Oxford: Oxford University Press,1995.
[1] GUO Yibo, NIU Meng, WANG Haidi, CHEN Yanhua, XUE Junxiao, YUAN Yue, HOU Lishuo, XU Mingliang, PAN Jun. An aircraft fuel data missing value filling method with generative adversarial network[J]. Journal of ZheJIang University(Science Edition), 2021, 48(4): 402-409.
[2] WANG Xie, ZHANG Xiaocan, SU Cheng. Land use classification of remote sensing images based on multi-scale learning and deep convolution neural network[J]. Journal of ZheJIang University(Science Edition), 2020, 47(6): 715-723.
[3] ZENG Jindi, ZHANG Feng, WU Sensen, DU Zhenhong, LIU Renyi. Spatial interpolation based on spatial auto-regressive neural network[J]. Journal of ZheJIang University(Science Edition), 2020, 47(5): 572-581.
[4] ZHOU Xiaotian, ZHANG Feng, DU Zhenhong, LIU Renyi. Optimization of typhoon track prediction based on neural network ensemble prediction[J]. Journal of ZheJIang University(Science Edition), 2020, 47(2): 196-202.
[5] LU Jiapin, LUO Yuetong, HUANG Zhaosong, ZHANG Yankong, CHEN Wei. An information fusion map matching method based on ranking learning[J]. Journal of ZheJIang University(Science Edition), 2020, 47(1): 27-35.
[6] ZHANG Beina, FENG Zhenhua, ZHANG Feng, DU Zhenhong, LIU Renyi, ZHOU Qin. Urban air quality data completion method based on spatio-temporal multi-view BP neural network[J]. Journal of ZheJIang University(Science Edition), 2019, 46(6): 737-744.
[7] PAN Shuiyang, LIU Junwei, WANG Yiming. Forecasting stock returns with artificial neural networks.[J]. Journal of ZheJIang University(Science Edition), 2019, 46(5): 550-555.
[8] Shanxiong CHEN, Xiaolong WANG, Xu HAN, Yun LIU, Minggui WANG. A recognition method of Ancient Yi character based on deep learning[J]. Journal of ZheJIang University(Science Edition), 2019, 46(3): 261-269.
[9] Rui ZHENG, Wenhua QIAN, Dan XU, Yuanyuan PU. Synthesis of embroidery based on convolutional neural network[J]. Journal of ZheJIang University(Science Edition), 2019, 46(3): 270-278.
[10] DU Xihua, WANG Chao. Correlation between structural parameters of Lindera Aggregata's chemical compositions and the retention time of chromatogram[J]. Journal of ZheJIang University(Science Edition), 2018, 45(6): 721-727.
[11] FANG Rongye, SHI Yubin, JIANG Ting, LI Wei, SHI Huixiang. A study on the activated carbon intelligent dosing system for urban sewage treatment plants based on BP neural network.[J]. Journal of ZheJIang University(Science Edition), 2018, 45(4): 468-475.
[12] LIU Yujie, PANG Yunping, LI Zongmin, LI Hua. Sketch based image retrieval based on abstract-level transform and convolutional neural networks[J]. Journal of ZheJIang University(Science Edition), 2016, 43(6): 657-663.
[13] ZHAO Taotao, BAI Jianjun, SHANG Zhonghui. Research on rurality differentiation of county areas in Shaanxi Province based on BP neural network[J]. Journal of ZheJIang University(Science Edition), 2016, 43(2): 203-210.
[14] FENG Cheng-Zhi, SHEN Mo-Wei-　. Application of gaze tracking in human computer interaction[J]. Journal of ZheJIang University(Science Edition), 2002, 29(2): 225-232.
[15] Guo Weiqiang . A Study on Resolving ChromatographicOverlapping Peaks with Artificial Neural Network[J]. Journal of ZheJIang University(Science Edition), 1998, 25(3): 62-65.