Please wait a minute...
浙江大学学报(工学版)
J4  2012, Vol. 46 Issue (6): 995-1003    DOI: 10.3785/j.issn.1008-973X.2012.06.006
计算机技术     
基于生理信号的观众情感状态识别模型
叶晓菡1,2, 陈岭1, 姜贤塔1, 陈根才1
1. 浙江大学 计算机科学技术学院,浙江 杭州 310027；
2. 浙江育英职业技术学院 信息技术与应用系,浙江 杭州 310018
Physiological signals based emotional state
recognition model of audience
YE Xiao-han1,2, CHEN Ling1, JIANG Xian-ta1, CHEN Gen-cai1
1. College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China; 2. Information Technology
and Applications Department, Zhejiang Yuying College of Vocational Technology, Hangzhou 310018,China
 全文: PDF  HTML
摘要：

为研究电影情节与观众生理信号变化的关系,提出基于生理信号的观众情感状态识别模型,从观众生理信号中提取特征,采用顺序前进法（SFS）进行特征选择,并基于支持向量机（SVM）建立观众情感状态识别模型.实验选择了不同类型的3部影片,共11名人员参加,在电影播放时拍摄观众表情并记录其生理信号,基于表情人工标注其情感状态.实验结果表明：该模型对各情感状态的区分较理想,平均识别率在90%以上.
Abstract:

To study the relationship between movie plot and the physiological signals of audience, a physiological signals based emotional state recognition model of movie audience was proposed. Features were extracted from physiological signals, and sequential forward selection (SFS) method was used for feature selection purpose. The emotional state recognition model was built based on support vector machine (SVM). Experiments were conducted to evaluate the performance of the model. In the experiments, three movies with different types were employed. During watching these movies, the facial expressions and physiological signals of 11 participants were recorded, and the human judgment of the emotional states of the participants was obtained based on their facial expressions. The experimental results indicate that the proposed model can distinguish among various emotional states, and the average recognition rate is higher than 90%.
出版日期: 2012-07-24
:  TP 391  
基金资助:

国家自然科学基金资助项目（60703040）；浙江省自然科学基金资助项目（Y107178）；浙江省科技计划重大项目（2007C13019）.
通讯作者: 陈岭，男，副教授.     E-mail: lingchen@cs.zju.edu.cn
作者简介: 叶晓菡，女（1970—），讲师，从事人机交互、情感计算研究.E-mail：yexiaohan1970@sina.com
服务　　
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章　　

引用本文:

叶晓菡, 陈岭, 姜贤塔, 陈根才. 基于生理信号的观众情感状态识别模型[J]. J4, 2012, 46(6): 995-1003.

YE Xiao-han, CHEN Ling, JIANG Xian-ta, CHEN Gen-cai. Physiological signals based emotional state
recognition model of audience. J4, 2012, 46(6): 995-1003.

链接本文:

http://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2012.06.006    或    http://www.zjujournals.com/eng/CN/Y2012/V46/I6/995

［1］ XU M, CHIA L, JIN J. Affective content analysis in comedy and horror videos by audio emotional event detection ［C］ ∥ Proceedings of International Conference on Multimedia and Expo. Amsterdam：［s.n.］, 2005: 622-625.
［2］ HANJALIC A, XU L. Affective video content representation and modeling ［J］. IEEE Transactions on Multimedia, 2005, 7(1): 143-154.
［3］ 孙凯,于俊清.面向观众的个性化电影情感内容表示与识别［J］.计算机辅助设计与图形学学报,2010, 22(1): 136-144.
SUN Kai, YU Junqing. Personalized video affective content representation and recognition of audience［J］. Journal of Computeraided Design & Computer Graphics, 2010, 22(1): 136-144.
［4］ SOLEYMANI M, CHANEL G, KIERKELS J J M, et al. Affective characterization of movie scenes based on multimedia content analysis and user’s physiological emotional responses［J］. IEEE International Symposium on Multimedia, 2008: 228-235.
［5］ MONEY A G, AGIUS H. Analysing user physiological responses for affective video summarisation［J］. Displays, 2009, 30(2): 59-70.
［6］ EKMAN P. Emotion in the Human Face［M］. Cambridge: Cambridge University Press, 1982.
［7］ KIM J, ANDRE E. Emotion recognition based on physiological changes in music listening［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(12): 2067-2083.
［8］ 孙杰,陈岭,阮升升,等.基于心率的身体控制游戏生理状态模型［J］.浙江大学学报:工学版, 2011, 45(2): 295-300.
SUN Jie, CHEN Ling, RUAN Shengsheng, et al. Heart rate based physiological states model forbodycontrolled games［J］. Journal of Zhejiang University: Engineering Science, 2011, 45(2): 295-300.
［9］ Thought Technology Ltd. Biofeedback Equipment［EB/OL］. ［2011-01-20］. http:∥www.thoughttechnology.com.
［10］ CHEN L, CHEN G, XU C, et al. EmoPlayer: a media player for video clips with affective annotations［J］. Interacting with Computers, 2008, 20(1): 17-28.
［11］ 吴奇,申寻兵,傅小兰.微表情研究及其应用［J］.心理科学进展,2010,18(9): 1359-1368.
WU Qi, SHEN Xunbing, FU Xiaolan. Research and application of microexpressions［J］. Advances in Psychological Science, 2010, 18(9): 1359-1368.
［12］ VERVERIDIS D, KOTROPOULOS C. Fast and accurate sequential floating forward feature selection with the Bayes classifier applied to speech emotion recognition［J］. Signal Processing, 2008, 88(12): 2956-2970.
［13］ VAPNIK V N. The nature of statistical learning theory ［M］. New York: SpringerVerlag, 1995.
［14］ ChihChung Chang and ChihJen Lin. LIBSVMA Library for Support Vector Machines［EB/OL］. ［2011-01-20］. http:∥www.csie.ntu.edu.tw/～cjlin/libsvm.
［15］ RUAN S, CHEN L, SUN J, et al. Study on the change of physiological signals during playing bodycontrolled games［C］∥ Proceedings of the International Conference on Advances in Computer Enterntainment Technology. New York:［s.n.］, 2009: 349-352.
[1] 赵建军,王毅,杨利斌. 基于时间序列预测的威胁估计方法[J]. J4, 2014, 48(3): 398-403.
[2] 徐嵩,孙秀霞,何衍. 利用直线段成像特性的摄像机畸变迭代标定方法[J]. J4, 2014, 48(3): 404-413.
[3] 崔光茫, 赵巨峰, 冯华君, 徐之海, 李奇, 陈跃庭. 非均匀介质退化图像快速仿真模型的建立[J]. J4, 2014, 48(2): 303-311.
[4] 张天煜, 冯华君, 徐之海, 李奇, 陈跃庭. 基于强边缘宽度直方图的图像清晰度指标[J]. J4, 2014, 48(2): 312-320.
[5] 刘中, 陈伟海, 吴星明, 邹宇华, 王建华. 基于双目视觉的显著性区域检测[J]. J4, 2014, 48(2): 354-359.
[6] 谢天, 解利军, 宋广华, 郑耀. 基于平面颜色分布的增强现实自然特征注册算法[J]. J4, 2013, 47(12): 2243-2252.
[7] 王相兵,童水光,钟崴,张健. 基于可拓重用的液压挖掘机结构性能方案设计[J]. J4, 2013, 47(11): 1992-2002.
[8] 王贝,李基拓,陆国栋. 空间趋向曲线引导的网格曲面拼接[J]. J4, 2013, 47(11): 2003-2009.
[9] 王进, 陆国栋, 张云龙. 基于数量化一类分析的IGA算法及应用[J]. J4, 2013, 47(10): 1697-1704.
[10] 杨玉婷, 史玉回, 夏顺仁. 基于讨论机制的头脑风暴优化算法[J]. J4, 2013, 47(10): 1705-1711.
[11] 杨帮华, 何美燕, 刘丽, 陆文宇. 脑机接口中基于BISVM的EEG分类[J]. J4, 2013, 47(8): 1431-1436.
[12] 杨冰, 许端清, 杨鑫, 赵磊, 唐大伟. 基于艺术风格相似性规则的绘画图像分类[J]. J4, 2013, 47(8): 1486-1492.
[13] 刘羽, 王国瑾. 以已知曲线为渐进线的可展曲面束的设计[J]. J4, 2013, 47(7): 1246-1252.
[14] 胡根生,鲍文霞,梁栋,张为. 基于SVR和贝叶斯方法的全色与多光谱图像融合[J]. J4, 2013, 47(7): 1258-1266.
[15] 楼晓俊, 孙雨轩, 刘海涛. 聚类边界过采样不平衡数据分类方法[J]. J4, 2013, 47(6): 944-950.