Please wait a minute...
浙江大学学报(工学版)  2018, Vol. 52 Issue (1): 160-165    DOI: 10.3785/j.issn.1008-973X.2018.01.021
自动化技术     
以轮廓为对象的体态特征情绪分类与预测
袁红1,2, 王波1, 王丽1, 许睦旬2
1. 中国航天员科研训练中心 人因工程重点实验室, 北京 100094;
2. 西安交通大学 工业设计系, 陕西 西安 710049
Emotional classification and prediction of body movements based on silhouette
YUAN Hong1,2, WANG Bo1, WANG Li1, XU Mu-xun2
1. National Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing 100094, China;
2. Department of Industrial Design, Xi'an Jiaotong University, Xi'an 710049, China
 全文: PDF(1455 KB)   HTML
摘要:

采用摄像机对人体行为进行采集,基于OpenCV库对人体行为进行特征提取,在已有学者研究的基础上,拓展所采集低层运动特征,引入PAD情绪量表对个体进行评估.采用中国民族音乐作为情绪诱发素材,对10名受试者进行正、中、负性情绪诱发,受试者通过外显行为将自身情绪自然表达出来;通过PAD情绪量表评估每段诱发素材的情绪状态,视频采集该情绪状态下受试者的行为;采用轮廓法提取视频中个体行为的体态特征,主要包括个体轮廓相对面积及变化特征;结合情绪量表的评估结果,采用支持向量机对个体体态特征所蕴含的情绪进行分类学习,实现体态特征的情绪预测.结果实现了体态特征的情绪分类,且以正、负性情绪为类别进行体态特征分类的情绪预测准确率达到76.92%.

Abstract:

The features of the human behaviors were collected by camera and extracted with OpenCV in order to predict the emotions of individuals with the help of PAD scales based on previous studies. Ten subjects were requested to express their emotions through body movements, which were induced by Chinese folk music involving positive, middle and negative emotions. The states of subjects' emotions were evaluated by PAD scales while the behaviors of subjects were collected by camera. The features of individual behaviors were extracted with the characteristic of silhouette, including the relative areas of the individual silhouettes and their rate of change. The emotions of behaviors were classified by support vector machine with the evaluation of emotional scales in order to realize the emotional prediction of the behavioral features. The results realized the emotional classification of behaviors, and the prediction accuracy rate came to 76.92% with the categories of positive and negative emotions.

收稿日期: 2016-10-23 出版日期: 2017-12-15
CLC:  TP391  
基金资助:

中国航天员中心-深圳"绿航星际"4人180天项目.

通讯作者: 王丽,女,研究员.orcid.org/0000-0001-8951-7441.     E-mail: wanglikunyu@126.com
作者简介: 袁红(1992-),女,硕士生,从事物人关系的研究.orcid.org/0000-0002-3649-2858.E-mail:yuanhong0624@126.com
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
作者相关文章  

引用本文:

袁红, 王波, 王丽, 许睦旬. 以轮廓为对象的体态特征情绪分类与预测[J]. 浙江大学学报(工学版), 2018, 52(1): 160-165.

YUAN Hong, WANG Bo, WANG Li, XU Mu-xun. Emotional classification and prediction of body movements based on silhouette. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(1): 160-165.

链接本文:

http://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2018.01.021        http://www.zjujournals.com/eng/CN/Y2018/V52/I1/160

[1] 胡馨月. 情感计算研究综述[J]. 中国校外教育:理论, 2011(增3):34-36. HU Xin-yue. A survey of emotional computing[J]. Education for Chinese After-school (Theory), 2011(supple.3):34-36.
[2] 傅小兰.情绪心理学[M].上海:华东师范大学出版社,2016.
[3] CASTELLANO G, VOLPE G. Automatedanalysis of body movement in emotionally expressive piano performances[J]. Music Perception, 2008, 26(2):103-119.
[4] CAMURRI A, LAGERLÖF I, VOLPE G. Recognizing emotion from dance movement:comparison of spectator recognition and automated techniques[J]. International Journal of Human-Computer Studies, 2003, 59(1/2):213-225.
[5] MEHRABIAN A. Pleasure-arousal-dominance:a general framework for describing and measuring individual differences in temperament[J]. Current Psychology, 1996, 14(4):261-292.
[6] MEHRABIAN A. Comparison of the PAD and PANAS as models for describing emotions and for differentiating anxiety from depression[J]. Journal of Psychopathology and Behavioral Assessment, 1997(19):331-357.
[7] SCHERER K R, EKMAN P.Handbook of methods in nonverbal behavior research[M]. Cambridge:Cambridge University Press, 1982, 3(3):286-287.
[8] MCDUFF D, KALIOUBY R, SENECHAL T, et al. Affectiva-MIT facial expression dataset (AM-FED):naturalistic and spontaneous facial expressions collected[J]. Computer Vision and Pattern Recognition Workshops, 2013, 13(4):881-888.
[9] KESSOUS L, CASTELLANO G, CARIDAKIS G. Multimodalemotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis[J]. Journal on Multimodal User Interfaces, 2009, 3(1):33-48.
[10] 郭萍. 基于视频的人体行为分析[D]. 北京:北京交通大学, 2012. GUO Ping. Humanactivity analysis in videos[D]. Beijing:Beijing Jiaotong University, 2012.
[11] 白鹏. 支持向量机理论及工程应用实例[M]. 西安:西安电子科技大学出版社, 2008.
[12] (美)哈林顿(Harrington P). 机器学习实战[M]. 北京:人民邮电出版社, 2013.
[13] 张学工. 关于统计学习理论与支持向量机[J]. 自动化学报, 2000, 26(1):32-42. ZHANG Xue-gong. Introduction to statistical learning theory and support vector machines[J]. ACTA AUTOM ATICA SINICA, 2000, 26(1):32-42.
[14] PAPAGEORGIOU C P, OREN M, POGGIO T. A general framework for object detection[C]//International Conference on Computer Vision.[S. l.]:IEEE, 2002:555-562.
[15] 薛召军, 李佳, 明东,等. 基于支持向量机的步态识别新方法[J]. 天津大学学报:自然科学与工程技术版, 2007, 40(1):78-82. XUE Zhao-jun, LI Jia, MING Dong, et al. SVM-based gait recognition[J]. Journal of Tianjin University:Science and Technology, 2007, 40(1):78-82.
[16] VAPNIK V N. Statisticallearning theory[J]. Encyclopedia of the Sciences of Learning, 2010, 41(4):3185.
[17] CHANG C C, LIN C J. LIBSVM:a library for support vector machines[J]. ACM Transactions on Intelligent Systems and Technology, 2011, 2(3):389-396.
[18] 蒋军,陈雪飞,陈安涛.情绪诱发方法及其新进展[J].西南师范大学学报:自然科学版,2011,36(1):209-214. JIANG Jun, CHEN Xue-fei, CHEN An-tao, et al. Mood induction procedures and the recent advancement[J]. Journal of Southwest China Normal University:Natural Science Edition, 2011, 36(1):209-214.
[19] 石骏. 中国民族音乐的情绪结构分析[D]. 上海:华东师范大学, 2015. SHI Jun. The emotional model of Chinese folk music[D]. Shanghai:East China Normal University, 2015.
[20] LI X M, ZHOU H T. The reliability and validity of the Chinese version of abbreviated PAD emotion scales[J]. Affective Computing and Intelligent Interaction, 2005, 3784(1):513-518.

[1] 韩勇, 宁连举, 郑小林, 林炜华, 孙中原. 基于社交信息和物品曝光度的矩阵分解推荐[J]. 浙江大学学报(工学版), 2019, 53(1): 89-98.
[2] 郑洲, 张学昌, 郑四鸣, 施岳定. 基于区域增长与统一化水平集的CT肝脏图像分割[J]. 浙江大学学报(工学版), 2018, 52(12): 2382-2396.
[3] 赵丽科, 郑顺义, 王晓南, 黄霞. 单目序列的刚体目标位姿测量[J]. 浙江大学学报(工学版), 2018, 52(12): 2372-2381.
[4] 何杰光, 彭志平, 崔得龙, 李启锐. 局部维度改进的教与学优化算法[J]. 浙江大学学报(工学版), 2018, 52(11): 2159-2170.
[5] 李志, 单洪, 马涛, 黄郡. 基于反向标签传播的移动终端用户群体发现[J]. 浙江大学学报(工学版), 2018, 52(11): 2171-2179.
[6] 王硕朋, 杨鹏, 孙昊. 听觉定位数据库构建过程优化[J]. 浙江大学学报(工学版), 2018, 52(10): 1973-1979.
[7] 魏小峰, 程承旗, 陈波, 王海岩. 基于独立边数的链码方法[J]. 浙江大学学报(工学版), 2018, 52(9): 1686-1693.
[8] 陈荣华, 王鹰汉, 卜佳俊, 于智, 高斐. 基于KNN算法与局部回归的网站无障碍采样评估[J]. 浙江大学学报(工学版), 2018, 52(9): 1702-1708.
[9] 张承志, 冯华君, 徐之海, 李奇, 陈跃庭. 图像噪声方差分段估计法[J]. 浙江大学学报(工学版), 2018, 52(9): 1804-1810.
[10] 刘洲洲, 李士宁, 李彬, 王皓, 张倩昀, 郑然. 基于弹性碰撞优化算法的传感云资源调度[J]. 浙江大学学报(工学版), 2018, 52(8): 1431-1443.
[11] 王勇超, 祝凯林, 吴奇轩, 鲁东明. 基于局部渲染的高精度模型自适应展示技术[J]. 浙江大学学报(工学版), 2018, 52(8): 1461-1466.
[12] 孙念, 李玉强, 刘爱华, 刘春, 黎威威. 基于松散条件下协同学习的中文微博情感分析[J]. 浙江大学学报(工学版), 2018, 52(8): 1452-1460.
[13] 郑守国, 崔雁民, 王青, 杨飞, 程亮. 飞机装配现场数据采集平台设计[J]. 浙江大学学报(工学版), 2018, 52(8): 1526-1534.
[14] 毕晓君, 王朝. 基于超平面投影的高维多目标进化算法[J]. 浙江大学学报(工学版), 2018, 52(7): 1284-1293.
[15] 张廷蓉, 滕奇志, 李征骥, 卿粼波, 何小海. 岩心三维CT图像超分辨率重建[J]. 浙江大学学报(工学版), 2018, 52(7): 1294-1301.