Human motion capture using wireless inertial sensors
Qi lei1, JIN Wen-guang2, GENG Wei-dong3
1. College of Software Technology, Zhejiang University, Hangzhou 310027,China;
2. Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China;
3. State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou 310027, China
Human motion capture is an important technology in the threedimensional character animation production. Since the motion capture process is very expensive and complex, in this paper we introduce a new method that captures the human motion data from the inertial motion sensors attached to the user’s limbs. The user wears multiple wireless inertial motion sensors with accelerometer and magnetometer, and the sensor data are sent to the computer using the wireless sensor network. LevenbergMarquardt based optimization algorithm is applied to estimate the threedimensional orientation of the inertial sensor and then bind the obtained orientation quaternion to the skeleton of the animation character. The root position of the animation character is modified inversely from the relative status of the supporting leg and the ground in order to make the walking motion more realistic. The experimental results show that our method can capture the user’s motion effectively and produce accurate and realistic motion capture data.
［1］ HSU E, GENTRY S, POPOVIC J. Examplebased control of human motion ［C］∥ Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation. Grenoble, France: Eurographics Association, 2004: 69-77.
［2］ LEE J, CHAI J, REITSMA P S, et al. Interactive control of avatars animated with human motion data ［C］∥ Proceedings of the 29th annual conference on Computer graphics and interactive techniques. San Antonio, Texas: ACM, 2002: 491-500.
［3］ MAES P, DARRELL T, BLUMBERG B, et al. The ALIVE system: wireless fullbody interaction with autonomous agents ［J］. ACM Multimedia Systems, 1997, 5: 105-112.
［4］ BLACKBURN J, RIBEIRO E. Human motion recognition using isomap and dynamic time warping ［C］∥ Proceedings of the 2nd conference on Human motion. Rio de Janeiro, Brazil: SpringerVerlag, 2007: 285-298.
［5］ ISHIGAKI S, WHITE T, ZORDAN VB, et al. Performancebased control interface for character animation ［J］. ACM Transactions on Graphics, 2009, 28: 1-8.
［6］ CHAI J, HODGINS J K. Performance animation from lowdimensional control signals ［C］∥ Proceedings of the 22nd annual conference on Computer graphics and interactive techniques. Los Angeles, California: ACM, 2005: 686-696.
［7］ LEE J, HA I. Sensor Fusion and Calibration for Motion Captures using Accelerometers ［C］∥ Proceedings of the 1999 IEEE International Conference on Robotics and Automation. Detroit, United states: IEEE, 1999: 1954-1959.
［8］ MIZELL D. Using gravity to estimate accelerometer orientation ［C］∥ Proceedings of the 7th IEEE International Symposium on Wearable Computers. New York, USA: IEEE, 2003: 252-258.
［9］ SHIRATORI T, HODGINS J. Accelerometerbased user interfaces for the control of a physically simulated character ［J］. ACM Transactions on Graphics, 2008, 27: 1-9.
［10］ MANTYJARVI J, HIMBERG J, SEPPANEN T. Recognizing human motion with multiple acceleration sensors ［C］∥ Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Tucson, United states: IEEE, 2001: 747-752.
［11］ SLYPER R, HODGINS J. Action capture with accelerometers ［C］∥ ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Dublin, Ireland: ACM, 2008: 193-199.
［12］ DONG W, LIM K Y, GOH Y K, et al. A lowcost motion tracker and its error analysis ［C］∥ IEEE International Conference on Robotics and Automation. Pasadena, USA: IEEE, 2008: 311-316.
［13］ LYMPOURIDES V, ARVIND D K, PARKER M. Fully wireless, full body 3D motion capture for improvisational performances ［C］∥ In Proceedings of the Workshop on Whole Body Interaction. Boston, USA: ACM, 2009: 221-233.
［14］ SAKAGUCHI T, SATO K, INOKUCHI S. Human Motion Capture by Integrating Gyroscopes and Accelerometers ［C］∥ IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems. Washington, USA: IEEE, 1996: 470-475.
［15］ BACHMANN E R, MCGHEE R B, YUN X, et al. Inertial and magnetic posture tracking for inserting humans into networked virtual environments ［C］∥ Proceedings of the ACM symposium on Virtual reality software and technology. Baniff, Canada: ACM, 2001: 9-16.
［16］ BRUDERLIN A, WILLIAMS L. Motion signal processing ［C］∥ Proceedings of the 22nd annual conference on Computer graphics and interactive techniques. Los Angeles, USA: ACM, 2005: 97-104.
［17］ HASENFRATZ J, LAPIERRE M, SILLION F. A realtime system for full body interaction with virtual worlds ［C］∥ Eurographics Symposium on Virtual Enviroments. Grenoble, France: The Eurographics Association, 2004: 147-156.
［18］ MADSEN K, NIELSEN H B, TINGLEFF O. Methods for nonlinear least squares problems ［M］. Lyngby: Technical University of Denmark Press, 2004: 44-58.
［19］ NOCEDAL J, WRIGHT S J. Numerical optimization ［M］. New York: Springer, 1999: 359-365.
