+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Real-time posture reconstruction for Microsoft Kinect

Real-time posture reconstruction for Microsoft Kinect

IEEE Transactions on Cybernetics 43(5): 1357-1369

The recent advancement of motion recognition using Microsoft Kinect stimulates many new ideas in motion capture and virtual reality applications. Utilizing a pattern recognition algorithm, Kinect can determine the positions of different body parts from the user. However, due to the use of a single-depth camera, recognition accuracy drops significantly when the parts are occluded. This hugely limits the usability of applications that involve interaction with external objects, such as sport training or exercising systems. The problem becomes more critical when Kinect incorrectly perceives body parts. This is because applications have limited information about the recognition correctness, and using those parts to synthesize body postures would result in serious visual artifacts. In this paper, we propose a new method to reconstruct valid movement from incomplete and noisy postures captured by Kinect. We first design a set of measurements that objectively evaluates the degree of reliability on each tracked body part. By incorporating the reliability estimation into a motion database query during run time, we obtain a set of similar postures that are kinematically valid. These postures are used to construct a latent space, which is known as the natural posture space in our system, with local principle component analysis. We finally apply frame-based optimization in the space to synthesize a new posture that closely resembles the true user posture while satisfying kinematic constraints. Experimental results show that our method can significantly improve the quality of the recognized posture under severely occluded environments, such as a person exercising with a basketball or moving in a small room.

Please choose payment method:

(PDF emailed within 0-6 h: $19.90)

Accession: 055392223

Download citation: RISBibTeXText

PMID: 23981562

DOI: 10.1109/tcyb.2013.2275945

Related references

Real Time Apnoea Monitoring of Children Using the Microsoft Kinect Sensor: A Pilot Study. Sensors 17(2):, 2017

SU-E-J-158: A Prototype of a Real-Time Respiratory Motion Monitoring System Using Microsoft Kinect Sensor. Medical Physics 39(6part8): 3689, 2012

Evaluation of foot posture using the Microsoft Kinect. Journal of Science and Medicine in Sport 16: E24-E25, 2013

Validity and reliability of head posture measurement using Microsoft Kinect. British Journal of Ophthalmology 98(11): 1560-1564, 2014

Reliability and validity of the Microsoft Kinect for evaluating static foot posture. Journal of Foot and Ankle Research 6(1): 14, 2013

Validation of a method for real time foot position and orientation tracking with Microsoft Kinect technology for use in virtual reality and treadmill based gait training programs. IEEE Transactions on Neural Systems and Rehabilitation Engineering 22(5): 997-1002, 2015

Point-of-care-testing of standing posture with Wii balance board and Microsoft Kinect during transcranial direct current stimulation: a feasibility study. Neurorehabilitation 34(4): 789-798, 2014

Preoperative implant selection for unilateral breast reconstruction using 3D imaging with the Microsoft Kinect sensor. Journal of Plastic Reconstructive and Aesthetic Surgery 70(8): 1059-1067, 2017

Kinect Posture Reconstruction Based on a Local Mixture of Gaussian Process Models. IEEE Transactions on Visualization and Computer Graphics 22(11): 2437-2450, 2016

The use of the Microsoft Kinect to measure thoracic kyphosis. PhysioTherapy 101: E1243-E1244, 2015

Detection of patient's bed statuses in 3D using a Microsoft Kinect. Conference Proceedings 2014: 5900-5903, 2014

Evaluation of the Microsoft Kinect for screening ACL injury. Conference Proceedings 2013: 4152-4155, 2013

Using the Microsoft Kinect™ to assess 3-D shoulder kinematics during computer use. Applied Ergonomics 65: 418-423, 2017

Towards a detailed anthropometric body characterization using the Microsoft Kinect. Technology and Health Care 24(2): 251-265, 2016

The feasibility of using Microsoft Kinect v2 sensors during radiotherapy delivery. Journal of Applied Clinical Medical Physics 17(6): 446-453, 2016