+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Continuous detection of human fall using multimodal features from Kinect sensors in scalable environment



Continuous detection of human fall using multimodal features from Kinect sensors in scalable environment



Computer Methods and Programs in Biomedicine 146: 151-165



Automatic detection of human fall is a key problem in video surveillance and home monitoring. Existing methods using unimodal data (RGB / depth / skeleton) may suffer from the drawbacks of inadequate lighting condition or unreliability. Besides, most of proposed methods are constrained to a small space with off-line video stream. In this study, we overcome these encountered issues by combining multi-modal features (skeleton and RGB) from Kinect sensor to take benefits of each data characteristic. If a skeleton is available, we propose a rules based technique on the vertical velocity and the height to floor plane of the human center. Otherwise, we compute a motion map from a continuous gray-scale image sequence, represent it by an improved kernel descriptor then input to a linear Support Vector Machine. This combination speeds up the proposed system and avoid missing detection at an unmeasurable range of the Kinect sensor. We then deploy this method with multiple Kinects to deal with large environments based on client server architecture with late fusion techniques. We evaluated the method on some freely available datasets for fall detection. Compared to recent methods, our method has a lower false alarm rate while keeping the highest accuracy. We also validated on-line our system using multiple Kinects in a large lab-based environment. Our method obtained an accuracy of 91.5% at average frame-rate of 10fps. The proposed method using multi-modal features obtained higher results than using unimodal features. Its on-line deployment on multiple Kinects shows the potential to be applied in to any of living space in reality.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 059546770

Download citation: RISBibTeXText

PMID: 28688485

DOI: 10.1016/j.cmpb.2017.05.007


Related references

Detection and Compensation of Degeneracy Cases for IMU-Kinect Integrated Continuous SLAM with Plane Features. Sensors 18(4):, 2018

Multimodal sensor-based fall detection within the domestic environment of elderly people. Zeitschrift für Gerontologie und Geriatrie 47(8): 661-665, 2014

Use of kinematic and mel-cepstrum-related features for fall detection based on data from infrared depth sensors. Biomedical Signal Processing and Control 40: 102-110, 2018

Fall detection in homes of older adults using the Microsoft Kinect. IEEE Journal of Biomedical and Health Informatics 19(1): 290-301, 2015

Improvement of acoustic fall detection using Kinect depth sensing. Conference Proceedings 2013: 6736-6739, 2013

A depth-based fall detection system using a Kinect® sensor. Sensors 14(2): 2756-2775, 2014

Efficient source separation algorithms for acoustic fall detection using a microsoft kinect. IEEE Transactions on Bio-Medical Engineering 61(3): 745-755, 2014

Survey on fall detection and fall prevention using wearable and external sensors. Sensors 14(10): 19806-19842, 2014

Obstacle detection in a greenhouse environment using the Kinect sensor. Computers and Electronics in Agriculture 113: 104-115, 2015

Scalable low-cost fabrication of disposable paper sensors for DNA detection. Acs Applied Materials and Interfaces 6(24): 22751-22760, 2014

Scalable graphene field-effect sensors for specific protein detection. Nanotechnology 24(35): 355502, 2013

Ionic Liquids with Wafer-Scalable Graphene Sensors for Biological Detection. IEEE Transactions on Nanobioscience 2019:, 2019

Human Arm Motion Tracking by Orientation-Based Fusion of Inertial Sensors and Kinect Using Unscented Kalman Filter. Journal of Biomechanical Engineering 138(9):, 2016

UP-Fall Detection Dataset: A Multimodal Approach. Sensors 19(9):, 2019

Using Temporal Covariance of Motion and Geometric Features via Boosting for Human Fall Detection. Sensors 18(6):, 2018