Fall detection method and system for housebound old people based on multi-feature fusion

A multi-feature fusion and detection method technology, which is applied in the field of fall detection method and system for the elderly at home, can solve the problems that need to be improved, the speed and accuracy are difficult to balance, and the time-consuming is long, so as to overcome the poor detection flexibility and improve the prediction accuracy , fast effect

Active Publication Date: 2021-05-14
NANJING UNIV OF POSTS & TELECOMM
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method takes a long time, and it is difficult to balance speed and accuracy
Although the above methods can achieve a certain recognition effect in a certain scene, it is difficult for a single feature to fully represent the rich information of the action of falling, and the recognition rate in complex scenes needs to be improved, and considering the flexibility of recognition Therefore, it is necessary to provide a fall behavior recognition method based on multi-feature fusion, so as to achieve better results in home security.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fall detection method and system for housebound old people based on multi-feature fusion
  • Fall detection method and system for housebound old people based on multi-feature fusion
  • Fall detection method and system for housebound old people based on multi-feature fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] Such as Figure 1 to Figure 4 As shown, a fall detection method based on multi-feature fusion, including: real-time video acquisition of a given monitoring object, respectively to obtain voice signals and video signals; preprocessing the voice signal and extracting the acoustic features of the voice signal; The video signal is divided into frames, and the images obtained after the frame division processing are respectively input into the Darknet-53 network and the VGG-16 network to obtain the current posture characteristics and facial features of the monitored object, and obtain the current state of the monitored object based on the facial features. The heart rate value is based on the current attitude feature to obtain the peak attitude response of the monitored object; after normalization and timing synchronization of the face features, it is cascaded with the acoustic features of the extracted voice signal to complete the fusion, and the fused fusion features Carry o...

Embodiment 2

[0057] Based on the fall detection method based on multi-feature fusion described in Embodiment 1, this embodiment provides a fall detection system based on multi-feature fusion, including:

[0058] The first module is used for real-time video acquisition of a given monitoring object, respectively acquiring voice signals and video signals;

[0059] The second module is used to preprocess the speech signal and extract the acoustic features of the speech signal;

[0060] The third module is used to divide the video signal into frames, input the images obtained after the frame division into the Darknet-53 model and the VGG-16 network respectively, and obtain the current posture features and face features of the monitoring object, based on the face The feature acquires the current heart rate value of the monitored object, and obtains the peak attitude response of the monitored object based on the current attitude feature;

[0061] The fourth module is used to normalize the face f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a fall detection method and system for housebound old people based on multi-feature fusion and belongs to the technical field of computer vision. The method and system can effectively monitor the potential tumble risk of the housebound old people and improve the pre-judgment accuracy of the potential tumble risk of the housebound old people. The method comprises the following steps of: carrying out real-time video acquisition on a given monitoring object, and obtaining voice signals and video signals; extracting acoustic features of the voice signals; acquiring current posture features and face features of the monitored object, acquiring a current heart rate value of the monitored object based on the face features, and acquiring a posture response peak value of the monitored object based on the current posture features; obtaining expression features of the monitored object; evaluating the feature confidence of the current posture features, the expression features and the current heart rate value of the monitored object to determine the fusion weight of each feature, and obtaining the fusion fall confidence of the monitored object; and judging the falling condition of the monitored object based on the fusion falling confidence and the posture response peak value of the monitored object.

Description

technical field [0001] The invention belongs to the technical field of computer vision, and in particular relates to a fall detection method and system for the elderly at home based on multi-feature fusion. Background technique [0002] With the acceleration of the informatization process, the smart home system has also ushered in new changes, and it has also had a relatively positive impact on video surveillance in the home. In the process of safety monitoring and analysis of the elderly at home, a very important task is to analyze the potential fall risk of the elderly. As one of the behaviors that can have a direct impact on the human body, falling will not only have a direct negative impact on human health, but also bring potential health risks. Falls are the number one cause of injury for people aged 65 and over, the data show. About 9,500 older adults die from falls each year, and the average person aged 65 to 69 suffers a hip fracture from every 200 falls. More ser...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06N3/04G06N3/08
CPCG06N3/049G06N3/08G06V20/52G06V10/44G06V2201/07G06N3/045G06F18/2135G06F18/253
Inventor 李晓飞蒋阳阳
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products