Video analysis method combining target detection with human body posture estimation

A technology of target detection and human body posture, which is applied in the field of video intelligent recognition, can solve problems such as the inability to perceive and identify dangerous behaviors or scenes, the inability to find danger sources, and the lack of information obtained.

Pending Publication Date: 2020-10-23
SHANGHAI MUNICIPAL ELECTRIC POWER CO +1
View PDF4 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, there are real-time and accurate algorithms, but the human body posture estimation algorithm can only analyze the personnel information, and cannot find other sources of danger in the image, let alone perform correlation analysis with other sources of danger.
[0004] It can be seen that using the existing technology for real-time video analysis in complex scenes, the mainstream target detection algorithm and human body pose estimation algorithm, due to their inherent limitations, the information obtained by each is insufficient, and many dangerous behaviors or scenes cannot be perceived and analyzed. identify

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video analysis method combining target detection with human body posture estimation
  • Video analysis method combining target detection with human body posture estimation
  • Video analysis method combining target detection with human body posture estimation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0033] Such as figure 1 and figure 2 As shown, a video analysis method that combines target detection with human pose estimation includes the following steps:

[0034] S1. Fetch video frames: Obtain live camera video streams through the streaming media server, intercept video frames from them, and obtain decoded pictures.

[0035] S2. Target detection: Use the deep learning algorithm to perform fast target detection on the first frame of the picture, and find all the target objects that can be identified.

[0036] Among them, in the fast target detection, the YOLO target detection model with real-time performance is used to make its detection speed reach 50 frames per second, which meets the real-time detection requirements.

[0037] S3. Positioning of key points of human body posture: If a person is found in the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a video analysis method combining target detection with human body posture estimation, and the video analysis method comprises the steps: obtaining an onsite camera video stream through a streaming media server, intercepting a video frame from the onsite camera video stream, and obtaining a decoded picture; carrying out rapid target detection on each obtained picture by adopting a deep learning algorithm, and finding out target objects of all identifiable categories; judging whether a person exists or not, and sequentially carrying out dangerous behavior analysis and dangerous scene analysis on the picture; in dangerous behavior analysis and dangerous scene analysis, if a dangerous event is found, reporting and pushing an alarm to a display platform in time; and continuously analyzing the video stream in real time. According to the video analysis method, target detection and a human body posture estimation algorithm are combined and introduced into the field ofintelligent monitoring and recognition of infrastructure videos, and dangerous behaviors or scenes can be recognized, and the labor force of manual screen staring in traditional monitoring can be liberated, and the infrastructure safety management efficiency is greatly improved.

Description

technical field [0001] The invention relates to the technical field of video intelligent recognition, in particular to a video analysis method combining target detection and human body pose estimation. Background technique [0002] In power grid infrastructure projects, traditional video surveillance is based on manual screen monitoring, and random calls to monitor lines for monitoring. In the era of big data information, the number of monitoring lines is increasing rapidly, but due to the internal personnel positions and staffing of the enterprise, it is impossible for the management personnel of power grid infrastructure projects to increase significantly. Moreover, some danger sources, such as fire sources, potholes, etc., require continuous attention 24 hours a day, covering the entire construction site, which is impossible to complete manually. Therefore, there is an urgent need for automated video analysis techniques capable of dangerous behaviors and scenarios. [0...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/103G06V20/52G06N3/045G06F18/241
Inventor 李宾皑路敏孙宇飞顾书玉
Owner SHANGHAI MUNICIPAL ELECTRIC POWER CO
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products