Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Free Viewpoint Video Playback Method Based on Somatosensory Camera Gesture Recognition

A gesture recognition, video playback technology, applied in character and pattern recognition, user/computer interaction input/output, mechanical mode conversion, etc., can solve problems such as high computational complexity, complicated steps, and unfavorable real-time switching of free viewpoints. , to achieve the effect of reducing lag, good integration, simple and fast gesture recognition method

Active Publication Date: 2020-08-11
ZHEJIANG UNIV OF TECH
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The steps of this gesture recognition method are relatively complicated, the calculation complexity is high, and it is not conducive to the real-time switching of free viewpoints.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Free Viewpoint Video Playback Method Based on Somatosensory Camera Gesture Recognition
  • A Free Viewpoint Video Playback Method Based on Somatosensory Camera Gesture Recognition
  • A Free Viewpoint Video Playback Method Based on Somatosensory Camera Gesture Recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The present invention will be described in detail below in conjunction with the embodiments and accompanying drawings, but the present invention is not limited thereto.

[0043] The present invention adopts the second-generation Kinect somatosensory camera of Microsoft Corporation and the PC whose processor is Inter-Core-i5-6500@2.30GHz as the hardware platform, and the embodiment of the present invention is based on the free viewpoint video playback method of Kinect camera gesture recognition, such as figure 1 As shown, it specifically includes the following steps:

[0044] (1) Obtain a frame of depth image and human skeleton data;

[0045] (2) Preprocessing the depth image by using bilateral filtering method;

[0046] (3) Use human skeleton data to calculate the center position of the right palm and the position of the right arm;

[0047] (4) Obtain the outline of the right palm according to the center position of the right palm and the depth image after preprocessi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a free-view video playback method based on gesture recognition of a somatosensory camera, which acquires a frame of depth image and human skeleton data, preprocesses the depth image with a bilateral filtering method, calculates the center position of the right palm and the position of the right arm, and obtains the right palm. Contour, extract the contour feature of the right palm and the position feature of the right arm to judge the gesture, and convert the recognized gesture into the corresponding viewpoint playback operation. The invention uses the bilateral filtering method to preprocess the depth image, so that the generated depth image better retains the edge contour information in the image. A simple and fast gesture recognition method is designed, which effectively reduces the jamming of user gestures when switching viewpoints. A new method for zooming in and zooming out and switching between viewpoints is designed. By recognizing the user's gestures, the part of the viewpoint image is zoomed in and out and the viewpoint is switched, which can bring users a good integration when watching free viewpoint videos. sense.

Description

technical field [0001] The invention relates to the field of free-viewpoint video playback, in particular to a free-viewpoint video playback method based on somatosensory camera gesture recognition. Background technique [0002] With the development of information technology, people have more and more stringent requirements for video playback, from the initial black-and-white video image to the current color video image, from the initial SD and HD to the current ultra-definition and ultra-high-definition, but people There is a physiological limit to the vision of the eye, and the demand for resolution and chromaticity is about to become saturated. In addition, the two major development directions of video and images in the 21st century are high-definition and three-dimensional. High-definition has been basically realized at present, and three-dimensional will be the development direction of video and images in the future. The display methods of stereoscopic video can be div...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N21/422G06K9/00G06F3/01
CPCH04N21/42204G06F3/017G06V40/28
Inventor 朱威宋广振王义锋陈朋郑雅羽
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com