A screen control method and device

Abstract

The invention discloses a screen control method and device. The screen control device comprises a data acquisition unit, a key point detection unit, a target tracking unit, a gesture recognition unitand an action recognition and control unit. The screen control method comprises the steps that a color image frame, a depth image frame and an IR image frame are acquired through a camera; obtaining akey point of the target part through the color image frame; obtaining the depth value of a key point according to the corresponding relationship among the pixel points of the three image frames, andobtaining the spatial position information of the key point to obtain the motion state information of the tracking target; according to a corresponding relation among pixel points of the three image frames and a key point of a target hand, segmenting a hand area on the depth image frame, and extracting a picture of the hand area on the IR image frame to carry out gesture recognition; and determining a target action according to the motion state information and the target gesture. According to the invention, the screen control can be performed more accurately and finely to enhance the user experience.

Description

technical field [0001] The invention relates to the technical field of computers, in particular to a screen control method and device. Background technique [0002] At present, the methods of large screen interaction are mainly based on touch, laser array, remote control or voice interactive methods. With the continuous improvement of screen technology, the definition and size of large screens are also rising. For super large screens, Touch interaction and laser array interaction can no longer meet the requirements and are gradually withdrawing from the stage, while voice interaction and somatosensory interaction are becoming mainstream. [0003] The voice interactive method requires the controller to continuously express their needs, but the resolution of the demand is not determined by the controller, which has certain restrictions, and in public places, it is also difficult to capture the controller's voice correctly and effectively . Although simple motion interaction ...

AI Technical Summary

Problems solved by technology

[0002] At present, the methods of large screen interaction are mainly based on touch, laser array, remote control or voice interactive methods. With the continuous improvement of screen technology, the definition and size of large screens are also rising. For super large screens, Touch interaction and laser array interaction can no longer meet the requirements and are gradually withdrawing from the stage, while voice interaction and somatosensory interaction are becoming mainstream

[0003] The voice interactive method requires the controller to continuously express their needs, but the resolution of the demand is not determined by the controller, which has certain restrictions, and in public places, it is also difficult to capture the controller's voice correctly and effectively

Although simple motion interaction can achieve better control effects, such as somatosensory games, somatosensory interaction has certain requirements for the physical strength of the controller, and it is difficult to achieve long-term control

Images