High-quality man-machine interaction method and device based on attitude matching

Abstract

The invention discloses a high-quality man-machine interaction method and device based on posture matching. The method comprises the following steps: establishing a man-machine interaction attitude library of a mixed reality cockpit environment, and obtaining camera space pose information through camera space calibration operation; according to the camera space pose information, six-degree-of-freedom information of a rigid body of the wrist of the user is calculated through a phase motor capture system, and geometric feature information of the hand of the user is determined; calculating position information of a fingertip area in a preset coordinate system according to the six-degree-of-freedom information of the rigid body of the wrist of the user and the geometric feature information of the hand of the user; and performing interaction state judgment on the collision detection bounding box according to the position information. The method solves the problems that in the prior art, mutual data set collection is not always continuous interaction action behaviors, the data set does not drive the human body to move, if the data set drives the digital human body to move, the search difficulty of a certain specific interaction posture is increased, and the data set does not drive the human body to move. And the continuity of human body movement in time and space cannot be ensured.

Description

technical field [0001] The present invention proposes a high-quality human-computer interaction method suitable for mixed reality cockpit scenes, which matches the action behavior of real human hands based on the existing gestures in the hand motion gesture database, so as to be driven by real motion capture data or artificial synthetic data The digital human moves, interacts, improves the precision of human-computer interaction, and enhances the natural performance ability. The invention belongs to the technical field of virtual reality and mixed reality. Background technique [0002] With the continuous development of intelligent technology, more and more intelligent equipment is used in people's life, work and study. The use of intelligent technology has improved the quality of people's life and increased the efficiency of people's study and work. [0003] MR technology is applied to the evaluation of aircraft cockpit scheme: Mixed reality (Mix Reality, MR for short) is ...

AI Technical Summary

Problems solved by technology

[0010] Embodiments of the present invention provide a high-quality human-computer interaction method and device based on posture matching, to at least solve the problem of not necessarily continuous interactive action behaviors in the collection of mutual data sets in the prior art, and the role of the data set is not to drive Human movement, if this data set is used to drive digital human movement, it will not only increase the difficulty of searching for a specific interactive posture, but also cannot guarantee the continuity of human movement in time and space.

Images