Human body intention recognition method and system and storage medium

Abstract

The invention discloses a human body intention recognition method. The method comprises the steps of collecting a feature signal of a current human body in real time; generating multi-source data features corresponding to the current human body and fixation point coordinates selected by eyes based on the feature signals; recognizing the multi-source data features and fixation point coordinates selected by eyes, and generating voice texts corresponding to the multi-source data features and scene image description texts corresponding to the fixation point coordinates; performing entity extraction on the voice text and the scene image description text to generate entity fragments corresponding to the voice text and the scene image description text; processing the entity segment by adopting aco-exponential resolution algorithm to generate a target object; and generating a human body intention recognition result based on the voice text, the scene image description text and the target object. Therefore, by adopting the embodiment of the invention, the recognition result is obtained after the mouth-eye cooperative interaction information of the specific scene is processed, so that the accuracy of recognizing the human body intention by the machine is improved.

Description

technical field [0001] The present invention relates to the technical field of artificial intelligence, in particular to a human body intention recognition method, system and storage medium. Background technique [0002] In recent years, with the rapid development of new wearable sensing technology and artificial intelligence technology, a large number of scholars and research institutions have emerged to conduct research on human-computer natural interaction such as voice and eye movement based on physiological interaction media such as eyes and mouth. In fact, the interaction between people is a process of word and eye coordination, and the complementary characteristics of multi-media information make the semantic expression between people more efficient and smooth. [0003] In the prior art, the interaction between a person and an operating device (such as a head-mounted display device, a computer, a mobile phone, and other living devices) is mainly through manual interac...

AI Technical Summary

Problems solved by technology

Due to the low intelligence of this interaction method, it wastes time, thus reducing the efficiency of human-computer interaction

Images