Data processing method for realizing multi-modal interaction and multi-modal interaction system

Abstract

The invention discloses a data processing method for realizing multi-modal interaction and a multi-modal interaction system. The method comprises the following steps: receiving multi-modal input data and pre-processing the multi-modal input data; respectively analyzing the pre-processed multi-modal input data by utilizing an emotion engine, a thought engine and a self-learning engine; carrying out comprehensive decision on the basis of the analysis results so as to obtain decision data; outputting a multi-modal interaction result according to the decision data. According to the method, the intelligence of robot systems can be enhanced, the robot systems are enabled to have growth and humanization, and the man-machine interaction experience is greatly improved.

Description

technical field [0001] The invention relates to the field of intelligent robots, in particular to a data processing method and a multimodal interaction system for realizing multimodal interaction. Background technique [0002] With the development of robot technology, intelligent robot products have increasingly penetrated into all aspects of people's lives. Robots are not only used to help users complete specified tasks efficiently, but are also required to be designed as partners that can interact with users in multimodal languages, actions, and emotions. [0003] Existing robot interaction systems are generally very rigid, with very weak intelligence, and may not even have intelligence. This type of robot system can usually only complete actions according to preset instructions. When interacting with users, the robot relies on the interactive components of the system to trigger instructions. The interaction mode is single, or it cannot perform multi-modal interaction. A...

AI Technical Summary

Problems solved by technology

[0003] Existing robot interaction systems are generally very rigid, with very weak intelligence, and may not even have intelligence

This type of robot system can usually only complete actions according to pre-set instructions. When interacting with users, the robot relies on the interactive components of the system to trigger instructions. The interaction mode is single, or it cannot perform multi-modal interaction.

At the same time, this type of robot system cannot acquire new knowledge through the interaction process with the user, cannot rely on itself to grow and lacks humanization

Images