Emotion comforting method and system based on GRU and mobile terminal

Abstract

An emotion comforting method and system based on a GRU and a mobile terminal belong to the technical field of intelligent equipment, and the method comprise the following steps: inputting facial expressions and sounds into a system, and training received data, so as to identify what emotion a user is in; according to the recognized emotion, enabling the terminal to make a preset comforting action;enabling the mobile terminal to record information such as emotional adjustment occurrence time, an adjustment mode and adjustment duration of the user each time; substituting the obtained information into a GRU network for re-learning; and periodically generating data reports. The invention has the beneficial effects that the GRUs in the double-layer secondary direction are adopted to simulate human auditory and visual processing paths to process emotion information of voice and facial expressions; the GRUs can solve the problems of gradient disappearance and explosion during RNN modeling; the training time is shorter than LSTM training time, and the number of overfitting problems is smaller. after an attention mechanism is introduced, the influence weight of important time sequence features can be improved, non-important time sequence features are inhibited, and the classification effect of the model is improved.

Description

Technical field [0001] The present invention belongs to the technical field of intelligent equipment, and more particularly to an emotional comfort method and system based on GRU-based sound and image recognition. Background technique [0002] With the development of society, the rhythm of people's lives is getting faster and faster. Usually sad emotions are increasingly pouring, the current expression identification application area is very broad, but it is very small to use in humans. The tragedy of psychological factors is endless, especially in the student population. [0003] People are universally carrying mobile terminals, and the time of using mobile terminals is also growing year by year, and interaction between mobile terminals has become the main way of people's expressions and venting emotions. Inventive content [0004] In order to solve the above technical problems, the present invention proposes a GRU-based emotional comfort method, system and mobile terminal, usi...

AI Technical Summary

Problems solved by technology

Usually sad emotions are becoming more and more difficult to pour out. Although the application fields of facial expression recognition are very wide, they are rarely directly applied to human emotions.

Images