Emotion comforting method and system based on GRU and mobile terminal

A mobile terminal and emotional technology, applied in the direction of neural learning methods, program loading/starting, program control design, etc., can solve the problems of human beings

Pending Publication Date: 2021-03-12
JIANGSU UNIV OF SCI & TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Usually sad emotions are becoming more and more difficult to pour out. Although the application fi...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Emotion comforting method and system based on GRU and mobile terminal
  • Emotion comforting method and system based on GRU and mobile terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] Next, the technical solutions in the embodiments of the present invention will be apparent from the embodiment of the present invention, and it is clearly described, and it is understood that the described embodiments are merely embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, there are all other embodiments obtained without making creative labor without making creative labor premises.

[0040] The present invention provides a GRU-based emotional comfort method including the following steps:

[0041] Step 1. In the system of the people's facial expression and sound, put the collected pictures and sound data to the GRU network algorithm for training, so that the identification user is in.

[0042] Step 2, according to the identified user emotions, the terminal makes a preset comfort;

[0043] Step 3, the mobile terminal records the time of each emotional adjustment of the user, and adjusts the mode of emotio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An emotion comforting method and system based on a GRU and a mobile terminal belong to the technical field of intelligent equipment, and the method comprise the following steps: inputting facial expressions and sounds into a system, and training received data, so as to identify what emotion a user is in; according to the recognized emotion, enabling the terminal to make a preset comforting action;enabling the mobile terminal to record information such as emotional adjustment occurrence time, an adjustment mode and adjustment duration of the user each time; substituting the obtained information into a GRU network for re-learning; and periodically generating data reports. The invention has the beneficial effects that the GRUs in the double-layer secondary direction are adopted to simulate human auditory and visual processing paths to process emotion information of voice and facial expressions; the GRUs can solve the problems of gradient disappearance and explosion during RNN modeling; the training time is shorter than LSTM training time, and the number of overfitting problems is smaller. after an attention mechanism is introduced, the influence weight of important time sequence features can be improved, non-important time sequence features are inhibited, and the classification effect of the model is improved.

Description

Technical field [0001] The present invention belongs to the technical field of intelligent equipment, and more particularly to an emotional comfort method and system based on GRU-based sound and image recognition. Background technique [0002] With the development of society, the rhythm of people's lives is getting faster and faster. Usually sad emotions are increasingly pouring, the current expression identification application area is very broad, but it is very small to use in humans. The tragedy of psychological factors is endless, especially in the student population. [0003] People are universally carrying mobile terminals, and the time of using mobile terminals is also growing year by year, and interaction between mobile terminals has become the main way of people's expressions and venting emotions. Inventive content [0004] In order to solve the above technical problems, the present invention proposes a GRU-based emotional comfort method, system and mobile terminal, usi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06K9/00G06F9/445G06N3/08G06N3/04
CPCG06F9/44505G06N3/08G06V40/174G06N3/045G06F18/24G06F18/253G06F18/214
Inventor 姜文刚谢虹
Owner JIANGSU UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products