Multi-domain fusion micro-expression detection method based on motion unit

Abstract

The invention relates to a multi-domain fusion micro-expression detection method based on a motion unit, and the method comprises the steps: (1) carrying out the preprocessing of a micro-expression video: obtaining a video frame sequence, carrying out the face detection and positioning, and carrying out the face alignment; (2) performing motion unit detection on the video frame sequence to obtainmotion unit information of the video frame sequence; (3) according to the motion unit information, finding out a facial motion unit sub-block containing the maximum micro-expression motion unit information amount ME as a micro-expression detection area through a semi-decision algorithm, and meanwhile, extracting a plurality of peak frames of the micro-expression motion unit information amount ME as reference climax frames of micro-expression detection by setting a dynamic threshold value; and (4) realizing micro-expression detection through a multi-domain fusion micro-expression detection method. According to the method, the influence of redundant information on micro-expression detection is reduced, the calculated amount is reduced, and the micro-expression detection has higher comprehensive discrimination capability. The calculation speed is high, and the micro-expression detection precision is high.

Description

technical field [0001] The invention relates to a motion unit-based multi-domain fusion micro-expression detection method, which belongs to the technical field of pattern recognition. Background technique [0002] As a typical form of nonverbal communication, facial expressions play an important role in human emotion analysis and have been extensively studied in various fields. Among them, people hide or suppress real facial expressions in some situations, and micro-expressions will be generated accordingly. The typical duration of micro-expression is 0.065 to 0.5 seconds. It is an unconscious, fast and partial facial expression. Unlike macro-expression, it can not be deliberately controlled by people's thinking. It can usually reveal the true emotion that people want to hide. Micro-expression research has great application value and broad development prospects in various fields such as crime detection and business negotiation. [0003] The essence of micro-expression dete...

AI Technical Summary

Problems solved by technology

[0007] However, these methods still have some shortcomings: they often only consider the dynamic features of pixels in the facial image (such as optical flow features) or only consider texture features (such as LBP, HOG features, etc.), but both methods have limitations. characteristics; the feature calculation is complex, and the calculation speed is relatively slow; the micro-expression detection effect is average

Images