The invention discloses a
massage manipulation recognition method based on
deep learning, and the method comprises the steps: collecting the force distribution and force size information of a hand during
massage through a flexible touch sensor, extracting the manipulation features through a neural network, and achieving the recognition of a
massage manipulation. A variational auto-
encoder is adopted to realize data enhancement; extracting key frames of input data by using a
frame difference method, and removing input redundant frames; extracting and training
spatial domain and
time domain features of the massage
dot matrix thermodynamic diagram group through a two-dimensional
convolutional neural network and a
recurrent neural network; a frame attention mechanism is introduced after the
convolutional neural network, and the massage manipulation recognition precision of the network is improved. According to the invention, the original sensor data is expanded without increasing the
data acquisition cost; key frames of graph group data are extracted, the network
overfitting phenomenon is reduced, and the network generalization ability is improved; the neural network extracts
time domain information between the video frames to obtain
time domain features of the massage manipulation; and by introducing a frame attention mechanism, the recognition precision is effectively improved.