The invention discloses a facial expression recognition method based on a video image sequence, and relates to the field of face recognition. The method includes the following steps of (1) identity verification, wherein an image is captured from a video, user information in the video is obtained, then identity verification is carried out by comparing the user information with a facial training sample, and a user expression library is determined; (2) expression recognition, wherein texture feature extraction is carried out on the video, a key frame produced when the degree of a user expression is maximized is obtained, an image of the key frame is compared with the expression training sample in the user expression library determined in the step (1) to achieve the aim of recognizing the expression, and ultimately a statistic result of expression recognition is output. By means of texture characteristics, the key frame obtained in the video is analyzed, the user expression library is built so that the user expression can be recognized, interference can be effectively prohibited, calculation complexity is reduced and the recognition rate is improved.