A Face-Based Video Annotation Method and Video Retrieval Method

Abstract

The invention provides a face-based video labeling method and a face-based video retrieving method. The labeling method comprises the following steps that: a face image and corresponding face features in a video to be labels are extracted, and the face features and attribute information of the face features are merged to obtain face metadata; all of the face features obtained in a video file to be labeled are subjected to automatic feature clustering, then, feature types are subjected to feature screening and feature recalling, and a feature type set P<2> and a non-classified feature set Q<2> are obtained; for each element in the P<2>, the affiliated feature type recommendation is carried out, and manual confirmation is carried out; for each element in the Q<2>, the non-classified face feature recommendation is carried out, and the manual confirmation is carried out; the feature types and the non-classified features are subjected to name labeling; and the labeled feature type and non-classified face feature information are used for forming a video labeling file of the video file. In the video labeling process, the program automatic recommendation is combined with the manual confirmation, so that the accuracy of the result is ensured, and the efficiency is also improved.

Description

technical field [0001] The invention belongs to the technical field of video cataloging, and in particular relates to a face-based video tagging method and a video retrieval method. Background technique [0002] Face-based video annotation refers to extracting and annotating the faces contained in the video, annotating all the faces in the video and organizing them into annotation files for easy retrieval and reuse. [0003] Existing patents related to face-based video tagging methods mainly include video cataloging methods based on face recognition or face clustering. For example, the patent application with application number 201110453762.3 discloses an automatic cataloging method based on face recognition technology The method specifically includes: receiving a human face material library; receiving a multimedia file; obtaining a key frame record and a corresponding key frame data picture according to the video file; obtaining a key frame human face picture according to t...

AI Technical Summary

Problems solved by technology

[0005] (1) The face sample library needs to be established in advance: this method needs to establish and maintain a key person sample library in advance, prefabricate the face samples of interested people in the person sample library, and use the face sample library to perform face annotation on the video ; (2) Only supports marking key figures: this method can only identify key figures in the sample library, resulting in the loss of most other figures

Images