Video label generation method and device and electronic equipment

A video labeling and video technology, applied in the field of image processing, can solve problems such as poor scalability, limited classification labels, low accuracy and recall rate, and achieve the effect of improving accuracy and recall rate and good scalability

Active Publication Date: 2020-11-20
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF6 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the limited classification labels that the image classification model can cover, this fine-grained video recognition method has low accuracy and recall, and poor scalability.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video label generation method and device and electronic equipment
  • Video label generation method and device and electronic equipment
  • Video label generation method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0019] The embodiment of the present application is aimed at the fine-grained video recognition method based on the image classification model in the related art. Since the classification labels that can be covered by the image classification model are limited, the accuracy and recall rate of the fine-grained video recognition are low, and the scalability is poor. pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video label generation method and device and electronic equipment, and relates to the technical field of image processing and the technical field of natural language processing. The specific implementation scheme comprises the steps of obtaining a to-be-processed target video; extracting a key video frame from the target video; obtaining candidate reference videos from areference video library, wherein the reference video library comprises a plurality of reference videos and text information corresponding to each reference video, and the similarity between at least one video frame in the candidate reference videos and the key video frame is larger than a first threshold value; and determining a label of the target video according to the text information corresponding to the candidate reference video. Therefore, through the artificial intelligence, especially the video label generation method based on deep learning, fine-grained identification of the target video does not need to be carried out by using an image classification model, so that the accuracy and recall rate of video fine-grained identification are improved, the reference video in the referencevideo library can be expanded at any time, and the expandability is good.

Description

technical field [0001] The present application relates to the technical field of image processing, in particular to the technical field of video image processing based on deep learning, and proposes a method, device and electronic equipment for generating video tags. Background technique [0002] Video fine-grained recognition refers to the recognition of the video to extract the text information related to the video, such as the video content, the name of the film and television drama, celebrity information, etc. included in the video. After that, the extracted text information can also be used as the label of the video , so as to facilitate video recommendation and video classification. [0003] In the related technology, the video is usually sampled to obtain multiple frames of images in the video, and the features corresponding to the multiple frames of images are fused, and then the image classification model is used to classify the video according to the fused features...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06F40/289G06F40/216
CPCG06F40/289G06F40/216G06V20/41G06V10/507G06V10/56G06F18/22
Inventor 任晖杨敏薛学通
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products