A method for generating video summaries and related devices

A technology for video summarization and video frames, applied in the computer field, can solve the problems of time-consuming and labor-intensive, labeling errors, affecting the efficiency and accuracy of video summarization, and achieve the effect of improving efficiency and accuracy and ensuring quality.

Active Publication Date: 2021-06-29
TENCENT TECH (SHENZHEN) CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the accuracy process of supervised video summary generation is affected by manual labeling, and the process of manual labeling is time-consuming and labor-intensive, prone to labeling errors, affecting the efficiency and accuracy of video summary generation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for generating video summaries and related devices
  • A method for generating video summaries and related devices
  • A method for generating video summaries and related devices

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0108] The embodiment of the present application provides a method for generating a video summary and a related device, which can be applied to a system or program including a video summary generation function in a terminal device. By acquiring a target video, wherein the target video includes a sequence of video frames, the video The frame sequence contains multiple video frames; then extract the image features of each video frame to generate an image feature sequence; and divide the video frame sequence into multiple target segment sequences to generate a paragraph feature sequence; further image feature sequence It is fused with the paragraph feature sequence to obtain the fusion feature; and then the reinforcement learning training is performed based on the fusion feature to generate a video summary. In this way, the unsupervised video summary generation process is realized. Due to the combination of image-level image features and depth-level paragraph features, the quality...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application discloses a method for generating video summaries and related devices, which are applied to artificial intelligence machine learning technology. By acquiring the target video; then extracting the image features of each video frame to generate an image feature sequence; and dividing the video frame sequence into multiple target segment sequences to generate a paragraph feature sequence; combining the image feature sequence and the paragraph feature sequence Fusion to obtain fusion features; and then reinforcement learning training based on fusion features to generate video summaries. In this way, the unsupervised video summary generation process is realized. Due to the combination of image-level image features and depth-level paragraph features, the quality of video summary generation is guaranteed, and the unsupervised video summary generation process does not require manual annotation, thereby improving Video summary Generated efficiency and accuracy.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a method for generating a video summary and related devices. Background technique [0002] With the rapid development of Internet technology, people's requirements for entertainment forms are getting higher and higher. For example, in the process of watching a video, a fast jump process based on a video abstract can be performed, thereby improving the experience of watching a video. [0003] Generally, a supervised video summarization process can be used for summarization generation, which requires manually annotated video sequences as training samples. First, image feature extraction is performed, then feature encoding is performed, and an extraction model is trained with labels to determine the probability that each image in the video sequence belongs to the summary, and then the video is reorganized to obtain the video summary. [0004] However, the accuracy proc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/049G06N3/08G06V20/46G06V20/41G06N3/045G06F18/213G06F18/2415G06F18/253
Inventor 闫桂霞王晓利王瑞琛
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap