Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Training method and device of video processing model and video processing method and device

A technology of video processing and training method, applied in the field of video processing, can solve the problem of increasing the cost of service resources, and achieve the effect of reducing the amount of calculation, reducing the total number of network layers, and reducing repeated calculations

Pending Publication Date: 2021-07-20
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present disclosure provides a video processing model training method and device, and a video processing method and device to solve the problem of inter-frame redundancy between images of video data, resulting in a large number of near-repetitive calculations in video processing, which greatly reduces the cost of service resources. additional questions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Training method and device of video processing model and video processing method and device
  • Training method and device of video processing model and video processing method and device
  • Training method and device of video processing model and video processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0069] It should be noted that the terms "first" and "second" in the specification and claims of the present disclosure and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a video processing model training method and device and a video processing method and device, and the method comprises the steps: inputting each frame of image of sample video data into a preset single-frame model, and obtaining a first recognition result of a target object in each frame of image outputted by each network layer; according to the time sequence of the images in the sample video data, inputting each frame of image into a to-be-trained time sequence model to obtain a second recognition result of the target object in each frame of image output by each network layer; comparing the first recognition result and the second recognition result of each frame of image output by each network layer, and determining the total loss value of the time sequence model recognition image; if it is determined that the time sequence model converges based on the total loss value, ending training. By applying the technical scheme provided by the embodiment of the invention, the problem that the cost of service resources is greatly increased due to the fact that a large amount of approximately repeated calculation is carried out on video processing because inter-frame redundancy exists between the images of the video data is solved.

Description

technical field [0001] The present disclosure relates to the technical field of video processing, in particular to a video processing model training method and device, and a video processing method and device. Background technique [0002] In the video processing scenario, many intelligent applications need to deploy a deep neural network model on the server or mobile terminal, and use the deep neural network model to output a result for each frame of video data. For example, when using magic expression special effects, it is necessary to use the deep neural network model to obtain the key points of the face on each frame of video data; when using the background blur special effect, it is necessary to use the deep neural network model to obtain each The segmentation mask (mask) of the foreground and background of the person on the frame image; when performing adaptive video coding and compression, it is necessary to use a deep neural network model to obtain the mask of the s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/08G06N3/04
CPCG06N3/08G06N3/045G06F18/217G06F18/22G06F18/214Y02T10/40
Inventor 王华彦陈昕
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com