Video frame insertion method and device, equipment and medium

A frame insertion and video technology, applied in the computer field, can solve the problems of long frame insertion time, cost, and reduced video frame insertion efficiency, etc., to achieve the effect of ensuring the frame insertion effect, improving the frame insertion efficiency, and improving the video frame insertion efficiency

Pending Publication Date: 2022-07-12
BEIJING BYTEDANCE NETWORK TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing frame interpolation method is to directly perform frame interpolation operation on the original resolution video frame, which often takes a long time for frame interpolation, thus reducing the efficiency of video frame interpolation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video frame insertion method and device, equipment and medium
  • Video frame insertion method and device, equipment and medium
  • Video frame insertion method and device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] figure 1 This is a flowchart of a method for video frame insertion provided in Embodiment 1 of the present disclosure. This embodiment can be applied to the case of performing frame insertion for every two adjacent frames in a video. The method can be performed by a video frame interpolation device, and the device can be implemented by software and / or hardware, and is integrated into a service electronic device. like figure 1 As shown, the method specifically includes the following steps:

[0037] S110. Acquire two adjacent frames in the target video.

[0038] Wherein, the target video may refer to a video that needs to be framed, so as to improve the fluency of the video. For example, the target video may refer to a slow motion video or the like. The two adjacent frames may refer to any two adjacent video frames in the target video, that is, the first frame and the second frame, so that a frame interpolation operation is performed between the first frame and the se...

Embodiment 2

[0063] image 3 This is a flowchart of a method for video frame insertion provided in Embodiment 2 of the present disclosure. This embodiment further optimizes the step of “determining target frame insertion corresponding to two adjacent frames based on the intermediate frame” on the basis of the above embodiments. The explanations of terms that are the same as or corresponding to the above embodiments are not repeated here.

[0064] see image 3 , the video frame insertion method provided by this embodiment specifically includes the following steps:

[0065] S310. Acquire two adjacent frames in the target video.

[0066] S320. Based on the preset sampling multiple, perform downsampling processing on the first frame and the second frame in the two adjacent frames, respectively, to obtain the first downsampling frame and the second downsampling frame.

[0067] S330. Based on the preset optical flow correction model, determine a first down-sampling optical flow graph correspo...

Embodiment 3

[0100] Figure 5 This is a schematic structural diagram of a device for video frame insertion provided in Embodiment 3 of the present disclosure. This embodiment can be applied to the case of performing frame insertion for every two adjacent frames in a video. like Figure 5 As shown, the apparatus specifically includes: an acquisition module 510 for two adjacent frames, a downsampling processing module 520 , a downsampling information determination module 530 , an upsampling processing module 540 and a target frame insertion determination module 550 .

[0101] Wherein, the acquisition module 510 for two adjacent frames is used to acquire two adjacent frames in the target video; the downsampling processing module 520 is used for respectively processing the first frame and the second frame in the adjacent two frames based on the preset sampling multiple. The frame is subjected to downsampling processing to obtain the first downsampling frame and the second downsampling frame; ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a video frame insertion method and device, equipment and a medium. The method comprises the following steps: acquiring two adjacent frames in a target video; respectively performing down-sampling processing on a first frame and a second frame in the two adjacent frames to obtain a first down-sampling frame and a second down-sampling frame; determining a first down-sampling optical flow diagram, a second down-sampling optical flow diagram and down-sampling correction information based on a preset optical flow correction model; performing up-sampling processing on the first down-sampling optical flow diagram, the second down-sampling optical flow diagram and the down-sampling correction information to obtain a first up-sampling optical flow diagram, a second up-sampling optical flow diagram and up-sampling correction information; and determining an intermediate frame between two adjacent frames according to the first frame, the second frame, the first up-sampling optical flow diagram, the second up-sampling optical flow diagram and the up-sampling correction information on the basis of a preset conversion integration model, and determining a target insertion frame corresponding to the two adjacent frames on the basis of the intermediate frame, thereby improving the video frame insertion efficiency on the premise of ensuring the frame insertion effect.

Description

technical field [0001] The embodiments of the present disclosure relate to computer technologies, and in particular, to a video frame insertion method, apparatus, device, and medium. Background technique [0002] With the rapid development of computer technology, the frame rate and fluency of the video can be improved by performing frame insertion operations on the video, so as to meet the user's high-quality requirements for the video. At present, video frame interpolation is usually performed based on optical flow, and an interpolated video frame between two adjacent frames is determined. However, in the existing frame interpolation method, the frame interpolation operation is directly performed on the video frames of the original resolution, which often requires a long frame interpolation time, thereby reducing the video frame interpolation efficiency. SUMMARY OF THE INVENTION [0003] Embodiments of the present disclosure provide a video frame insertion method, appara...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N19/132H04N19/587
CPCH04N19/132H04N19/587
Inventor 王庆徐天春赵世杰陈嘉麟张清源李军林
Owner BEIJING BYTEDANCE NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap