Image processing method and device, electronic device and storage medium

Abstract

The embodiment of the invention discloses an image processing method and device, an electronic device and a storage medium, and the method comprises the steps: obtaining a first image frame sequence which comprises a to-be-processed image frame and at least one adjacent image frame adjacent to the to-be-processed image frame; performing image alignment operation on the to-be-processed image frameand each adjacent image frame to obtain alignment feature data of each adjacent image frame; and performing feature compensation operation on the alignment feature data of each adjacent image frame based on the to-be-processed image to obtain compensated alignment feature data of each adjacent image frame, and determining a processed image frame corresponding to the to-be-processed image frame based on the compensated alignment feature data. In the embodiment of the invention, after the preliminary image alignment operation is carried out on the multiple image frames, the feature compensationoperation is carried out on the image frames after the preliminary image alignment operation is carried out, so that the image alignment and fusion quality is effectively improved.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to an image processing method and device, electronic equipment and storage media. Background technique [0002] Video super-resolution is the process of recovering high-resolution output frames from a series of low-resolution input video frames. This process is pathological, because many details have been lost in the low-resolution frame sequence, which cannot be recovered during the super-resolution process. [0003] The current video super-resolution process often includes four steps, feature extraction, multi-frame alignment, multi-frame fusion, and reconstruction. Among them, multi-frame alignment and multi-frame fusion are the key points of video restoration technology. In terms of multi-frame alignment and multi-frame fusion, the warp method is mainly used to align other frames respectively, and then perform fusion. Alignment tends to go wrong when the input fra...

AI Technical Summary

Problems solved by technology

Alignment tends to go wrong when the input frame has occlusions, excessive motion, and blur

In this regard, the current solution is to use additionally learned image optical flow to assist alignment, but the additional optical flow model leads to a significant increase in the amount of calculation

This method uses multiple sets of optical flow to increase the complexity and training stability of the model, thus affecting the effect of super-resolution

Images