Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Night image enhancement method and system based on cyclic generative adversarial residual network and QTP loss item

An image enhancement and network technology, applied in the field of computer vision, can solve problems such as insufficient night enhancement effect, poor image blur quality, and loss of semantic information

Active Publication Date: 2021-11-05
EAST CHINA NORMAL UNIV
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 1. False color, poor quality of image blur; 2. The enhancement effect of the night is not enough; 3. The distortion of the image before and after enhancement leads to the loss of semantic information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Night image enhancement method and system based on cyclic generative adversarial residual network and QTP loss item
  • Night image enhancement method and system based on cyclic generative adversarial residual network and QTP loss item
  • Night image enhancement method and system based on cyclic generative adversarial residual network and QTP loss item

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] In conjunction with the following specific embodiments and accompanying drawings, the invention will be further described in detail. The process, conditions, experimental methods, etc. for implementing the present invention, except for the content specifically mentioned below, are common knowledge and common knowledge in this field, and the present invention has no special limitation content.

[0057] The present invention comprises the following concrete steps:

[0058] Step 1: Obtain the night scene image and the corresponding daytime scene image, divide the data set, and divide the data set into a test set and a training set according to the ratio of the number of test sets to the number of training sets at 1:30. Then perform data pre-operations: cropping the image, scaling the size of the image (the size of the cropped image and the size of the zoomed image need to be a multiple of 4, the specific size depends on the actual graphics card memory), image rotation and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a night image enhancement method based on a cyclic generative adversarial residual network and QTP loss items, and respectively improves problems faced by an unsupervised night image enhancement task through loss items of three dimensions of QTP. According to the invention, mixed loss comprises the loss items of the cyclic adversarial network, and three added parts, namely quality loss, task loss and perception loss, wherein the quality part solves a blurred image or false color problem by enhancing similarity between a reference image and an enhancement result quality score; the task part solves a problem of an insufficient enhancement effect from a perspective of constraining an enhancement result to have a higher daytime probability, namely, maximizing the daytime probability; and the perception part limits missing semantic information after domain transformation through a method of keeping Fourier phase spectrum of images before and after night enhancement to be consistent, and ensures content consistency of a night image and an enhanced image. In addition, a learnable and more ideal night image enhancement model is obtained by fusing new loss functions.

Description

technical field [0001] The present invention relates to the technical field of computer vision, deep learning and generative confrontational neural network, specifically a kind of dark night image enhancement method in the field of unsupervised real scene based on cyclic generative confrontational residual network and QTP loss item and its application in image processing Applications. Background technique [0002] With the rapid development of science and technology, computer vision technology is entering every aspect of people's life. For example, automatic driving, detection and recognition of scene cameras, auxiliary reversing images, etc. However, in the task examples mentioned above, the performance of computer vision technology is often better in an environment with sufficient light. Once it is applied in a poor light or even dark environment, the accuracy and performance of these visual tasks will drop significantly. The reason is that the visibility of the dark nig...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/50G06T5/10G06N3/04G06N3/08
CPCG06T5/50G06T5/10G06N3/08G06T2207/20056G06T2207/20081G06T2207/20084G06T2207/30168G06N3/047G06N3/045
Inventor 邱崧郭皓明徐伟陈昕苑孙力李庆利丰颖
Owner EAST CHINA NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products