Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image fusion method and system based on generative adversarial network, and storage medium

An image fusion and network technology, applied in the field of image processing, can solve problems such as loss of input image information, limited pathological slice image size, inaccurate fusion decision mapping, etc., to achieve the effect of reducing time cost and hardware cost

Pending Publication Date: 2020-10-09
怀光智能科技(武汉)有限公司
View PDF0 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Traditional fusion algorithms based on transform domain and space domain can obtain high-quality fused images, but they still may lose some information of input images due to inaccurate fusion decision mapping
In recent years, with the large-scale application of convolutional neural networks in the field of image processing, more and more people have used convolutional neural networks in the field of image fusion, developed image fusion algorithms based on deep learning, and improved the effect of fusion. However, limited by the size of pathological slice images (on the order of billions to tens of billions of pixels), using traditional image fusion algorithms or existing fusion algorithms based on deep learning to fuse multi-focus slice images requires hardware cost and time efficiency. exist challenges

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image fusion method and system based on generative adversarial network, and storage medium
  • Image fusion method and system based on generative adversarial network, and storage medium
  • Image fusion method and system based on generative adversarial network, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0038] The image fusion method based on the generative confrontation network provided by the present invention is not only applicable to cytopathological slices, but also applicable to other cytopathological slice data and natural landscape images under the premise of establishing a suitable data set. The present invention will be described below by taking the image fusion of pathological slices...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image fusion method and system based on a generative adversarial network, and a storage medium. The method comprises the steps that a sample set is used for pre-training a fuzzy region recognition model, and a mask image of a fuzzy region marked by each image sample in the sample set is output, wherein the sample set comprises the image samples and a fusion image label Ir; multi-channel images formed by stacking the image samples and the corresponding mask images are input into a fusion model to be trained, wherein the fusion model comprises a generator and a discriminator; a fusion image If output by the generator and a fusion image label Ir are input into the discriminator to be subjected to adversarial training; and a to-be-fused image is input into the trained fuzzy region recognition model and the fusion model to generate a fused image. According to the invention, image fusion can be realized only by collecting a few multi-focus images, the time cost andhardware cost of image fusion can be effectively reduced, and the method is especially suitable for fusion of super-large pathological section images.

Description

technical field [0001] The invention belongs to the technical field of image processing, and more specifically relates to an image fusion method, system and storage medium based on a generative confrontation network. Background technique [0002] The purpose of image fusion is to fuse multiple input images into one fusion image. Compared with any single input image, the fusion image can provide more information for human or machine perception, including more information and clearer images. Fusion images are beneficial to the further processing of cervical cancer cell pathological sections. At present, under the optical microscope imaging system of cervical cancer cell pathological sections, by setting the focal length of the optical lens, only objects within the depth of field are clearly visible in the image, and other places are generally blurred. Therefore, in order to obtain a larger depth of field The image, usually adjust the focal length to shoot multiple images for ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/50G06T7/136G06T7/194G06T7/90G06N3/04G06N3/08
CPCG06T5/50G06T7/136G06T7/194G06T7/90G06N3/08G06T2207/20221G06T2207/10061G06T2207/30024G06T2207/20081G06T2207/20084G06T2207/30204G06T2207/10024G06N3/048G06N3/044G06N3/045
Inventor 曾绍群余江胜程胜华刘秀丽耿协博
Owner 怀光智能科技(武汉)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products