Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Sketch-based interactive iteration type virtual shoeprint image generation method

An image generation and shoe print technology, which is applied in image enhancement, image analysis, image data processing, etc., can solve problems such as difficult extraction of shoe print images, only applicable models, and smooth generated images, so as to improve the loss function and improve the fitting Ability, the effect of improving the ability to judge

Pending Publication Date: 2021-06-18
DALIAN MARITIME UNIVERSITY
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Isola et al. proposed a conditional generation network model with supervised training, but this model is only suitable for dense images, and the generation effect of sparse images such as input sketches is not satisfactory.
[0003] Whether it is the traditional sketch-based image generation algorithm or the deep learning sketch-based image generation algorithm, it has good generation ability for complex and complete sketches, but it cannot produce good generation results for too simple and sparse sketches. , the main reason is that there are too few areas that can be used in a picture, and the content information and texture information are seriously insufficient, which cannot satisfy the inference ability and learning ability of the algorithm, so the generated image will be too smooth to satisfy the subjective feeling of the human eye. , inaccurate matching, inconsistent textures, lack of detail information, etc.
Especially for shoe print images, the sole pattern has rich line and texture information, and it is particularly cumbersome to draw, so it is urgent to give an algorithm that can generate a complete shoe print image with the simplest sketch
[0004] In the on-site shoe print images, the background is often too complex and the shoe print images are difficult to extract.
This greatly reduces the usefulness of the evidence

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sketch-based interactive iteration type virtual shoeprint image generation method
  • Sketch-based interactive iteration type virtual shoeprint image generation method
  • Sketch-based interactive iteration type virtual shoeprint image generation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0097] figure 2 It is a multi-level fusion of hole residuals and fully convolutional shoe print image generation network, in which the solid line part is the multi-scale hole convolution fusion module, and the dotted line part is the hole convolution residual multi-level fusion module, and the solid line represents the convolution. K represents the span, d represents the dilation rate, Conv3 represents the convolution kernel size is 3×3, and the Conv number represents the number of convolution kernels. For example, Conv3, 512 in the figure, K=1, d=2, means that the convolution kernel size of the convolution layer is 3×3, the number of convolution kernels is 512, the span is 1, and the expansion coefficient is 2. The dotted connection line represents Concat, the dotted connection line represents deconvolution, and ConvT3 represents deconvolution with a convolution kernel size of 3×3.

Embodiment 2

[0099] image 3 It is a fully convolutional deep and shallow layer feature fusion shoeprint image discrimination network, where the solid line part represents the deep and shallow layer expansion convolution feature fusion module, and the dotted line part is the span convolution downsampling module. The solid connection line represents convolution, K represents the span, d represents the dilation rate, Conv3 represents the convolution kernel size is 3×3, and the Conv number represents the number of convolution kernels. For example, Conv3 in the figure, 256, K=1, d=2, means that the convolution kernel size of the convolution layer is 3×3, the number of convolution kernels is 256, the span is 1, and the expansion coefficient is 2. Dotted lines represent concatenation (Concat).

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a sketch-based interactive iteration type virtual shoeprint image generation method. The method comprises the following steps: constructing an overall network architecture; wherein the overall network framework comprises a hole residual multi-level fusion full-convolution shoeprint image generation network, a full-convolution deep and shallow feature fusion shoeprint image discrimination network and a VGG19 pre-trained on an Image Net; performing offline model training on the constructed overall network; and generating an online virtual shoeprint image based on the offline trained model. According to the method, the shoeprint sketch is used to realize the generation of the shoeprint image, and the problems that the background is complex and the field shoeprint image is difficult to extract, which cannot be solved by the existing traditional image restoration algorithm and deep learning, are solved. The criminal investigation personnel are assisted to utilize crime scene information as much as possible to carry out case detection, and the case solving efficiency is improved.

Description

technical field [0001] The invention relates to the technical field, in particular to a sketch-based interactive iterative virtual shoe print image generation method. Background technique [0002] At present, sketch-based image generation is mainly divided into two categories. The first category is based on traditional image correlation algorithms. The second category is the image generation algorithm based on deep learning. The specific content of each method is as follows: (1) The traditional image sketch generation algorithm adopts the method of search fusion, first searches the image blocks related to the sketch from the large-scale image database, and then fuses the image blocks. (2) In recent years, with the development of deep learning, generative adversarial networks have been increasingly applied to image generation. Isola et al. proposed a conditional generative network model with supervised training, but this model is only suitable for dense images, and the eff...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T11/60G06T5/30G06N3/04
CPCG06T11/60G06T5/30G06T2207/20081G06T2207/20084G06T2207/20221G06N3/045
Inventor 王新年姜浩段硕古王琳
Owner DALIAN MARITIME UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products