Conditional generative adversarial-based three-dimensional model fuzzy texture feature saliency method

A conditional generation, three-dimensional model technology, applied in biological neural network models, neural learning methods, 3D modeling, etc., can solve the problems of blurred texture boundaries, blurred boundary textures, limited input data clarity, etc., to improve the degree of fidelity , the effect of reducing computation time

Pending Publication Date: 2022-03-01
扬州大学江都高端装备工程技术研究所
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The disadvantage is that the boundary information of the generated model is not processed, and there is blurring at the boundary of the generated texture
The disadvantage is that the texture is updated by replacing the fusion fixed operation, the result is limited by the clarity of the input data, and the boundary texture blurring cannot be fully processed
[0007] To sum up, the existing 3D reconstruction methods have a certain blurring phenomenon in the generated texture boundary, which makes the fidelity of 3D reconstruction have certain defects.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Conditional generative adversarial-based three-dimensional model fuzzy texture feature saliency method
  • Conditional generative adversarial-based three-dimensional model fuzzy texture feature saliency method
  • Conditional generative adversarial-based three-dimensional model fuzzy texture feature saliency method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Such as figure 1 A saliency method for 3D model fuzzy texture features based on conditional generation confrontation is shown, including the following steps:

[0029] Step 1) generate the shape and texture of the three-dimensional geometric model, and obtain the point cloud features of the three-dimensional geometric model;

[0030] First, input the image to HMR (Human Mesh Recovery) and predict the SMPL (Skinned Multi-Person Linear Model) parameters, where HMR uses an iterative 3D regression module to generate shape, pose and translation parameters for SMPL, and the estimated 3D grid m of the input image Expressed as: m=M(β,θ,γ), secondly, use U-Net to generate textures, and use Opendr to render tensors, map the generated textures to 3D grids, use the UV correspondence provided by SMPL and Opendr's The rendering function R(m,t) assigns pixels to the surface of the 3D geometric model, and at the same time uses linear interpolation to fill the gaps, and finally obtains ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a three-dimensional model fuzzy texture feature salification method based on conditional generative adversarial, and the method comprises the following steps: 1), generating the shape and texture of a three-dimensional geometric model, and obtaining the point cloud features of the three-dimensional geometric model; 2) extracting a fuzzy boundary point cloud; and 3) feature saliency of the fuzzy boundary based on the conditional generative adversarial network. According to the method, based on multi-scale voxelization fuzzy boundary frame selection, textures are generated through the conditional generative adversarial network for mapping, the extracted voxel blocks are embedded into the three-dimensional geometric model, global texture fidelity of the geometric model is achieved through a multi-scale voxel segmentation mode, global texture optimization is changed into local texture optimization, and the calculation amount is reduced.

Description

technical field [0001] The invention relates to the field of three-dimensional geometric model reconstruction, in particular to a three-dimensional model fuzzy texture feature salient method based on conditional generation confrontation. Background technique [0002] In the existing 3D geometric model reconstruction technology, the step of model fidelity is usually involved, and the reconstructed 3D geometric model only has shape information. Therefore, after the 3D geometric shape reconstruction, it is usually necessary to supplement the texture information on the basis of the geometric shape model. In order to make the whole 3D geometric model have a more realistic visual effect [0003] In 2019, Wang et al. from the University of Chinese Academy of Sciences proposed a re-identification method for supervised texture generation (Wang J, Zhong Y, Li Y, et al.Re-Identification Supervised Texture Generation[C] / / 2019IEEE / CVF Conference on Computer Vision and Pattern Recognitio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/20G06T15/04G06N3/04G06N3/08
CPCG06T17/20G06T15/04G06N3/08G06T2200/04G06N3/045
Inventor 孙进马昊天雷震霆梁立谢文涛周威
Owner 扬州大学江都高端装备工程技术研究所
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products