Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Defect detection semantic segmentation model modeling method and device, medium and equipment

A technology of semantic segmentation and model modeling, applied in neural learning methods, biological neural network models, character and pattern recognition, etc., can solve problems such as low accuracy rate and poor segmentation accuracy, and achieve sufficient features, good model prediction accuracy, The effect of improving the detection rate and segmentation accuracy

Active Publication Date: 2020-08-07
SEIZET TECH SHEN ZHEN CO LTD
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the feature vector extracted from the image of the defect area is similar to the dimension of the feature vector extracted from the adjacent image, the accuracy of defect segmentation is relatively poor, resulting in a low accuracy rate of defect detection.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Defect detection semantic segmentation model modeling method and device, medium and equipment
  • Defect detection semantic segmentation model modeling method and device, medium and equipment
  • Defect detection semantic segmentation model modeling method and device, medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] Such as figure 1 As shown, the present application provides a semantic segmentation model modeling method for workpiece defect detection, including the following steps:

[0059] S1 acquires multiple sets of original workpiece point cloud data for training, and the workpiece is a workpiece containing a specified defect type;

[0060] S2 determines the defect composite image of each workpiece based on the original workpiece point cloud data;

[0061] S21 converts the original workpiece point cloud data into a two-dimensional depth map;

[0062] S22 Obtain the first gradient map Scale1 and the second gradient map Scale2 respectively based on the two-dimensional depth map;

[0063] S23 synthesizes a two-dimensional depth map, Scale1, and Scale2 based on the RGB three-channel color image to obtain a defect composite image;

[0064] S3 acquires the defect labeling Label image corresponding to the workpiece:

[0065] S4 Build a semantic segmentation model: set the initiali...

Embodiment 2

[0094] For the defect types of workpieces used for training, one or more types can be preset as required, and the model design can be customized to set the type and number of models, that is, to design a custom defect segmentation network. On the basis of Embodiment 1, this application continues to further design the semantic segmentation model. The deep learning semantic segmentation defect detection model built by this application includes a sequentially connected feature extraction network and feature prediction network;

[0095] The feature extraction network is used to predict the location of the defect area, which includes a feature extraction layer, a feature compression layer, a feature flattening layer, and a feature classification layer;

[0096] Feature extraction is performed on the image data according to the feature extraction layer, and a feature map of the image data is obtained;

[0097] Compress the feature map according to the feature compression layer and o...

Embodiment 3

[0135] On the basis of Embodiment 1 and / or Embodiment 2, corresponding to the above-mentioned training data, the application further limits the input of the semantic segmentation model, and also provides a defect detection method based on the semantic segmentation model. The image of the workpiece to be detected is preprocessed, that is, the input of the semantic segmentation model is the defect composite image of the workpiece to be detected, and after the preprocessing of the defect composite image of the workpiece to be detected, the pb file of the defect prediction model is called to realize the online prediction of the 3D defect of the workpiece And quantification, and the defect form is more intuitive, and better detection results are obtained.

[0136] Such as Figure 4 As shown, the defect detection method based on the semantic segmentation model shown in this embodiment obtains point cloud data of workpiece defects through line laser scanning, then obtains point cloud...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a workpiece defect detection semantic segmentation model modeling method. The method comprises the steps that: a plurality of groups of original workpiece point cloud data fortraining are acquired, and workpieces are workpieces containing specified defect types; the defect synthesis image of each workpiece is determined based on the original workpiece point cloud data; theoriginal workpiece point cloud data are converted into a two-dimensional depth map; a first gradient map Scale1 and a second gradient map Scale2 are acquired based on the two-dimensional depth map; the two-dimensional depth map, Scale1 and Scale2 are synthesized based on an RGB three-channel color image, so that a defect synthesis image can be obtained; a defect labeling Label image correspondingto each workpiece is acquired; a semantic segmentation model is constructed, and training is performed based on the multiple groups of workpiece defect synthesis images and the corresponding defect labeling Label images, semantic segmentation model parameters are iterated, so that a convergent semantic segmentation model can be obtained; and after semantic segmentation training is finished, modellayers and corresponding weights are solidified into pb files, and the pb files are exported as pb model files corresponding to the workpiece defect images, so that 3D defect segmentation precision and a detection rate can be effectively improved.

Description

technical field [0001] The invention relates to the technical field of defect detection on industrial sites, in particular to a defect detection semantic segmentation model modeling method, device, medium and equipment. Background technique [0002] In industrial scenarios, there are very strict requirements on the delivery indicators of product parts. These requirements provide a guarantee for the functional role of product parts after they leave the factory. In industrial scenarios, various mechanical, sound, light, and electrical complex environments and numerous processes may damage the appearance of product parts, making them defective product parts. [0003] At present, there are two main methods of product defect detection commonly adopted in the industry: (1) manual detection; (2) detection methods based on machine vision. Among them, manual detection has many shortcomings such as low efficiency, high cost, and manual fatigue; in mass industrial production, defect d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/34G06K9/46G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V10/267G06V10/44G06V10/56G06N3/045G06F18/2415
Inventor 梅爽宋瑞超赵青
Owner SEIZET TECH SHEN ZHEN CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products