Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Semi-supervised video target segmentation method

A target segmentation and semi-supervised technology, applied in the field of computer vision, to achieve fast accuracy, improve performance and segmentation speed

Pending Publication Date: 2020-11-20
BEIJING JIAOTONG UNIV
View PDF6 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The invention provides a semi-supervised video object segmentation method to solve the defects of the prior art problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semi-supervised video target segmentation method
  • Semi-supervised video target segmentation method
  • Semi-supervised video target segmentation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0050] figure 2 It is a schematic flow chart of a semi-supervised video object segmentation method of the present embodiment, referring to figure 2 , the method includes:

[0051] S1 preprocesses the video image to obtain the image of the current frame and the image of the first frame, and gives the segmentation map of the first frame.

[0052] S2 constructs a semi-supervised video target segmentation network model, which includes a short-term network module, a long-term network module, an attention gate network module and an upsampling module.

[0053] S3 image 3 For the schematic diagram of the semi-supervised video target segmentation network model of the present embodiment, refer to image 3 , input the image of the previous frame and the image of the current frame into the short-term network module to obtain the rough segmentation map and relative change information of the current frame; the image of the current frame, the image of the first frame, the segmentation ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a semi-supervised video target segmentation method, which comprises the steps: S1, preprocessing a video image to obtain an image of a current frame and an image of a first frame, and giving a segmentation image of the first frame; S2, constructing a semi-supervised video target segmentation network model, wherein the semi-supervised video target segmentation network model comprises a short-time network module, a long-time network module, an attention gate network module and an up-sampling module; S3, inputting the image of the previous frame, the segmentation result image of the previous frame and the image of the current frame into a short-time network module to obtain a rough segmentation image and relative change information of the current frame; inputting the image of the current frame, the image of the first frame, the segmentation map of the first frame and the rough segmentation map of the current frame into a long-term network module to obtain absolute change information; inputting the relative change information and the absolute change information into an attention gate network to obtain a segmentation result, and finally obtaining a segmentation result graph through an up-sampling module. According to the method, the segmentation performance and the segmentation speed can be improved.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a semi-supervised video target segmentation method. Background technique [0002] With the development of deep learning, neural network technology is applied in more and more scenarios, and video object segmentation, as a popular research direction in the field of computer vision, is also receiving more and more attention. Video target segmentation is mainly divided into two types: semi-supervised video target segmentation and unsupervised video target segmentation. Semi-supervised video target segmentation refers to the target segmentation map of the first frame to segment the target of the remaining frames; unsupervised video target segmentation It means that the target in the entire video is segmented without giving any prior information. [0003] The research on semi-supervised video object segmentation in the prior art mainly includes online fine-tuning, propagation...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/10G06N3/08G06N3/04
CPCG06T7/10G06N3/08G06T2207/10016G06N3/045
Inventor 滕竹王晶粳张宝鹏李浥东
Owner BEIJING JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products