Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Unsupervised video segmentation method based on non-local space-time characteristic learning

A spatiotemporal feature, video segmentation technology, applied in image analysis, image data processing, instruments, etc., can solve the problems of inaccurate motion information, blurred objects, etc., to achieve improved robustness, improved segmentation accuracy, and good denoising effect. Effect

Inactive Publication Date: 2017-08-04
NANJING UNIV OF INFORMATION SCI & TECH
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In general, the difficulty of segmentation lies in the irregular movement and deformation of the segmented target, the rapidly changing complex background, the inaccurate motion information and the blurring of the target, etc., but to obtain accurate information, it is necessary to use accurate segmentation results. caught in a loop
So far, there is no general and reliable unsupervised segmentation algorithm that can be applied to all complex transformation scenes. At present, most of the video segmentation algorithms proposed by many scholars at home and abroad are aimed at a specific application or a specific type of image. video

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unsupervised video segmentation method based on non-local space-time characteristic learning
  • Unsupervised video segmentation method based on non-local space-time characteristic learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The technical solution of the present invention will be further described below in conjunction with the accompanying drawings.

[0023] like figure 1 As shown, the present invention provides an unsupervised video segmentation method based on non-local spatio-temporal feature learning, including obtaining the video sequence to be segmented, using superpixel segmentation to process the video sequence, using optical flow to match front and rear frame information, and according to the video sequence The optical flow information of adjacent frames obtains the approximate range of the moving target, optimizes the matching results by using non-local spatio-temporal information, establishes a graph model, solves and outputs the segmentation results; the input video processing, by inputting the video to be segmented The system stores the video as a single-frame picture sequence available for processing; the superpixel segmentation module performs superpixel segmentation processi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an unsupervised video segmentation method based on non-local space-time characteristic learning. The method comprises the following steps of acquiring a video sequence which needs to be segmented; using a superpixel to segment and process the video sequence; using a light stream to carry out previous and next frame information matching; according to adjacent frame information of the video sequence, acquiring a range of a motion target and taking as model initialization input; using global information to optimize a matching result; and establishing a graph model and using a graph segmentation algorithm to solve a segmentation result, and through video segmentation, acquiring output of the motion target. Through carrying out superpixel segmentation on each frame of image in an input video, an operation complexity can be greatly reduced; and non-local space-time information is used to optimize matching information acquired through the light stream so that segmentation robustness can be increased and a noise influence is reduced. Any manual intervention is not needed, and an accurate segmentation result can be acquired completely based on video image information.

Description

technical field [0001] The invention relates to an unsupervised video segmentation method based on non-local spatio-temporal feature learning, belongs to the field of computer vision, and specifically relates to the field of video segmentation in image processing. Background technique [0002] Video refers to an image sequence composed of a series of continuous single images, and usually includes text, voice and other information. In order to facilitate transmission and use, it is usually necessary to segment the video, remove some areas in the video that are not of interest to the user, and obtain the data characteristics of the target content for subsequent feature extraction and analysis. [0003] Video segmentation, also known as motion segmentation, refers to dividing an image sequence into multiple regions according to a certain standard, and its purpose is to separate meaningful entities from the video sequence. In image processing technology, image and video segment...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/10G06T7/215
CPCG06T2207/10016G06T2207/20081
Inventor 张开华李雪君宋慧慧
Owner NANJING UNIV OF INFORMATION SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products