Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Stereo vision saliency calculation method based on left and right monocular receptive fields and binocular fusion

A stereo vision and receptive field technology, applied in the field of computer vision, can solve the problems of not considering binocular fusion, not considering the problem of binocular fusion, and not fully conforming to the processing process of the stereo vision system.

Inactive Publication Date: 2016-03-23
PEKING UNIV
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] However, most stereoscopic saliency calculation methods only extract the saliency map of the stereoscopic image on the left eye image, and do not consider the binocular fusion problem, which is not completely in line with the human stereoscopic vision system processing process.
On the other hand, most of the stereo vision saliency calculation methods use images taken by the author himself, without corresponding manual annotation results, and there is no public stereo image evaluation data set, so quantitative comparison cannot be done
[0012] In general, most of the bottom-up stereo vision saliency calculation methods are extended based on the two-dimensional visual saliency calculation method, which simulates the monocular receptive field model well, and conforms to part of the human visual processing process, but most of the calculation methods It only takes depth as a feature, does not consider the problem of binocular fusion, and does not include the important process of binocular interaction in the human stereoscopic vision system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Stereo vision saliency calculation method based on left and right monocular receptive fields and binocular fusion
  • Stereo vision saliency calculation method based on left and right monocular receptive fields and binocular fusion
  • Stereo vision saliency calculation method based on left and right monocular receptive fields and binocular fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] A stereoscopic saliency calculation method based on left and right monocular receptive fields and binocular fusion, including the following three steps:

[0043] a) Obtain the feature map of the monocular receptive field.

[0044] b) Binocular Fusion.

[0045] c) Adjust weights based on center preference and foreground preference.

[0046] Through the above three steps, the saliency distribution of stereo images can be estimated automatically. in,

[0047] The feature map for extracting the monocular receptive field is to extract the saliency distribution map under different features by establishing the left and right monocular receptive field models.

[0048] The method for extracting the feature map of the monocular receptive field mainly comprises the following steps:

[0049] a) Bottom-level feature extraction: Extract the bottom-level features of stereo images as input information.

[0050] b) Obtain the left eye feature map: Simulate the simple cells of the h...

Embodiment 2

[0068] figure 1 It is a schematic flow chart of the present invention, and in conjunction with the figure and examples, the stereoscopic vision salience calculation method is described in detail as follows:

[0069] Step 1: Extract the underlying features of the left and right images of the stereo image respectively.

[0070] People perceive light and color through the cone cells and rod cells on the retina, and then transmit this information to the visual center for further analysis.

[0071] So in this paper, the retinal nerve cells are simulated, and the brightness and color features of the image are extracted as the input of information.

[0072] Generally speaking, an image consists of three colors: red (r), green (g), and blue (b), so the brightness here is defined as I=(r+g+b) / 3, which represents the brightness feature I .

[0073] The color feature is selected for color contrast, not red, green and blue, although in physiology it is often mentioned that red, green a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a stereoscopic vision significance calculating method based on left and right monocular receptive field and binocular fusion and belongs to the technical field of computer vision. Through simulating the processing process of a human stereoscopic vision system, firstly, left and right monocular receptive field models are respectively built, corresponding characteristic patterns are obtained, then, left and right eye characteristic patterns with the same characteristics and result patterns with different characteristics are fused, in addition, the pixel significance is regulated on the basis of center preference and prospect preference, and finally, a significance distribution pattern most closely approaching to the human stereoscopic vision attention is obtained. The stereoscopic vision significance calculating method has the innovation points that the influence of two common phenomena of the center preference and the prospect preference on the human stereoscopic vision attention is added, so the whole method can perfectly conform to the processing process of the human vision system. The stereoscopic vision significance calculating method provided by the invention can perfectly simulate the processing process of the human stereoscopic vision system, and the interesting region in stereoscopic images can be more effectively extracted.

Description

technical field [0001] The invention relates to a stereoscopic saliency calculation method based on left and right monocular receptive fields and binocular fusion, and belongs to the technical field of computer vision. Background technique [0002] In the vast world faced by human beings, there are massive amounts of information around human beings at any time. However, on the one hand, the human sensory system has limited capacity and cannot receive all information at the same time; on the other hand, compared with the sensory system, the brain's information processing capacity is very limited, and there is a bottleneck problem between the two. Visual attention is an essential part of the mental system in order to effectively receive and process information. [0003] When facing a complex scene, the human visual system (HVS) can quickly selectively filter out non-important information in the visual scene, so as to focus on a few visually salient objects. This process is ca...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/00
Inventor 田永鸿王敏黄铁军
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products