A panoramic image salience image generation method and system for fusion of visual characteristics and behavioral characteristics

A panoramic image and visual characteristic technology, which is applied in image data processing, instruments, character and pattern recognition, etc., can solve the problems of different viewing methods of panoramic images and the inability to obtain saliency maps, etc., and achieve the effect of improving the display effect

Active Publication Date: 2019-01-08
INST OF INFORMATION ENG CHINESE ACAD OF SCI
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, there are many saliency detection algorithms for traditional planar images. Although these saliency detection algorithms can be directly applied to panoramic images, due to the characteristics of panoramic images, it is usually impossible to obtain a perfect saliency map.
[0004] First, panoramic images are viewed differently from traditional flat images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A panoramic image salience image generation method and system for fusion of visual characteristics and behavioral characteristics
  • A panoramic image salience image generation method and system for fusion of visual characteristics and behavioral characteristics
  • A panoramic image salience image generation method and system for fusion of visual characteristics and behavioral characteristics

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The present invention will be further described below in conjunction with the accompanying drawings.

[0034] The relationship between the equirectangular projection surface, spherical surface, and perspective plane of the panoramic image is as follows: figure 2 shown. The rectangle on the left represents the equirectangular projection of the panoramic image, the sphere represents the spherical representation of the panoramic image, and the viewing angle is the tangent plane ABCD tangent to the sphere at point Q, where point Q is the center of the tangent plane ABCD corresponding to the viewing angle.

[0035] Suppose E(x, y, z) represents the Cartesian coordinates of a point in the panoramic image on the spherical surface, E′(m, n) is its two-dimensional homogeneous coordinates on the perspective projection, E″(u, v ) represents its 2D homogeneous coordinate image on the equirectangular projection. The conversion relationship between them is:

[0036]

[0037] ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a panoramic image salience image generation method and system for fusion of visual characteristics and behavioral characteristics. The method comprises the following steps: 1)converting a panoramic image from an equal rectangular domain to a spherical domain, and then converting the panoramic image from the spherical domain to a view angle domain to obtain a view angle plane image corresponding to the panoramic image; 2) using the Gaussian difference filter to process the plane image of the view angle to obtain DoG values of each pixel in the image in the visual space;3) using the Euclidean distance value between the DoG value corresponding to each pixel and the average DoG value to represent the visual feature saliency of the corresponding pixel on the whole panoramic image, and obtaining the visual feature saliency map SV corresponding to the panoramic image; 4) obtaining the behavior characteristic salience map Sb of the user viewing the panoramic image according to the actual head movement data of the user; 5) fusing the visual characteristic salience map SV and the behavior characteristic salience map Sb to obtain the final panoramic image salience map S. The method greatly improves the display effect of the panoramic image.

Description

technical field [0001] The technical field of computer software of the present invention relates to a method and system for generating a saliency map of a panoramic image in which visual characteristics and behavioral characteristics are fused. Background technique [0002] In recent years, panoramic images have attracted attention because they can capture a wide view of surrounding scenes. By using a head-mounted display (HMD), panoramic images can give viewers an immersive visual experience. Based on this feature, panoramic images have been widely used in many virtual reality (VR) applications. [0003] The spatial size of panoramic images is much larger than that of traditional images. It is very difficult to store and transmit panoramic images under existing conditions. However, the human visual attention mechanism (Visual Attention Mechanism) is a kind of selective attention. Users usually only Focus on a small portion of the entire panoramic image. Distinguish salie...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00G06K9/46
CPCG06T19/006G06V10/462
Inventor 丁颖刘延伟刘科栋
Owner INST OF INFORMATION ENG CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap