Confidence map-based method for distinguishing and detecting virtual object of augmented reality scene

Abstract

The invention relates to a confidence map-based method for distinguishing and detecting a virtual object of an augmented reality scene. The method comprises the following steps of: selecting vitality and reality classification features; constructing a pixel level vitality and reality classifier by means of the vitality and reality classification features; extracting regional comparison features of the augmented reality scene and a real scene respectively by means of the vitality and reality classification features, and constructing a region level vitality and reality classifier; giving a test augmented reality scene, detecting by means of the pixel level vitality and reality classifier and a small-size detection window to acquire a virtual score plot which reflects each pixel vitality and reality classification result; defining a virtual confidence map, and acquiring the virtual confidence map of the test augmented reality scene by thresholding; acquiring the rough shape and the position of a virtual object bounding box according to the distribution situation of high virtual response points in the virtual confidence map; and detecting by means of the region level vitality and reality classifier and a large-size detection window in the test augmented reality scene to acquire a final detection result of the virtual object. The method can be applied to the fields of film and television manufacturing, digital entertainment, education training and the like.

Description

technical field [0001] The invention relates to the fields of image processing, computer vision and augmented reality, in particular to a method for discriminating and detecting a virtual object in an augmented reality scene based on a confidence map. Background technique [0002] Augmented reality is a further extension of virtual reality. With the help of necessary equipment, computer-generated virtual objects and objectively existing real environments coexist in the same augmented reality system, presenting virtual objects and real environments to users from the perspective of sensory and experience effects. An integrated augmented reality environment. With the development of augmented reality technology and the emergence of augmented reality scenes with higher image realism, there is an urgent need for standards and basis for measuring and evaluating the credibility of augmented reality scenes. How to determine whether a scene is an augmented reality scene, and further ...

AI Technical Summary

Problems solved by technology

[0009] The above-mentioned methods for distinguishing virtual images from real images have in common that none of the features extracted by them for the virtual-real classification are suitable for any given region in the image.

In addition, in existing object detection work, the objects generally dealt with have strong and easy-to-describe appearance features as prior information

Relatively speaking, in the detection of virtual objects in augmented reality scenes, the detection target (that is, the virtual object) does not have explicit prior information that is easy to describe in appearance, such as color, shape, size, etc., so it is difficult to distinguish and detect

Images