Image processing method and device in AR scene, electronic equipment and storage medium

An image processing and image technology, which is applied in the field of image processing, can solve problems such as difficulty in achieving good results, affecting users' judgment of road conditions, and unclearness, etc., to achieve the effects of augmenting reality user experience, improving picture display quality, and simplifying calculations

Active Publication Date: 2019-07-12
APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECH CO LTD
View PDF7 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The real scene image collected by the AR scene will be unclear due to factors such as light and shadow, mainly because some areas in the image are too dark or overexposed. Such an image is directly rendered in the 3D scene, and the picture is not clear enough, which brings users a lot of trouble. extremely poor visual feedback
[0004] Taking AR navigation as an example, some areas of the video frame in front of the car captured by the camera are too dark or overexposed due to factors such as light and shadows. Users judge the road conditions and even cause safety problems
For complex actual road conditions in AR navigation, if image processing methods are used to automatically improve the brightness and contrast of road conditions images, it is difficult to achieve good results

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image processing method and device in AR scene, electronic equipment and storage medium
  • Image processing method and device in AR scene, electronic equipment and storage medium
  • Image processing method and device in AR scene, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] figure 1 It is a flow chart of the image processing method in the AR scene provided by Embodiment 1 of the present invention. This embodiment is applicable to some areas of the real scene image that are too dark or overexposed due to factors such as light and shadow in the AR scene, and image processing is required. For example, if the road condition image is not clear in AR navigation, image fill light is required or the picture in AR games is not clear, etc. The method can be executed by an image processing device in the AR scene, the device can be implemented by software and / or hardware, and generally can be integrated in the AR device or server. Such as figure 1 As shown, the method specifically includes:

[0032] S110. Acquire a depth image corresponding to the current real-scene image.

[0033] In this embodiment, the real scene image refers to a scene reproduced according to real environment information, for example, a photo or a video of the real environment ...

Embodiment 2

[0047] On the basis of the foregoing embodiments, this embodiment provides an implementation manner of performing coloring processing on an ambient light occlusion image according to virtual lighting parameters. Explanations of terms that are the same as or corresponding to those in the foregoing embodiments will not be repeated in this embodiment.

[0048] Specifically, performing coloring processing on the ambient light occlusion image according to virtual lighting parameters, including: reading the virtual lighting parameters; Shade each pixel in the image for coloring.

[0049] When performing pixel shading processing in two-dimensional screen space, the stored virtual lighting parameters are first read, and the ambient light occlusion image is colored pixel by pixel according to the virtual lighting parameters and the original image data, and the colored image is displayed in real time Image, for the user to view.

[0050] In an optional implementation manner, performin...

Embodiment 3

[0057] On the basis of the foregoing embodiments, this embodiment provides an implementation manner of acquiring an ambient light occlusion image corresponding to a depth image. Explanations of terms that are the same as or corresponding to those in the foregoing embodiments will not be repeated in this embodiment.

[0058] This embodiment uses the SSAO method to render an image as an example for illustration, and the SSAO can be calculated by using a normal-based hemispherical integral or a line-of-sight-based spherical integral.

[0059] Specifically, acquiring the ambient light occlusion image corresponding to the depth image includes:

[0060] Calculate the normal vector of each pixel in the depth image; calculate the shading value of each pixel according to the depth value and normal vector of each pixel, and obtain the ambient light shading image;

[0061] or,

[0062] Determine the line-of-sight vector of each pixel in the depth image; calculate the shading value of e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses an image processing method and device in an AR scene, electronic equipment and a storage medium. The method comprises the steps: acquring a depth image corresponding to a current real scene image; obtaining an ambient light shielding image corresponding to the depth image; and performing coloring processing on the ambient light shielding image according tothe virtual illumination parameter. According to the embodiment of the invention, the 3D virtual illumination and the depth map are combined, the ambient light shielding image corresponding to the depth image is colored according to the virtual illumination parameter, the three-dimensional world optical imaging process can be simulated, an unclear area in the image is lightened in real time or excessive exposure is inhibited, the image display quality is improved, and better augmented reality user experience is brought; and three-dimensional scene rendering is converted into pixel coloring ofa two-dimensional screen space, so that calculation can be simplified to a great extent.

Description

technical field [0001] Embodiments of the present invention relate to image processing technologies, and in particular, to an image processing method, device, electronic device, and storage medium in an AR scene. Background technique [0002] AR (Augmented Reality, Augmented Reality) technology displays virtual information and real information on the same screen, and the combination of virtual and real information gives users a real visual experience. [0003] The real scene image collected by the AR scene will be unclear due to factors such as light and shadow, mainly because some areas in the image are too dark or overexposed. Such an image is directly rendered in the 3D scene, and the picture is not clear enough, which brings users a lot of trouble. Extremely poor visual feedback. [0004] Taking AR navigation as an example, some areas of the video frame in front of the car captured by the camera are too dark or overexposed due to factors such as light and shadows. User...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T15/00G06T15/50G06T19/00
CPCG06T15/005G06T15/50G06T19/006Y02B20/40
Inventor 罗志平周志鹏张丙林刘毅邓苏南
Owner APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap