Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for realizing augmented reality based on deep learning, and mobile terminal

A deep learning and augmented reality technology, applied in the field of computer applications, can solve problems such as single application scenarios and strong use limitations, and achieve the effect of expanding application scenarios and enhancing the ability of target detection

Active Publication Date: 2019-04-26
SHENZHEN AUGMENTED REALITY TECH CO LTD
View PDF6 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to solve the technical problems of single application scenarios and strong limitations in the related technologies for realizing augmented reality, the present invention provides a method, device and mobile terminal for realizing augmented reality based on deep learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for realizing augmented reality based on deep learning, and mobile terminal
  • Method and device for realizing augmented reality based on deep learning, and mobile terminal
  • Method and device for realizing augmented reality based on deep learning, and mobile terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of systems and methods consistent with aspects of the invention as recited in the appended claims.

[0051] figure 1 It is a flow chart of a method for implementing augmented reality based on deep learning according to an exemplary embodiment. The method for implementing augmented reality based on deep learning can be used in mobile terminals such as smart phones, smart homes, computers, and AR devices. Such as figure 1 As shown, the method for implementing augmented reality based on deep learning may include step S110, step S120, step S130, and step S140.

[0052] Step S110, separating the plane image from the depth image collected by the depth camera.

[0053] A ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a device for realizing augmented reality based on deep learning and a mobile terminal, and belongs to the technical field of computer application. The method comprises the following steps: separating a planar image from a depth image collected by a depth camera; Carrying out deep learning on the planar image through a pre-trained neural network model; determining a target in the planar image, extracting a pixel coordinate and a corresponding depth value of each pixel of the target in the depth image; calculating a three-dimensional coordinate of the targetaccording to the pixel coordinate and the depth value; Therefore, the augmented reality is realized, the realization of the augmented reality gets rid of the limitation of an application scene, the traditional augmented reality technology is upgraded to an augmented reality method based on deep learning, the application scene of the augmented reality is greatly expanded, and the target detection capability of the augmented reality is enhanced.

Description

technical field [0001] The present invention relates to the field of computer application technology, in particular to a method, device and mobile terminal for realizing augmented reality based on deep learning. Background technique [0002] Augmented Reality (AR, Augmented Reality) technology can make the real-time world richer, more interesting and more efficient by superimposing rich text and multimedia information. The AR scene has three-dimensional information. By superimposing virtual objects in real-time three-dimensional space, the seamless fit with the real scene is realized. However, the detection efficiency and accuracy of the image recognition technology that the existing AR technology relies on still cannot meet the requirements of most application scenarios, which directly leads to the application of AR technology in some specific scenarios, which greatly limits the limitations of the use of AR technology. . Contents of the invention [0003] In order to so...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/00G06N3/08
CPCG06F3/005G06N3/082
Inventor 苏波徐泽明
Owner SHENZHEN AUGMENTED REALITY TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products