Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Information providing method and device based on augmented reality, equipment and storage medium

A technology of augmented reality and scene information, which is applied in the computer field, can solve problems such as the inability of users to participate in it, the lack of user interaction, and the inability to meet user needs well, so as to achieve enhanced perception, strong sense of immersion, and meet actual application needs Effect

Pending Publication Date: 2019-09-27
TENCENT TECH (SHENZHEN) CO LTD
View PDF5 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, whether it is an individual user or a business, they usually play music, video and other materials for consumers through mobile terminals, personal computers, smart TVs, audio equipment, etc. Although this method can meet the needs to a certain extent, users cannot Participate in it, lack of interaction with users, and cannot meet user needs well

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Information providing method and device based on augmented reality, equipment and storage medium
  • Information providing method and device based on augmented reality, equipment and storage medium
  • Information providing method and device based on augmented reality, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0114] In this example, the application scenario is described as a shopping mall. In this example, the user is a consumer of the mall, and the AR content that needs to be provided to the consumer is the music material that the merchant wants to play to the user.

[0115] In practical applications, based on the solutions provided by the embodiments of the present application, merchants in shopping malls can bind music materials on media such as merchant trademarks (logo) or two-dimensional codes (markers in this example) displayed in their shopping malls, or It is to pre-establish the mapping relationship between scene information (such as logo or QR code) and the AR content (music material) to be displayed.

[0116] In this application scenario, consumers can turn on the camera (the image acquisition device in this example) on their terminal device anytime and anywhere, and use the camera to capture the above-mentioned scene image including the business logo or QR code, and th...

example 2

[0121] In this example, the actual application scenario is not limited, and may be any scenario in the user's life.

[0122] Assuming that the user is walking on the road, the user can take a scene image through the camera on the terminal device, and send the image to the background (such as a server) for identification. The mapping relationship between the scene type and the AR content (music material is still taken as an example in this example) determines the music material that matches the current scene. In addition, through the AR MarkerLess module (a functional module used to implement Marker-Less AR technology) By analyzing the captured scene images, the positional relationship between the matching plane and the camera can be finally obtained, and the music material can be displayed on the matching plane.

[0123] As an optional application solution, when the music material is displayed on the matching plane, the music material may include other material information, su...

example 3

[0125] Figure 2a A schematic diagram of a scene image in this example is shown in , as shown in the figure, a Chinese painting is shown in the scene image, which can be sent to the cloud server for identification, and it is recognized that the scene image contains a image, determine that the image corresponds to the audio and video material, Figure 2b A frame image of the audio and video material is shown in the figure; in addition, through the AR Makerbase module (a functional module for realizing Marker-based AR technology) to Figure 2a Analyze the image shown in , and determine the display target, that is, the marker is Figure 2a The Chinese painting shown in , and determine the spatial relationship between the camera and the marker, and then attach the audio and video materials obtained from the cloud server to the marker for tracking and playback, where the progress bar shown in the figure is the playback progress bar of the material, as shown in the figure, the tot...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides an augmented reality-based information providing method and device, equipment and a storage medium. The method comprises the steps of obtaining a scene image of a reality scene collected by an image collection device; according to the scene image, obtaining to-be-displayed augmented reality AR content and a display target of the AR content in the scene image; fusing the AR content with the display target so as to provide the fused content for the user; wherein the AR content is determined by the following modes: identifying a scene image to obtain scene information of the scene image; and determining AR content corresponding to the scene information based on the scene information. Based on the scheme provided by the embodiment of the invention, the information associated with the scene where the user is located can be provided for the user, and the information is displayed to the user based on the AR technology, so that the immersion of the user is effectively improved, and the actual application requirement can be better met.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular, the present application relates to an augmented reality-based information providing method, device, device, and storage medium. Background technique [0002] With the rapid development of society and science and technology, people's living needs are constantly improving, and multimedia materials such as music and video have gradually become an indispensable part of people's lives. The best way to meet the needs of consumers and attract more consumers is usually by playing music, videos or other promotional content to attract consumers. At present, whether it is an individual user or a business, they usually play music, video and other materials for consumers through mobile terminals, personal computers, smart TVs, audio equipment, etc. Although this method can meet the needs to a certain extent, users cannot Participating in it, the sense of interaction with users ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/16G06K9/00
CPCG06F3/011G06F3/16G06F2203/012G06V20/20
Inventor 吴正山
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com