Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Third-perspective video synthesis and output system and method for virtual reality project

A technology of virtual reality and output method, which is applied in the field of virtual reality and can solve problems such as inability to share teaching

Inactive Publication Date: 2017-07-25
GUANGZHOU ETO INFORMATION TECH CO LTD
View PDF3 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This kind of VR-based training can only provide personal experience from the first perspective, but cannot share teaching

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Third-perspective video synthesis and output system and method for virtual reality project
  • Third-perspective video synthesis and output system and method for virtual reality project
  • Third-perspective video synthesis and output system and method for virtual reality project

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below in conjunction with the accompanying drawings of the description.

[0028] A virtual reality project based on HTC Vive equipment and Unity3D development engine

[0029] The synthesis and output system of the third perspective, the virtual reality project in this embodiment is described by taking a student's practical training project as an example.

[0030] Such as image 3 As shown, the hardware configuration based on the present invention includes a VR helmet worn on the operator's head, a positioning handle for the operator to hold and operate, a computer, a video camera, a first TV for the photographer to watch, a second TV for the audience to watch and Display for compositing operations. The computer includes a graphics card for collecting VR helmet video signals and a video capture card for collecting camera video signals, the graphics card is connected to the display screen through a display interface, and t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a third-perspective video synthesis and output system and method for a virtual reality project. The system comprises a camera used for shooting a moving image of an operator wearing a VR helmet, holding a locating handle in a hand and operating the VR project in a blue box, an image matting module used for extracting the moving image of the operator, a background extraction module used for extracting a background image in the VR project, a foreground extraction module used for extracting a foreground image in the VR project, and a video synthesis module used for synthesizing the moving image, the background image and the foreground image into a third-perspective video. The third-perspective synthesis and output of the VR project developed based on a Unity3D engine are realized by utilizing an image capture technology and a video matting technology according to a characteristic that the Unity3D VR engine has a foreground alpha channel image output function, so that the problem of application limitation that a VR device only can provide the first perspective is solved.

Description

technical field [0001] The invention relates to the technical field of virtual reality, in particular to a synthesis and output system of a third-view video of a virtual reality project. Background technique [0002] Virtual reality (VR) technology is a combination of various technologies, including real-time three-dimensional computer graphics technology, wide-angle (wide-view) stereoscopic display technology, tracking technology for the observer's head, eyes and hands, and tactile / force feedback. Output a first-view 3D stereoscopic image for the left and right eyes, and put on a head-mounted display to present and blend into it. The first-view image presented by the user after wearing the helmet uses the combination of electronic gyroscope technology and head movement. The electronic gyroscope can accurately perceive the three-dimensional information of space x, y, and z, and transmit this information back to the computer. The calculation is performed in the computer, so ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01H04N5/222H04N5/262H04N5/265H04N5/268
CPCG06F3/011G06F2203/012H04N5/2226H04N5/2621H04N5/265H04N5/268
Inventor 冯大治
Owner GUANGZHOU ETO INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com