VR-AR all-in-one machine terminal human remote interaction method and system based on it

Abstract

The present invention provides a VR-AR all-in-one machine terminal real person remote interaction method, comprising the following steps: S1, at the same time, the cloud processing server obtains the coded pre-processing video stream and the coded audio stream from the video acquisition device and the all-in-one terminal device respectively; S2, cloud processing The server processes the encoded preprocessed video stream and the encoded audio stream to obtain the target video stream and audio stream; S3, the cloud processing server synchronizes the target video stream and audio stream to form an audio and video stream; S4, the cloud processing server processes the audio and video stream Hybrid compression encoding; S5, the all-in-one terminal device obtains the audio and video stream after hybrid compression encoding from the cloud server. The R-AR all-in-one terminal real-person remote interaction method and the system based on it solve the problem that in the prior art, the voice collection function of AR or VR equipment is combined with the image collection function of video collection equipment, resulting in insufficient functions of AR or VR equipment. problem of utilization.

Description

technical field [0001] The present invention relates to the field of realizing virtual reality of distance education, in particular to a method for remote interaction with a real person at a VR-AR all-in-one machine terminal and a system based thereon. Background technique [0002] The Chinese patent discloses an image data processing method and device, a computer device, and a readable storage medium with the application number CN201810124075.9, wherein the image data processing method includes: if the RGB image converted from the collected YUV encoded image includes Cutting out the target image, extracting the target image from the RGB image; encoding the target image to obtain image data to be transmitted, wherein the image data to be transmitted includes YUV422 plane format data and alpha channel data. Although this method can reduce the bandwidth of transmitting image data in the existing virtual scene or 360-degree panoramic video, there are problems: [0003] In addi...

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a VR-AR all-in-one machine terminal real-person remote interaction method and a system based on it to solve the problem of combining the voice collection function of AR or VR equipment with the image collection function of video collection equipment in the prior art, resulting in AR or The problem that the functions of VR equipment cannot be fully utilized