Scalable 3D display remote video communication method

Abstract

The invention discloses an expandable three-dimensional display remote video communication method. According to the expandable three-dimensional display remote video communication method, the image of a first user is obtained by means of an RGB-D camera at the data transmission end, the image of the first user comprises a texture image and a depth image, facial feature information and expression feature information are extracted from the texture image, physical feature information is extracted from the depth image, and point clouds of the first user are reconstructed; all the feature information is optimized by means of the point clouds, the optimized feature information is obtained to generate a three-dimensional model A, the three-dimensional model A is projected on a corresponding texture image, the corresponding texture information is extracted, and acquired voice information, the optimized feature information and texture data are sent to a second user; at the data receiving end, the second user receives the data from the first user and extracts the optimized feature information from the received data to generate a three-dimensional model B, the three-dimensional model B is rendered by means of the texture data, and a rendering result is output through a three-dimensional display device, and the voice information is played.

Description

technical field [0001] The invention relates to the field of remote video communication, in particular to an expandable three-dimensional display remote video communication method. Background technique [0002] Remote video communication systems are playing an increasingly important role in today's society. The industry has adopted many technologies to improve the effect of virtual reality in the system, so that participants in remote conferences can obtain a more immersive experience. Three-dimensional display technology has experienced unprecedented development in both academia and industry, and it can be used in remote video communication systems. Since the latest 3D display technology can provide natural visualization effects and important visual cues, such as eye contact, facial expressions, body language, etc., the advantages of applying it to remote video communication systems are self-evident. [0003] There are already some 3D display technologies applied to remote...

AI Technical Summary

Problems solved by technology

[0005] In terms of real-time 3D information capture of people, the emergence of RGB-D cameras provides a convenient and low-cost potential solution to this problem, but there are very few reports on its application to video communication, especially 3D video communication.

Images