Methods and apparatus for encoding and decoding virtual reality content

Abstract

The techniques described herein relate to methods, apparatus, and computer readable media configured to process multimedia data. The multimedia data includes a hierarchical track structure with at least a first track and a second track, such that the first track is at a first level in the hierarchical track structure and the second track is at a second level in the hierarchical track structure above the first level of the first track. First metadata is contained within the first track and second metadata is contained within the second track. The multimedia data can be decoded by performing, based on the first metadata and the second metadata, a track derivation operation on the media data associated with the first track to generate the media data of the second track such that the second track is a derived track of the first track. According to the provided methods, apparatus, and computer readable media configured to process multimedia data, the decoding efficiency can be improved.

Description

technical field [0001] The present invention relates to video coding and decoding. In particular, the present invention relates to a method and apparatus for associating, storing and / or signaling virtual reality (VR) attributes and / or metadata and composition track derivation. Background technique [0002] There are various types of 3D content (3D content) and multi-directional content (multi-directional content). For example, omnidirectional video is a type of video that is captured using a set of cameras, rather than just one camera like traditional unidirectional video. For example, cameras can be placed around a particular center point such that each camera captures a portion of the video on a spherical overlay of the scene to capture 360-degree video. Videos from multiple cameras can be stitched, rotated, and projected to generate projected 2D images representing spherical content. For example, a spherical figure can be put into a 2D image using an equal rectangular ...

AI Technical Summary

Problems solved by technology

[0005] However, processing all spherical content can be computationally intensive and can consume significant bandwidth

For example, for online streaming applications, processing all spherical content would place an unnecessarily greater burden on network bandwidth

Therefore, it may be difficult to maintain a good user experience when bandwidth resources and / or computing resources are limited

Some technologies only process what the user is viewing

Images