Data structure for efficient access to variable-size data objects

Abstract

A data structure includes variable-size data objects [“VSDOs”] and enables selective and efficient retrieval of data in particular VSDOs. The data structure includes multiple packets. Each packet includes a reference count field, a references field, and an objects field. The references field stores references to VSDOs within the data structure. The reference count field indicates the number of references stored in the references field. The objects field stores the actual VSDOs. To access a particular VSDO, an accessing unit traverses the reference count fields of the multiple packets until the accessing unit finds a packet that includes the reference to the particular VSDO. The accessing unit accesses the particular VSDO based upon the reference. To further improve the efficiency of an access operation, packets form metapackets. A metapacket header sums the reference count fields of the packets within the metapacket. To access a particular VSDO, an accessing unit traverses the metapacket headers until the accessing unit finds a metapacket that includes a packet having the reference to the particular VSDO. Based upon the reference, the accessing unit accesses the particular VSDO. Storing light field information in VSDOs using the data structure facilitates efficient light field operations and light field operations at selective levels of refinement.

Description

TECHNICAL FIELD [0001] The present invention pertains to storage, manipulation, and transmission of variable-size data objects. A data structure that stores variable-size data objects also facilitates efficient access to the variable-size data objects. In one use, the data structure stores light field information to facilitate selective and efficient access to the light field image information. BACKGROUND OF THE INVENTION [0002] Digital information can be represented as a series of data objects to facilitate processing and storing the digital information. For example, a digital audio or video file can be represented as a series of data objects that contain digital audio or video samples. More generally, a data object is an aggregation of digital information that is related along spatial, temporal, conceptual, or any other lines of significance. [0003] When a series of data objects represents digital information, processing the series is simplified if the data objects are equal size....

AI Technical Summary

Benefits of technology

[0013] The present invention pertains to efficient storage, manipulation, and transmission of digital information with variable-size data objects [“VSDOs”]. A data structure contains digital information in a series of VSDOs for efficient storage and transmission of the digital information. Using the data structure, particular VSDOs within the data structure are selectively, rapidly, and efficiently accessed. For example, using the data structure to store data for a light field data stream, selective portions of the data stream can be rapidly and efficiently accessed.

[0028] When the data structure contains multiple packets, the accessing unit receives a numerical selection m that corresponds to a VSDO to be accessed. The accessing unit selects a packet in the data structure to be the focus of processing, for example, the first packet. Based upon the value in the reference count field of the focus packet, the accessing unit determines whether the focus packet contains a reference corresponding to numerical selection m. If the focus packet contains such a reference, the accessing unit accesses the VSDO corresponding to m based upon the reference. If the focus packet does not contain such a reference, the accessing unit checks a subsequent focus packet. If the accessing unit reaches the end of the data structure without finding a reference corresponding to numerical selection m, the accessing unit terminates the accessing operation. Thus, a VSDO is selectively, rapidly, and efficiently retrieved without processing the VSDOs or references to VSDOs that proceed the packet in the data structure.

[0033] In one use of the present invention, light field information is stored in an efficient manner using a data structure with VSDOs. For a light field image that has been separated into base layer information and enhancement layer information, the data structure with VSDOs facilitates efficient light field operations. Base layer information provides a low granularity version of the light field image, while enhancement layer information refines that low granularity version. VSDOs that include enhancement layer information are selectively and efficiently accessed.

Problems solved by technology

Although access to equal-size data objects in a series is relatively straightforward, in some applications, use of equal-size data objects leads to inefficient storage and transmission.

Accessing a particular VSDO within a series of VSDOs is relatively complicated, however.

Storage and transmission of light fields present difficulties due to the amount of digital information in a typical light field.

Compression of light field information can reduce the representation of the light field image information, usually at some cost to the quality of the information and the speed of accessing the information.

In addition to the considerable storage and transmission requirements for a light field, manipulation of light field images presents considerable memory and processing requirements.

Unfortunately, loading multiple light field images into random access memory (to facilitate random access to dispersed light field samples) consumes large amounts of memory given the size of a typical light field image.

Moreover, even after light field images are loaded into memory, light field operations are computationally complex, especially when decompression of the light field information is required.

These high memory and processing requirements hinder real time rendering, especially for serialized rendering operations.

This linear, sequential retrieval wastes resources because many blocks that are retrieved are not used in the rendering operation.

This inefficiency is exacerbated when numerous non-sequential, dispersed light field samples must be retrieved.

Images