Analysis and manipulation of images and video for generation of surround views

Abstract

Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a surround view. In particular embodiments, the surround view reduces redundancy in the image and location data, and presents a user with an interactive and immersive viewing experience.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]This application claims priority under 35 U.S.C. §119 to Provisional U.S. Patent Application No. 61 / 903,359 (Attorney Docket No. FYSNP001P) by Holzer et al., filed on Nov. 12, 2013, titled “Systems and Methods Fr Providing Surround Views,” which is incorporated by reference herein in its entirety and for all purposes.TECHNICAL FIELD[0002]The present disclosure relates to generating surround views, which includes providing a multi-view interactive digital media representation.DESCRIPTION OF RELATED ART[0003]With modern computing platforms and technologies shifting towards mobile and wearable devices that include camera sensors as native acquisition input streams, the desire to record and preserve moments digitally in a different form than more traditional two-dimensional (2D) flat images and videos has become more apparent. Traditional digital media formats typically limit their viewers to a passive experience. For instance, a 2D flat imag...

AI Technical Summary

Benefits of technology

The patent is about a system and method for creating surround views, which are interactive and immersive digital representations of events and memories. The system analyzes and manipulates images and videos to reduce redundancy and provide a more complete view of the data. The resulting surround views can be used for various applications, such as visual search and social sharing. The technical effects of the patent include improved mechanisms for viewing and indexing visual data, separation of content and context in a surround view, and providing a more accurate and complete view of an object or event.

Problems solved by technology

Traditional digital media formats typically limit their viewers to a passive experience.

Accordingly, traditional digital media formats, such as 2D flat images, do not easily lend themselves to reproducing memories and events with high fidelity.

Unfortunately, neither 2D images nor 2D videos have been designed for these purposes.

Images