Systems and methods for determining depth from multiple views of a scene that include aliasing using hypothesized fusion

Abstract

Array cameras in accordance with embodiments of the invention perform super resolution processing using images of a scene that contain aliasing. In several embodiments, the depth of pixels is determined by fusing portions of a higher resolution image at a number of hypothesized depths and determining the depth at which the portion of the higher resolution image best matches the scene captured in the lower resolution images used to fuse the higher resolution image.

Description

RELATED APPLICATIONS[0001]This application claims priority to U.S. Provisional Application 61 / 536,500 filed Sep. 19, 2011, the disclosure of which is incorporated herein by reference.FIELD OF THE INVENTION[0002]The present invention relates to super resolution processing and more specifically to super resolution processes that determine pixel depth using multiple images of a scene captured from different viewpoints, where the captured images of the scene include aliasing.BACKGROUND[0003]In a typical imaging device, light enters through an opening (aperture) at one end of the imaging device and is directed to an image sensor by one or more optical elements such as lenses. The image sensor includes pixels that generate signals upon receiving light via the optical element. Commonly used image sensors include charge-coupled device image sensors (CCDs) and complementary metal-oxide semiconductor (CMOS) sensors.[0004]Conventional digital cameras typically achieve color separation by perfo...

AI Technical Summary

Benefits of technology

The patent describes a way to prevent light from entering the pixel stacks by using a material that blocks it. This improves the quality of the image captured by the camera.

Problems solved by technology

Image sensors are subject to various performance constraints including, among others, dynamic range, signal to noise (SNR) ratio and low light sensitivity.

A challenge associated with increasing the number of pixels in an image sensor is that the lens system is dimensioned to span the image sensor.

The problem is most acute with mobile cameras, such as those used in mobile phones and consumer electronics devices, where the form factor of the lens system can significantly impact the overall form factor of the mobile device.

Images