Image processing apparatus, image pickup apparatus, image processing method, and program

Abstract

There is provided an image processing apparatus including an HDR (High Dynamic Range) processing unit inputting images picked up while exposure control that changes an exposure time is being carried out with a predetermined spatial period and a predetermined temporal period on pixels that compose an image sensor, and carrying out image processing. The HDR processing unit generates a first combined image by combining pixel values of a plurality of images with different sensitivities generated by an interpolation process using a plurality of consecutively picked-up images, generates a second combined image by combining pixel values of a plurality of images with different sensitivities generated by an interpolation process that uses a single picked-up image, and generates an HDR image by executing a pixel value blending process on the first combined image and the second combined image in accordance with a blending ratio calculated in accordance with movement detection information.

Description

technical field [0001] The present invention relates to an image processing device, an image capturing device, an image processing method and a program. In particular, the present invention relates to an image processing device, an image pickup device, an image processing method, and a program that generate images with a high dynamic range (wide dynamic range). Background technique [0002] A solid-state image pickup element such as a CCD image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor used in a video camera or a digital still camera operates by accumulating electric charges in accordance with the amount of incident light and outputting light corresponding to the accumulated electric charges. Electrical signals to perform photoelectric conversion. However, the amount of charge that can be accumulated in the photoelectric conversion element is limited, so when a certain amount of light has been received, a saturation level is reached, thus causi...

AI Technical Summary

Problems solved by technology

One problem with this approach is that false colors and double images can result when the subject moves since the two images to be combined are taken at slightly different timings

Conversely, in the case where the subject is dark, a lot of noise will be included in the low-sensitivity pixels, and an image will have to be generated using only the pixel information of the high-sensitivity pixels

In this way, there are cases where effective pixel information cannot be obtained due to the state of the image-taking subject, and as a result, there is a problem of image quality degradation such as resolution degradation and / or generation of false colors due to the inability to obtain color samples

Images