An integrated method for both super-resolution and multi-frame
demosaicing includes an
image fusion followed by simultaneous
deblurring and interpolation. For the case of color super-resolution, the first step involves application of recursive
image fusion separately on the three different color
layers. The second step is based on minimizing a maximum a posteriori (MAP) cost function. In one embodiment, the MAP cost function is composed of several terms: a data fidelity penalty term that penalizes dissimilarity between the
raw data and the super-resolved estimate, a luminance penalty term that favors sharp edges in the luminance component of the image, a
chrominance penalty term that favors
low spatial frequency changes in the
chrominance component of the image, and an orientation penalty term that favors similar edge orientations across the color channels. The method is also applicable to color super-resolution (without
demosaicing), where the low-quality input images are already demosaiced. In addition, for
translational motion, the method may be used in a very fast
image fusion algorithm to facilitate the implementation of dynamic, multi-input / multi-output color super-resolution /
demosaicing.