Seam-Based Reduction and Expansion of Images With Color-Weighted Priority

Abstract

A system and method for expansion and reduction of images uses an absolute value associated with each pixel of an input image (e.g., a color and / or intensity value) to determine a respective energy value for each pixel. For example, a given color or range of colors (e.g., skin tones, or other high-priority colors) may be assigned higher energy values than other colors and / or color ranges, and may be protected during image reduction and / or expansion. These energy values may be used to determine a cost associated with various seams of the image, which may represent the priority of the seams in the image. One or more low-cost seams may be identified for removal or replication to produce a resized image. The methods may be used in conjunction with an automated skin tone detector or a user interface that allows selection of one or more high priority colors or color ranges.

Description

BACKGROUNDDescription of the Related Art[0001]The diversity and versatility of display devices today imposes new demands on digital media. For instance, designers must create different alternatives for web-content and design different layouts for different devices. Moreover, HTML, as well as other standards, can support dynamic changes of page layout and text. Images, although they make up some of the key elements in digital media, typically remain rigid in size and cannot deform to fit different layouts automatically. However, the size and / or aspect ratio of an image must change in order to fit into different displays, such as cell phones or PDAs, or to print on a given paper size or at a specified resolution.[0002]Resizing images using standard image scaling is often not sufficient since it is oblivious to the image content and typically can be applied only uniformly, resulting in various artifacts or distortions of the input image. Cropping is also of limited use since it can onl...

AI Technical Summary

Benefits of technology

[0005]The methods described herein may be implemented as program instructions, (e.g., stored on computer-readable storage media) executable by a CPU and / or GPU, in various embodiments. For example, they may be implemented as program instructions that, when executed, implement a resizing operation in an image editing application in response to user input. In various embodiments, the methods described herein may be used in conjunction with an automated skin tone detector, or in conjunction with a user interface that allows selection of one or more high priority colors or color ranges. For example, in various embodiments, a user of an image editing application may be able to specify one or more high-priority colors and / or color ranges of a given image using a color selection tool, pull-down menu, radio button, or alphanumeric input field.

Problems solved by technology

Images, although they make up some of the key elements in digital media, typically remain rigid in size and cannot deform to fit different layouts automatically.

Resizing images using standard image scaling is often not sufficient since it is oblivious to the image content and typically can be applied only uniformly, resulting in various artifacts or distortions of the input image.

Cropping is also of limited use since it can only remove pixels from the image periphery.

However, standard seam carving techniques may be computationally expensive and may also produce undesirable artifacts or distortions.

Images