1251results about "Conversion involving interpolation processes" patented technology

A video, audio and graphics system uses multiple transport processors to receive in-band and out-of-band MPEG Transport streams, to perform PID and section filtering as well as DVB and DES decryption and to de-multiplex them. The system processes the PES into digital audio, MPEG video and message data. The system is capable of decoding multiple MPEG SLICEs concurrently. Graphics windows are blended in parallel, and blended with video using alpha blending. During graphics processing, a single-port SRAM is used equivalently as a dual-port SRAM. The video may include both analog video, e.g., NTSC / PAL / SECAM / S-video, and digital video, e.g., MPEG-2 video in SDTV or HDTV format. The system has a reduced memory mode in which video images are reduced in half in horizontal direction only during decoding. The system is capable of receiving and processing digital audio signals such as MPEG Layer 1 and Layer 2 audio and Dolby AC-3 audio, as well as PCM audio signals. The system includes a memory controller. The system includes a system bridge controller to interface a CPU with devices internal to the system as well as peripheral devices including PCI devices and I / O devices such as RAM, ROM and flash memory devices. The system is capable of displaying video and graphics in both the high definition (HD) mode and the standard definition (SD) mode. The system may output an HDTV video while converting the HDTV video and providing as another output having an SDTV format or another HDTV format.

A method for forming an output stream of data includes determining an output resolution for the output stream of data, determining an output frame rate for the output stream of data, determining an output color depth for the output stream of data, retrieving a first frame of data, a second frame of data, and a third frame of data from an input stream of data, the input stream of data having an input resolution, an input frame rate, and an input color depth, subsampling the first frame of data, the second frame of data, and the third frame of data to respectively form a first subsampled frame of data, a second subsampled frame of data, and a third subsampled frame of data, when the output resolution is lower than the input resolution, dropping the second subsampled frame of data, when the output frame rate is lower than the input frame rate, reducing color depth for the first subsampled frame of data and the second subsampled frame of data to respectively form a first reduced frame of data and a second reduced frame of data, when the output color depth is smaller than the input color depth, and converting the first reduced frame of data and the second reduced frame of data into the output stream of data.

A format converter which performs frame rate conversion and de-interlacing using a bi-directional motion vector and a method thereof are provided. The method includes the steps of (a) estimating a bi-directional motion vector between the current frame and the previous frame from a frame to be interpolated; setting the motion vector of a neighboring block that has the minimum error distortion, among motion vectors estimated in step (a), as the motion vector of the current block; and (c) forming a frame to be interpolated with the motion vector set in step (b).

An interpolation frame generation device (201) that generates an interpolation frame that interpolates image frames that are obtained by decoding a coded image signal (210) that is coded by motion compensation, includes a motion vector deriving unit (203) and an interpolation frame generating unit (204). The motion vector deriving unit (203) acquires a motion compensation vector of a coded block that forms the coded image signal (210). The interpolation frame generating unit (204) generate the interpolation frame in accordance with the motion vector of the image block that forms an image frame by using the motion compensation vector of the coded block as the motion vector of the image block.

An interlace-to-progressive scan conversion system comprises: a spatial line averaging prefilter; a motion estimator; a three-stage adaptive recursive filter. The motion estimator comprises: a 3-D recursive search sub-component having a bilinear interpolator; a motion correction sub-component having an error-function including penalties related to the difference between a given candidate vector and a plurality of neighboring vectors; a block erosion sub-component. The motion estimator assumes that motion is constant between fields. The three-stage adaptive recursive filter comprises: a first stage that selects between using static pixels data and moving pixels data from a next field; a second stage that selects a more valid set of data between motion compensated data from a previous field and the pixels selected by the first stage; a third stage that combines an intra-field interpolation with the more valid set of data selected by the second stage.

A video and graphics system has a reduced memory mode in which video images are reduced in half in horizontal direction during decoding. The video and graphics system includes a video decoder for decoding MPEG-2 video data. The video images may not be downscaled in the horizontal direction when no bi-directionally predicted pictures are used. The video and graphics system may output an HDTV video while converting the HDTV video and providing as another output having an SDTV format or another HDTV format. The output having an SDTV format may be recorded using a video cassette recorder (VCR) while the HDTV video is being displayed.

A method converts a resolution of video signals, the method including: calculating up-sampling and down-sampling ratios based on a resolution of an input video signal and a desired resolution of an output video signal; calculating a number of filter tabs by multiplying the up-sampling and down-sampling ratios by a number of side lobes; calculating first filter coefficients of a same number of the filter tabs by multiplying a window function by a sinc function; calculating final filter coefficients by subtracting a result of a multiplication of a Gaussian function by a window function from the first filter coefficients, and then normalizing the final filter coefficients; and performing filtering in vertical and horizontal directions based on the final filter coefficients by modifying a sampling rate of an input video signal depending on the up-sampling and down-sampling ratios, to obtain clear video images.

A video and graphics system processes video data including both analog video, e.g., NTSC / PAL / SECAM / S-video, and digital video, e.g., MPEG-2 video in SDTV or HDTV format. The video and graphics system includes a video decoder, which is capable of concurrently decoding multiple SLICEs of MPEG-2 video data. The video decoder includes multiple row decoding engines for decoding the MPEG-2 video data. Each row decoding engine concurrently decodes two or more rows of the MPEG-2 video data. The row decoding engines have a pipelined architecture for concurrently decoding multiple rows of MPEG-2 video data. The video decoder may be integrated on an integrated circuit chip with other video and graphics system components such as transport processors for receiving one or more compressed data streams and for extracting video data, and a video compositor for blending processed video data with graphics.

A video, audio and graphics system uses multiple transport processors to receive in-band and out-of-band MPEG Transport streams, to perform PID and section filtering as well as DVB and DES decryption and to de-multiplex them. The system processes the PES into digital audio, MPEG video and message data. The system is capable of decoding multiple MPEG SLICEs concurrently. Graphics windows are blended in parallel, and blended with video using alpha blending. During graphics processing, a single-port SRAM is used equivalently as a dual-port SRAM. The video may include both analog video, e.g., NTSC / PAL / SECAM / S-video, and digital video, e.g., MPEG-2 video in SDTV or HDTV format. The system has a reduced memory mode in which video images are reduced in half in horizontal direction only during decoding. The system is capable of receiving and processing digital audio signals such as MPEG Layer 1 and Layer 2 audio and Dolby AC-3 audio, as well as PCM audio signals. The system includes a memory controller. The system includes a system bridge controller to interface a CPU with devices internal to the system as well as peripheral devices including PCI devices and I / O devices such as RAM, ROM and flash memory devices. The system is capable of displaying video and graphics in both the high definition (HD) mode and the standard definition (SD) mode. The system may output an HDTV video while converting the HDTV video and providing as another output having an SDTV format or another HDTV format.

An apparatus and method for converting a picture format in a digital TV is disclosed including a picture characteristic extracting section analyzing a compressed bit stream of every input picture scanned in an interlaced scanning pattern to analyze the characteristic of each picture; an interpolation determining section determining an interpolation operation processing in an adaptable manner using information each extracted from every given pictures at the picture characteristic extracting section; and an operation performing section performing the related operation according to the interpolation operation processing determined by the interpolation determining section to perform an interpolation.

A process for up-converting an existing video source signal having a low frequency (frames / second) to a high frequency signal for use with High Definition Television (HDTV). The process samples the existing frames in the existing video signal and calculates integer displacements of pels within the existing frames. A polynomial curve fit is then performed on the displacements to obtain estimates of horizontal and vertical displacements of each block in each existing frame. Based on the alignment of the blocks within a sampling grid on each frame, the blocks are segregated into groups. The block groups are then used to interpolate missing or required frames of the high frequency signal in a piecemeal manner by utilizing blocks of a particular block group to estimate a corresponding block in a frame of the high frequency signal.

An electronic endoscopic apparatus having various sorts of electronic endoscopes mounting a CCD with a different number of pixels, for example, 410,000 pixels, 270,000 pixels or 190,000 pixels that are connectable to a processor. A CCD drive and signal processing circuit drives all the CCDs at a frequency set up for the CCD with 410,000 pixels, and an information quantity conversion circuit expands an image acquired by the CCD with 270,000 pixels or 190,000 pixels by pixel interpolation in a horizontal direction or a vertical direction to form an image with an aspect ratio of 4 to 3. Also, a video signal acquired in an NTSC system is converted into a video signal of a PAL system by using a television standard conversion circuit, thereby displaying an excellent PAL video without any bar noise.

An Encoder Assisted Frame Rate Up Conversion (EA-FRUC) system that utilizes various motion models, such as affine models, in addition to video coding and pre-processing operations at the video encoder to exploit the FRUC processing that will occur in the decoder in order to improve the modeling of moving objects, compression efficiency and reconstructed video quality. Furthermore, objects are identified in a way that reduces the amount of information necessary for encoding to render the objects on the decoder device.

Disclosed herein are systems and methods for estimating global and local motions between a pair of temporally adjacent frames of an input signal and for applying these motion vectors to produce at least one interpolated, motion-compensated frame between the adjacent frames. In particular, the systems and methods comprise designs for a motion compensated frame rate converter including a global affine motion estimation engine, a global translation motion estimation engine, a segmentation mask generator, an object edge strength map generator and a local motion estimation engine. Combinations of these features are implemented in a motion compensated picture rate converter to accurately and efficiently provide motion estimation and compensation for a sequence of frames.

A first motion vector is estimated by using a first frame and a second frame that follows the first frame. A support frame is generated from at least either the first or the second frame by using the first motion vector. The support frame is divided into a plurality of small blocks. Motion vector candidates are estimated by using the first and second frames, in relation to each of the small blocks. A small block on the first frame, a small block on the second frame and the small blocks on the support frame are examined. The small block on the first frame and the small block on the second frame correspond to each of the motion vector candidates. A second motion vector is selected from the motion vector candidates, and points the small block on the first frame and the small block on the second frame which have the highest correlation with each of the small blocks on the support frame. An interpolated frame is generated from at least either the first or the second frame by using the second motion vector.

A deinterlacing method and apparatus for digital image data is disclosed. In the present invention, one of various interpolations appropriately performed according to a detected extent and direction of motion in a pixel to be interpolated. Thus, a screen quality can significantly be improved.

An active matrix type display panel is a hold type display panel which has a plurality of pixels arranged in a matrix form, and holds and displays an electrical signal pixel by pixel for a predetermined time. A frame rate conversion circuit converts a video signal having a first vertical frequency (60 Hz) into a video signal having a second vertical frequency (120 Hz) which is m / n-fold (wherein m is an integer of 2 or more, n is an integer of 1 or more, and conditions of m>n are satisfied) of the first vertical frequency. A time base emphasizing circuit subjects an output from the frame rate conversion circuit to time base emphasis. A drive circuit displays the video signal having the second vertical frequency in a display panel.

An image signal converting apparatus for converting a first image signal into a second image signal, where the first and second image signals include a plurality of pictures of different frames. A motion detector is operable to detect motion of the first image signal between a first frame and a second frame, and processing circuitry produces the second image signal based on an assumption of a pixel at a position corresponding to the detected motion. The apparatus may be employed to produce an output signal of either the same resolution as the first image signal with aliasing distortion reduced or eliminated, or with higher resolution in vertical and / or horizontal directions.

An apparatus for displaying video signals includes an input source to receive video signals having different frame frequencies and provide an input video signal from among the received video signals, a frame frequency detector to detect, as a first frame frequency, the frame frequency of the input video signal, a determiner to determine a second frame frequency according to the first frame frequency and provide a frame frequency conversion rate, the second frame frequency being higher than the first frame frequency, an interpolation frame generator to generate interpolation frames according to the frame frequency conversion rate, and a frame frequency converter to convert the input video signal into a video signal having the second frame frequency by interpolating the generated interpolation frames between original frames of the input video signal.

A method for deinterlacing a picture is disclosed. The method generally includes the steps of (A) generating a plurality of primary scores by searching along a plurality of primary angles for an edge in the picture proximate a location interlaced with a field of the picture, (B) generating a plurality of neighbor scores by searching for the edge along a plurality of neighbor angles proximate a particular angle of the primary angles corresponding to a particular score of the primary scores having a best value and (C) identifying a best score from a group of scores consisting of the particular score and the neighbor scores to generate an interpolated sample at the location.

An encoding device evaluates a plurality of processing and / or post-processing algorithms and / or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods / algorithms either in an encoded bit-stream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm / method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm / method at the decoder / post-processor and / or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and / or error correction techniques that contribute to a restoration of the downsampled images.

A spatial-type de-interlacing process to be applied to a digital image for obtaining a spatial reconstruction. Furthermore, to the digital image there are also applied one or more temporal-type motion compensation de-interlacing processes for obtaining one or more temporal reconstructions, and the spatial reconstruction and the one or more temporal reconstructions are sent to a decision module. The decision module applies a cost function to the spatial reconstruction and the temporal reconstructions and chooses from among the spatial reconstruction and the temporal reconstructions the one that minimizes the cost function. Preferential application is to display systems, in particular displays of a cathode-ray type, liquid-crystal type, and plasma type which use a mechanism of progressive scan.

In one aspect of the disclosure, there is provided a method comprising causing, at least in part, actions that result in: generating, for primary content to be broadcasted for output on a primary content output device, rendering adaptation information configured for use in adapting the rendering of the primary content on a secondary content output device thereby providing an output of secondary content which is derived from the broadcasted primary content; wherein the primary content comprises at least a first media portion having a first temporal output characteristic; wherein the rendering adaptation information comprises temporal information configured for use in adjusting the rendering of the at least first media portion so as to enable generation of secondary content comprising at least a second media portion having a second temporal output characteristic that can differ from the first temporal output characteristic of the at least first media portion.

An interpolation image generating method includes dividing each of the first reference image and the second reference image into reference regions each including pixels, executing a correlation operation between the first reference image and first destination images located before and after the first reference image and a correlation operation between the second reference image and a second destination image to derive motion vectors for the first and second destination images every reference region, obtaining correlation values between the regions of the first and second destination images that are indicated by the motion vectors and the reference region to determine the reference region as a high or low correlation region, generating an interpolation image candidate between the first reference and second images using the reference region determined as the high correlation region, and mixing the interpolation image candidates using the motion vectors of the reference region to produce an interpolation image.

A method and a device for motion estimated and compensated Field Rate Up-conversion (FRU) for video applications is disclosed and claimed. The invention provides for dividing an image field to be interpolated into a plurality of image blocks, where each image block includes a respective set of image elements of the image field. In one embodiment, for each image block of a subset of image blocks, a group of neighboring image blocks is selected. A motion vector for the image block is estimated that describes the movement of the image block from a previous image field to a current image field on the basis of predictor motion vectors associated to the group of neighboring image blocks. Each image element of the image block is determined by interpolation of two corresponding image elements in the previous and current image fields related by the estimated motion vector. To estimate a motion vector, the invention provides for applying each of the predictor motion vectors to the image block to determine a respective pair of corresponding image blocks in the previous and current image fields. For each of the pairs of corresponding image blocks, an error function which is the Sum of luminance Absolute Difference (SAD) between corresponding image elements in the pair of corresponding image blocks is evaluated. For each pair of the predictor motion vectors, a degree of homogeneity is also evaluated, followed by the application of a fuzzy rule having an activation level that is proportional to the degree of homogeneity of the pair of predictor motion vectors and the error functions of the pair of predictor motion vectors. An optimum fuzzy rule having the highest activation level is selected, from which the best predictor motion vector is determined, having the smaller error function of the pair associated to the optimum fuzzy rule. In most cases, the motion vector for the image block is estimated on the basis of the best predictor motion vector.

A video and graphics system includes a video decoding system for processing compressed video data. The compressed video data includes MPEG-2 video data containing SDTV video data or HDTV video data. The video decoding system includes a video decoder for processing the compressed video data to generate displayable video, and a memory controller for transferring the compressed video data to and from an external memory. The video decoder requests to the memory controller to transfer the compressed video data using one of predetermined addressing patterns. The predetermined addressing patterns allow for more efficient transferring of the compressed video data to and from the external memory when compared to sequentially transferring a fixed number of data bytes starting at a fixed address. The use of the predetermined addressing patterns results in reading the compressed video data from the external memory in a predetermined order in a less number of clock cycles. The use of the predetermined addressing patterns also results in transferring the compressed video data over the data bus between the memory controller and the video decoder in a less number of clock cycles.

An image interpolation method comprises searching a motion vector from different pairs of blocks on a first and a second reference image symmetrically, extracting a first and a second image block from the first and the second reference image, respectively, the first and the second image block being located by the motion vector, determining a region determination threshold using an absolute difference between paired opposite pixels of the first and the second image block, extracting from each of the first and the second image block a first pixel region that the absolute difference is smaller than the region determination threshold, and obtaining a pixel value of a second pixel region of the to-be-interpolated block from a pixel value of the first pixel region of each of the first and the second image block, the second pixel region corresponding to the first pixel region.