Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Context adaptive directional intra prediction

Inactive Publication Date: 2011-10-13
SONY CORP
View PDF13 Cites 36 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

[0016]The present invention is directed at addressing the above intra prediction issues by extending direction prediction to improve the visual quality as well the coding performance for next generation video coding standards. Extended directional information is provided while leveraging inter-block geometric dependency at the decoder side to limit the need for additional side information. In particular, enhanced prediction direction detection is performed at the decoder-side in the reconstructed neighborhood of the current block to get the a priori prediction direction.
[0017]The encoder according to the invention can perform intra prediction encoding using any desired number of modes, such as beyond the nine modes provided in the AVC coding standard. The encoder can derive a prediction direction, which can be adjusted by the encoder to account for curvatures. Additional side information can be sent to the decoder to guide utilization of enhanced directional modes. In one implementation a signal is sent from the encoder to inform the decoder whether or not to reconstruct the image based on use of the extended modes, or to use the standard modes. In one implementation a flag referred to herein as “detection” is sent to the decoder to inform it that the directionality of the current block can be determined based on its neighbors. As the enhanced prediction direction detection is conducted at the decoder side, a high directional resolution can be obtained with the present techniques without requiring significant overhead in regard to the need for additional signaling bits.
[0028]An element of the invention is an intra predictive video coding method and apparatus which improves coding accuracy.
[0029]Another element of the invention is an enhanced edge-based adaptive direction estimation method which improves intra prediction.
[0031]Another element of the invention is enhanced directional prediction which can be applied at the decoder in response to neighboring blocks.

Problems solved by technology

First, the limited number of directional modes, such as a maximum of eight within AVC, can limit the precision necessary to properly code blocks subject to arbitrary directional patterns.
Secondly, mode number prediction from neighboring blocks is not sufficiently accurate to exploit the geometric dependency between blocks, which would allow use of enhanced directional modes in a decoder without significantly increasing side information.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Context adaptive directional intra prediction
  • Context adaptive directional intra prediction
  • Context adaptive directional intra prediction

Examples

Experimental program
Comparison scheme
Effect test

embodiment 10

[0047]FIG. 1 illustrates an example video coding (encoder and / or decoder) embodiment 10 configured for context adaptive intra prediction. Although the present invention is shown implemented within an AVC (H.264) codec, it can be implemented in other intra predictive coding apparatus without departing from the teachings of the present invention. To provide for the prediction of subsequent blocks in the current picture or subsequent coded pictures, a decoder model is present within the encoder itself. Stated another way, it will be appreciated that a decoder is generally a subset of the functional elements of an encoder. The schematic of FIG. 1 depicts both an encoder 10, and a decoder 12, as a subset of encoder 10 for the sake of illustration. It will be appreciated, however, that in practice the decoder can be implemented entirely separately from any encoding functions, or may be implemented in a combination encoder-decoder.

[0048]A video input 14 is shown with a frame split into mac...

embodiment 1

[0084]2. The apparatus of embodiment 1, further comprising programming executable on said computer for obtaining said image gradient vectors for pixels neighboring a current block, in response to applying a first-order derivative operator to pixels neighboring a current block to obtain image gradient vectors.

[0085]3. The apparatus of embodiment 1, further comprising programming executable on said computer for determining which edge directions do not cross block boundaries of said current block in response to comparing the slopes of said edge directions against minimum and maximum slope thresholds in preparation for said discarding edge directions.

[0086]4. The apparatus of embodiment 1, further comprising programming executable on said computer for determining said summation of projections in response to objective function S(θ) as summation of projections to a candidate direction θ, as given by,

S(θ)=∑i=1N〈e^,a->i〉2=∑i=1Na->i2cos(θ-θi)2

wherein {right arrow over (a)}i with (i=1, ...

embodiment 7

[0090]8. The apparatus of embodiment 7, further comprising programming executable on said computer for performing steps comprising: (a) finding an optimum prediction direction θopt which accounts for curvature in said dominant edge direction θ*; (b) determining direction adjustment angle Δθ in response to said optimum prediction direction θopt and said dominant edge direction θ* as Δθ=θopt−θ*; (c) quantizing said direction adjustment angle Δθ into a quantized direction adjustment angle; and (d) encoding said quantized direction adjustment angle as side information within an encoded output of said encoder.

[0091]9. The apparatus of embodiment 1, further comprising programming executable on said computer for determining a quantization step size in quantizing the direction adjustment angle, wherein the quantization step size is a decreasing function of a confidence value s.

[0092]10. The apparatus of embodiment 1, wherein said apparatus for video coding comprises a decoder configured to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Enhanced directional prediction apparatus and methods are taught which are based on edge-based adaptive directional estimation, for providing an improved prediction direction for intra prediction within a coding device. Image gradient vectors are obtained for pixels in the neighborhood of the current block, and edge directions determined. Candidate edge directions are processed to derive a dominant edge direction in response to defining an objective function as a summation of projections to a candidate direction and computing suggested direction of each neighboring pixel. The dominant edge direction may be utilized for the prediction direction, such as in response to a detection mode flag signaled to the decoder, or modified by an angular adjustment, which can be communicated to a decoder.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]This application claims priority from U.S. provisional application Ser. No. 61 / 323,063 filed on Apr. 12, 2010, incorporated herein by reference in its entirety.STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT[0002]Not ApplicableINCORPORATION-BY-REFERENCE OF MATERIAL SUBMITTED ON A COMPACT DISC[0003]Not ApplicableNOTICE OF MATERIAL SUBJECT TO COPYRIGHT PROTECTION[0004]A portion of the material in this patent document is subject to copyright protection under the copyright laws of the United States and of other countries. The owner of the copyright rights has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the United States Patent and Trademark Office publicly available file or records, but otherwise reserves all copyright rights whatsoever. The copyright owner does not hereby waive any of its rights to have this patent document maintained in secrecy, inclu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N7/32H04N19/593
CPCH04N19/176H04N19/14H04N19/11H04N19/61
Inventor LIU, WEIMAANI, EHSANGHARAVI-ALKHANSARI, MOHAMMAD
Owner SONY CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products