Video region-of-interest extraction method based on encoding information

Abstract

The invention discloses a video region-of-interest extraction method based on visual perception characteristics and encoding information, and relates to the field of video encoding. The video region-of-interest extraction method comprises the following steps of (1) extracting luminance information of a current encoding macro-block from a primary video stream, (2) identifying a space domain visual characteristic saliency region through an inter-frame prediction mode type of the current encoding macro-block, (3) using a mean motion vector, in the horizontal direction, of a previous encoding macro-block and a mean motion vector, in the perpendicular direction, of the previous encoding macro-block as dual dynamic thresholds, identifying a time domain visual characteristic saliency region according to the result of comparison among a motion vector, in the horizontal direction, of the current encoding macro-block, a motion vector, in the perpendicular direction, of the current encoding macro-block and the dual dynamic thresholds, and (4) defining a video interest priority through combination of the identification result of the space domain visual characteristic saliency region and the identification result of the time domain visual characteristic saliency region, and achieving automatic extraction of a region of interest of a video. According to the video region-of-interest extraction method, the important encoding basis can be provided for the video encoding technology based on the ROI.

Description

technical field [0001] The invention belongs to the field of video information processing. Using video coding technology and the principle of human visual perception to realize a fast extraction method of video interest region. The method can automatically analyze the input video stream, and use the encoding information to mark and output the region of interest in the video. Background technique [0002] The latest video coding standard H.264 / AVC uses a variety of advanced coding technologies. While improving the coding performance, its coding complexity also increases sharply, which limits its wide application in multimedia information processing and real-time communication services. People have conducted in-depth research on how to improve the encoding speed of H.264 / AVC, and proposed a large number of fast encoding optimization algorithms, but most of the algorithms do not distinguish the visual importance of each area in the video image, and use the same method for all ...

AI Technical Summary

Problems solved by technology

[0002] The latest video coding standard H.264 / AVC adopts a variety of advanced coding technologies. While improving the coding performance, its coding complexity also increases sharply, which limits its wide application in multimedia information processing and real-time communication services.

People have conducted in-depth research on how to improve the encoding speed of H.264 / AVC, and proposed a large number of fast encoding optimization algorithms, but most algorithms do not distinguish the visual importance of each area in the video image, and use the same method for all encoding content. The encoding scheme ignores the difference in the human visual system HVS (Human Visual System, HVS) perception of the video scene

Images