Multimedia-frame processing method and device

Abstract

The invention discloses a multimedia-frame processing method and device. The method comprises determining whether time difference values of multimedia frames in a buffer queue mutate, wherein the time difference values are the differences between display time label indication moments and receiving moments of the multimedia frames, the buffer queue comprises N to-be-processed multimedia frames which are sorted according to receiving moments, and N is an integer; performing non-synchronous playing on M to-be-processed multimedia frames in the processing period wherein the M to-be-processed multimedia frames are the front M multimedia frames which are arranged in an ascending mode according to the receiving moments in the buffer queue; performing synchronous playing on M to-be-processed multimedia frames in the processing period if non multimedia frames with the time difference values mutated in the buffer queue and the time difference values of the M to-be-processed multimedia frames are within the preset threshold. By means of the method and the device, good transient and steady state responses are achieved.

Description

technical field [0001] The invention relates to the field of multimedia communication, in particular to a method and device for processing multimedia frames. Background technique [0002] In the digital TV system, the encoder at the transmitting end encodes the audio analog signal or the video analog signal to obtain audio frames or video frames, and the decoder at the receiving end decodes the audio frames or video frames. In order to ensure the normal operation of the encoder at the transmitting end and the decoder at the receiving end, the frequency and phase of the encoder and decoder must be consistent. [0003] The following describes how the encoder and decoder work. [0004] At the transmitter, the audio analog signal or video analog signal is sampled, quantized and compressed by the encoder according to the MPEG-2 standard to form an elementary stream ES (Elementary Stream, ES), which is a non-segmented continuous code flow. The ES is divided into sections, and t...

AI Technical Summary

Problems solved by technology

[0006] In the prior art, the above-mentioned preset threshold is usually set larger, because if a smaller preset threshold is set, it will cause frequent switching between synchronous playback and asynchronous playback

[0007] However, the inventor found that the code stream received by the decoder may be unstable. In this case, the time difference between the receiving time of the audio frame or video frame determined according to the STC and the time indicated by the PTS is also unstable, usually Large changes will occur in a short period of time. When performing synchronous playback processing on this unstable code stream, the probability of skipping or repeating frames calculated according to the time difference is greater than 1, making The played pictures are discontinuous, and asynchronous playback will not be performed until the above-mentioned time difference is greater than the preset threshold

[0008] To sum up, there is a sudden change in the difference between PTS and STC in the code stream, that is, the time difference between the receiving time of the audio frame or video frame determined according to the STC and the time indicated by the PTS increases instantaneously. The time difference between the receiving moment of the audio frame or video frame determined according to the STC and the moment indicated by the PTS is just within the preset threshold, so that the number of skipped frames and repeated frames calculated by the synchronous playback process will be instantaneous. increase, resulting in discontinuous playback

Images