Streaming media audio and video synchronization method and system

Abstract

A streaming media audio-video synchronization method and system are provided by the present invention. The system includes: buffer modules, which are classified as audio buffer modules and video buffer modules when pre-decoding and decoding, wherein the audio buffer modules are classified as a first audio buffer module and a second audio buffer module; decoding modules, which are classified as audio decoding modules and video decoding modules, for decoding the received un-decoded audio and video data packets, wherein the audio decoding modules decode the audio data packets by taking the data packet between the adjacent video frames as a unit and the first audio buffer module and the second audio buffer module buffer respectively the adjacent decoded audio data packets; and an input and output control module for controlling the output of the decoded audio and video data, wherein controlling to output selectively the decoded audio data packets in the first audio buffer module or the second audio buffer module and controlling the output of the next adjacent decoded video frame after accomplishing the output of the decoded audio data packets in the first audio buffer module or the second audio buffer module.

Description

technical field [0001] The invention relates to mobile phone streaming media technology, in particular to a streaming media audio and video synchronization method and system. Background technique [0002] With the rapid development of Internet TV, communication technology and multimedia products, streaming media technology has become an online playback technology that has emerged in recent years, that is, playing while downloading, and the player does not have to wait until all multimedia files are downloaded to local storage before playing. Instead, download and play at the same time. The player opens up a cache area in the client's memory, usually a few megabytes of space, and the player waits until there is enough data in the buffer area to start decoding and playing. During the "streaming media" transmission process, the transmission protocol used is real-time transmission Protocol, referred to as RTP protocol, this protocol is defined to work in one-to-one or one-to-ma...

AI Technical Summary

Problems solved by technology

[0009] We will find that there is a problem with the above technology that it is impossible to determine the decoding amount of an audio decoding task, how long to perform an audio decoding process, and how to query the video timestamp

Obviously, if there are too many audio packets to be decoded at one time, the video decoding time will be delayed. The resources of the mobile phone are limited, and there is only one CPU

And frequently checking the video timestamp will increase the meaningless task switching rate, resulting in a waste of CPU utilization, which will also reduce the battery life of the mobile phone

Images