Multimedia communication method and terminal thereof

Abstract

The invention relates to multimedia communication technique, disclosing a multimedia communication method and the terminal design and implementation thereof, improving transmission reliability and communication quality. And the invention adopts ERRTP to provide a transmission layer packing form able to carry error resilient encoding solution related information on the basis of the existing RTP protocol, making multimedia data label the corresponding error resilient encoding solution related information while transmitted on ERRTP, thus merging error resilient mechanism into the transmission layer; in accordance with H.264 NALU structure, the invention provides a special ERRTP packing method and protocol header modification solution, able to integrate all NALU header bytes in the same ERRTP packet into its header, thus expressing important information of NALU in the ERRTP header and raising transmitting efficiency.

Description

technical field [0001] The invention relates to multimedia communication technology, in particular to a multimedia communication technology supporting error resilience. Background technique [0002] With the rapid development of computer Internet (Internet) and mobile communication network, the application of streaming media technology is becoming more and more extensive, from online broadcasting, movie playing to distance teaching and online news websites, etc., all use streaming media technology. Currently, there are mainly two ways to transmit video and audio on the Internet: Download and Streaming. Streaming transmission is the continuous transmission of video / audio signals, and when the streaming media is played on the client computer, the rest continues to download in the background. There are two ways of streaming transmission (Progressive Streaming) and real-time streaming (Realtime Streaming). Live streaming is real-time delivery, especially suitable for live even...

AI Technical Summary

Problems solved by technology

[0109] In addition, because there is no convenient solution for network status monitoring and description of the relative importance of data in the prior art, multi-level protection and unequal protection have not been realized.

[0110] In practical application, the above scheme has the following problems: the Tornado code scheme in the prior art is too complicated, the efficiency is low, it is applied to the protection of video data, the delay is large, and it cannot meet the performance requirements of real-time communication

[0116] The main reason for this situation is that the existing technology uses a fixed erasure code strategy to protect the video communication stream, which cannot adapt to network communication changes; the alternative mechanism adopted by the error concealment method will cause error diffusion; the error diffusion elimination method requires Complicated mechanisms or additional feedback channels consume system processing resources and network bandwidth resources

[0117] In the existing technical solution, the header information of the NALU is completely encapsulated in the payload, so that the RTP protocol cannot directly know the attributes, levels, and importance of the payload, so that the QoS mechanism based on this cannot be realized

Secondly, this encapsulation format also causes NALU header information to occupy payload resources, because each NALU has header information attached, resulting in many cases, because the header information of multiple NALUs of the same type in one RTP are the same , thus wasting RTP transmission bandwidth resources

[0118] The multimedia communication framework of H.264 / RTP adopts a common cooperative control protocol RTCP to transmit QoS reports to realize QoS monitoring. However, RTCP itself is not necessarily the most suitable for specific video communication applications such as H.264, because Its own out-of-band re-opening logical channel to transmit QoS reports affects the network status and leads to conflicts

[0119] The key point is that the existing technology does not implement the error resilience protection strategy of the transport layer, and cannot provide the reliability and communication quality of multimedia transmission.

Images