Distributed ultra-high-definition video synchronous processing method

Abstract

The invention discloses a distributed ultra-high-definition video synchronous processing method, which comprises the following steps of step 1, collecting video data in real time by a camera, converting the collection time into a uniform timestamp, and pushing a video stream to a client; step 2, the client reads and analyzes the video stream of each path of camera to obtain video frame data; step 3, decoding the video frame data by using a GPU (Graphic Processing Unit), and storing the decoded video frame data into a decoding cache queue; step 4, reading and processing the image from the corresponding decoding cache queue by each thread, and storing the image into a corresponding rendering cache queue; and step 5, reading the image data from each rendering buffer queue, synchronizing multiple paths of image data through uniform timestamp comparison, and merging the synchronized image sequences on the same canvas for rendering display. According to the method, video decoding and processing are carried out by using a GPU parallel calculation framework, the time delay and jitter of video processing are reduced, timestamp synchronization is integrated, and synchronous, real-time and smooth processing of distributed multi-channel ultra-high-definition videos is realized.

Description

technical field [0001] The invention belongs to the field of video image processing, in particular to a distributed ultra-high-definition video synchronization processing method based on time stamp synchronization. Background technique [0002] A mainstream protocol currently used in video network transmission is RTSP (Real Time Streaming Protocol) real-time streaming protocol, which is an application in the TCP / IP (Transmission Control Protocol / Internet Protocol) protocol system A layer protocol that defines how one-to-many applications can efficiently transmit multimedia data over an IP network. RTSP is located on top of RTP (Real-time Transport Protocol, Real-time Transport Protocol) and RTCP (Real-time Transport Control Protocol, Real-time Transport Control Protocol) in terms of architecture. RTP / RTCP is the actual data transmission protocol, which uses TCP or UDP (UserDatagram Protocol, User Datagram Protocol) to complete the data transmission. Among them, RTCP is a c...

AI Technical Summary

Problems solved by technology

[0004] The RTSP protocol can be used to transmit video data through the network more conveniently, but the RTSP protocol does not particularly emphasize time synchronization, and it will cause a certain time delay during transmission.

When transmitting ultra-high-definition video such as 4K, due to the large amount of I frame (key frame) data, it takes much longer to obtain the complete I frame data than the P frame and B frame, which will cause the video frame rate of the decoded output Jitter occurs

When processing multiple 4K network video streams in parallel, this delay and jitter will make the output videos out of sync in time, resulting in overlapping and inconsistency of images. This problem makes parallel processing of multiple 4K videos difficult. Put into practical engineering application

Images