Video enhancement and transmission method based on deep learning

Abstract

The invention discloses a video enhancement and transmission method based on deep learning. Downsampling is carried out on a high-definition video at a video source end, thereby obtaining a low-definition video; the low-definition video is compressed in an existing video coding mode; and the compressed low-definition video is transmitted. The size of the video data is greatly reduced through downsampling and video coding, so the video traffic needing to be transmitted is correspondingly reduced, and an effect of reducing the bandwidth cost is achieved. At a user receiving end, a user receives the low-definition video, reconstructs the low-definition video by employing a super-resolution image reconstruction method of the deep learning and restores the low-definition video into a high-resolution video for the user to watch, so the video transmission bandwidth cost is effectively reduced. According to the method, the video transmission bandwidth cost is reduced by at least 50%; the resolution of the live broadcast video is improved; and the watching experience of a user is improved.

Description

technical field [0001] The invention relates to computer artificial intelligence technology, and is applied in the field of video enhancement and transmission, in particular to a video enhancement and transmission method based on deep learning. Background technique [0002] According to the Internet industry report survey, by 2020, 80% of the data on the Internet will be video data. Although the computing power of mobile terminals has been greatly improved and the 4G network is becoming more and more perfect, the explosive growth of video data has brought new challenges to video storage and transmission on the mobile Internet. Taking live video platforms as an example, there are currently nearly 300 online live broadcast platforms in China, and dozens of investment institutions have participated in the investment. Among them, the market size of online live broadcasts is about 15 billion, and the number of users watching them has exceeded 200 million. According to the foreca...

AI Technical Summary

Problems solved by technology

Its disadvantage is that during video decoding, the reduced-resolution video frame and the representative high-resolution patch frame need to be sent to the receiver together, which will additionally increase the bandwidth consumption of video transmission

Its disadvantages are: it needs to disseminate over-complete dictionaries and low-resolution videos, occupying transmission bandwidth consumption

The disadvantage of this patent is that deep learning only uses a 3-layer network structure, which cannot fully express and reconstruct the nonlinear mapping relationship between low-resolution images and high-resolution images, and the reconstruction effect needs to be improved.

Images