A panoramic video key frame coding method and device

A technology of panoramic video and coding method, which is applied in the direction of digital video signal modification, image communication, electrical components, etc., can solve the problems of low I-frame compression efficiency, high bandwidth cost, and network traffic consumption, etc., and is conducive to popularization and application, saving The effect of network bandwidth and improving compression efficiency

Active Publication Date: 2018-06-19
BEIJING BYTEDANCE TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In addition, in the current encoding process of the key frame (I frame) of the panoramic video, such as adopting HEVC (HighEfficiency Video Coding, which is a new video compression standard, which can replace the H.264 / AVC encoding standard) or AVS (Audio Video Coding) Coding Standard, audio and video coding standard) encodes I frames, only using the spatial correlation within the frame, resulting in low compression efficiency of I frames
[0004] As a result, the current panoramic video is large in size, consumes a lot of network traffic during transmission, and has high bandwidth costs, which limits the promotion and application of panoramic video

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A panoramic video key frame coding method and device
  • A panoramic video key frame coding method and device
  • A panoramic video key frame coding method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] figure 1 It is a schematic flow chart of a panoramic video key frame encoding method provided in Embodiment 1 of the present invention. Such as figure 1 As shown, the method includes the following steps:

[0053] S101. Acquire a spherical panoramic video key frame.

[0054] S102. Map the spherical panoramic video key frame into a planar panoramic video image according to a preset mapping method, and divide the planar panoramic video image into a plurality of planar views;

[0055] This step specifically includes: directly mapping the panoramic video key frame image into a planar panoramic video image according to a preset mapping method, and then dividing the planar panoramic video image into multiple planar views. There is a certain temporal and spatial correlation between these planar views. Depending on the mapping method, the resolutions of the multiple plane views generated by the mapping can be the same or different.

[0056]It should be noted that, in the em...

Embodiment 2

[0071] Figure 7 It is a schematic flowchart of a panoramic video key frame coding method provided in Embodiment 2 of the present invention. like Figure 7 As shown, the method includes the following steps:

[0072] S701. Acquire a spherical panoramic video key frame.

[0073] S702. Map the spherical panoramic video key frame into a planar panoramic video image according to a preset mapping method, and divide the planar panoramic video image into multiple planar views:

[0074] Steps S701 to S702 are the same as steps S101 to S102 in the first embodiment, and for the sake of brevity, no detailed description is given here. For details, refer to the relevant description of the first embodiment.

[0075] S703. Determine whether the shape of the plane view is a rectangle, if not, execute step S704, if yes, execute step S705:

[0076] S704. Process the non-rectangular plane view shape into a rectangle.

[0077] As an example, to process a non-rectangular planar view into a rec...

Embodiment 3

[0085] Figure 8 It is a schematic flowchart of a panoramic video key frame encoding method provided in Embodiment 3 of the present invention. like Figure 8 As shown, the method includes the following steps:

[0086] S801. Acquire a spherical panoramic video key frame.

[0087] S802. Map the spherical panoramic video key frame into a planar panoramic video image according to the quadrangular pyramid mapping method, and divide the planar panoramic video image into a square view and 4 triangular views.

[0088] S803. Determine whether the shapes of the plane views are all rectangles, and if not, perform step S804.

[0089] S804. Stitch the four triangular plane views into two square plane views.

[0090] S805. Arrange the mapped square view and the spliced ​​two square planar views into a new video sequence in scanning order.

[0091] S806. Encode one planar view in the video sequence in an I frame manner, and encode the other two planar views in a P frame manner.

[0092...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

This invention discloses an encoding method and configuration for panorama video key frame. The method includes: obtaining spherical panorama video key frame; converting the spherical panorama video key frame to planar panorama view key frame according to the preset mapping method; generating a new video sequence from the above planar panorama view key frames as their scanning order; encoding one planar view as I-frame method, and the rest as P-frame; integrating all planar views into a whole planar panorama video as separate previous positions ; reversely converting the panorama video to spherical panorama video key frame. Compared with current I-frame encoding method, this invention provides an encoding method which improves compress efficiency of panorama video key frame, saves network bandwidth and facilitates promotion and application of panorama video.

Description

technical field [0001] The present invention relates to the field of virtual reality (Virtual Reality, VR) video technology, in particular to a method and device for encoding key frames of a panoramic video. Background technique [0002] At present, VR (virtual reality) videos on the market are mainly panoramic videos. The video coverage angle of the panoramic video is 360 degrees horizontally and 180 degrees vertically. Compared with the normal video, the file data volume of the panoramic video is greatly increased. [0003] In addition, in the current encoding process of the key frame (I frame) of the panoramic video, such as adopting HEVC (HighEfficiency Video Coding, which is a new video compression standard, which can replace the H.264 / AVC encoding standard) or AVS (Audio Video Coding) Coding Standard (audio and video coding standard) encodes I frames, and only utilizes the spatial correlation within the frame, resulting in low compression efficiency of I frames. [0...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/161H04N19/42
CPCH04N19/42
Inventor 姜东侯明强洪定坤
Owner BEIJING BYTEDANCE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products