Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Immersive media data transmission method adapting to human eye perception condition

A technology of media data and human perception, which is applied in the field of video transmission and computer vision, and can solve problems such as large data flow

Inactive Publication Date: 2019-07-30
NANJING UNIV
View PDF7 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of the above situation, the present invention proposes an immersive media data transmission method that adapts to human perception, and solves the problem of excessive data flow during transmission by assigning different video qualities to different visual areas

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Immersive media data transmission method adapting to human eye perception condition
  • Immersive media data transmission method adapting to human eye perception condition
  • Immersive media data transmission method adapting to human eye perception condition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034]In this embodiment, the H.264 quantization parameter q of each region is regulated, and the specific implementation steps are as follows:

[0035] Step 1, low-quality immersive media data is pre-transmitted. The panorama data is compressed and transmitted to the local end according to QP=48 (ie, q≈161).

[0036] Step 2, when the user browses smoothly, the image quality in the field of view area is calculated according to compression, where q min is the corresponding value when QP=22, that is, it is equal to 8, and θ is the centrifugal angle of the center of the field of view in the horizontal direction. Among them, the details of each parameter are shown in Table 1.

[0037] Table 1 Values ​​of each parameter in the model when the quantitative parameter q is adjusted

[0038]

[0039] In practical application, it is suggested to adopt the reference table of discrete control parameters to realize partition quality control. Here, the transmission of 4K panorama im...

Embodiment 2

[0052] In this embodiment, the resolution s of each region is regulated, and the specific implementation steps are as follows:

[0053] Step 1, low-quality immersive media data is pre-transmitted. The panorama data is compressed and transmitted to the local end according to s=1024x540.

[0054] Step 2, when the user browses smoothly, the image quality in the field of view area is calculated according to compression, where s max It is 4096x2160, and θ is the centrifugal angle of the center of the field of view in the horizontal direction. Among them, the details of each parameter are shown in Table 3.

[0055] Table 3 Values ​​of parameters in the model when adjusting the resolution s

[0056]

[0057] It can be seen from the above table that the control parameter c is in is a fixed value in , and in is context-dependent, which may be due to the fact that existing Vive headsets do not provide sufficient pixel density to accurately reflect the amplitude changes cause...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an immersive media data transmission method adapting to a human eye perception condition. The method comprises the following steps of S1, before a user starts to browse, pre-storing part of low-quality panoramic video data to a user side; s2, when the user starts to browse stably, enabling the server side to transmit the high-quality view field area content according to thecurrent visual behavior of the user, and distributing the non-uniformly distributed image quality under the current view field based on the current sight drop point of the user; s3, during the process that the visual focus of the user is migrated to the next region from the current region, providing the data in the view field of the VR helmet by the pre-stored low-quality panoramic video data, and continuously pre-storing the low-quality panoramic video data to the user side; and S4, when the user recovers stable browsing and the sight line is migrated again, repeating the steps S2 and S3 until the observation is stopped. According to the method, the size of the VR data flow can be effectively reduced, and meanwhile it can be guaranteed that the subjective perception quality of the videocontent in the whole view field area is not changed.

Description

technical field [0001] The invention relates to the fields of video transmission and computer vision, in particular to an immersive media data transmission method adapted to human perception. Background technique [0002] At present, immersive media, such as VR (virtual reality) helmets and VR glasses, have gradually entered the public eye, and many top IT companies (such as Facebook / Oculus, HTC, Google, etc.) are increasing their investment in the immersive media market. Excellent VR equipment needs to ensure high-definition visual scenes and interactive behaviors without perceptual delay. The stable transmission of high-frame-rate high-definition video data brought about by this has put forward certain requirements on network bandwidth. How to efficiently transmit VR data streams with high quality is an urgent problem in the current VR market. [0003] At present, in order to ensure interaction without perceptual delay and high-quality visual experience, the data transmit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/2343H04N21/2662H04L29/06G06F3/01
CPCH04N21/2343H04N21/2662H04L65/80G06F3/013H04L65/762
Inventor 马展郭珮瑶沈秋周熔冰黄铭锴曹汛
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com