Dynamic sound effect adjusting method and system based on mixed reality space

Abstract

The invention provides a dynamic sound effect adjusting method and system based on a mixed reality space, and sound effects are adjusted for audiences based on story plots in the mixed reality space, and the method is characterized in that the method comprises the following steps: obtaining a mixed sound effect, and dividing the mixed sound effect into a story sound effect and an environment sound effect; obtaining a view cone of the audience and a sound source corresponding to the story sound effect; judging whether the sound source is in a visual cone or not; when the sound source is in the view cone, judging whether the story sound effect is greater than a preset maximum story sound effect threshold value or not, and if not, improving the story sound effect to the maximum story sound effect threshold value; judging whether the environment sound effect is greater than a preset maximum environment sound effect threshold value or not, and if yes, reducing the environment sound effect to the maximum environment sound effect threshold value; when the sound source is not in the view cone, judging whether the story sound effect and the environment sound effect are adjusted or not, and if yes, adjusting the adjusted story sound effect and the adjusted environment sound effect to the original sound effect.

Description

technical field [0001] The invention belongs to the field of dynamic sound effect adjustment, and in particular relates to a dynamic sound effect adjustment method and system based on a mixed reality space. Background technique [0002] Mixed reality space refers to the mixing of virtual characters, characters and props in the real world, so that the boundary between the real world and the story world is blurred, and the audience can better enter an immersive panoramic world. In traditional flat movies, The sound designer will carry out sound mixing design in advance according to the camera position, movement trajectory and expected artistic effect, so that the audience can easily enter the movie plot. However, in the narrative in the immersive space, the audience can move and watch freely. It may cause the ambient sound to overwhelm the story sound. In addition, the sound is a spatial sound, that is, the volume will increase when it is close to the sound source, and the vol...

AI Technical Summary

Problems solved by technology

[0002] Mixed reality space refers to the mixing of virtual characters, characters and props in the real world, so that the boundary between the real world and the story world is blurred, and the audience can better enter an immersive panoramic world. In traditional flat movies, The sound designer will carry out sound mixing design in advance according to the camera position, movement trajectory and expected artistic effect, so that the audience can easily enter the movie plot. However, in the narrative in the immersive space, the audience can move and watch freely. It may cause the ambient sound to overwhelm the story sound. In addition, the sound is a spatial sound, that is, the volume will increase when it is close to the sound source, and the volume will decrease when it is far away from the sound source, which will affect the audience's experience of the story.

Images