Multi-sensor group integration type detection method and head tracking-enabled surround sound method

Abstract

The invention relates to a multi-sensor group integration type motion detection method and a head tracking-enabled virtual surround sound generation method. According to the technical scheme of the motion detection method, multiple sensor groups are adopted to acquire the motion-related information, and then the final detection data can be obtained based on the detection data of the sensor groups. According to the technical scheme of the virtual surround sound generation method, virtual reality equipment is mainly composed of a headset and a head-worn type display. The head-worn type display is provided with a first sensor group. The headset is provided with a second sensor group. The motion angle of a user head is detected according to the above motion detection method. After that, the audio effect is rotated based on the motion angle of the user head, and then a virtual surround sound capable of tracking the motion of the head is generated and played through the handset. Based on the above detection method, the motion detection result is more accurate and more reliable. Meanwhile, the motion of the user head is tracked based on the above virtual surround sound generation method, so that the auditory effect is higher in quality.

Description

technical field [0001] The invention relates to a motion detection method for multi-sensor group fusion, and also relates to a virtual surround sound generation method supporting head tracking based on the multi-sensor group fusion method. Background technique [0002] When the user wears headphones to listen to virtual surround sound, when the user's head rotates, the virtual surround sound in the earphone will follow the rotation of the user's head, which makes people feel different when listening to music on the spot, and the generated virtual surround sound is not realistic enough. Therefore, it is necessary to use a motion sensor for head tracking (headtracking), so that a user (user) of a virtual reality device or a head-mounted display (head-mounted display, HMD) can obtain high-quality surround sound that is not affected by head movement. [0003] Existing motion sensors mainly include accelerometers, gyroscopes, and magnetic sensors, each of which has its own inhere...

AI Technical Summary

Problems solved by technology

For example, the accelerometer provides a gravity vector (the vector pointing to the center of the earth), while the magnetometer acts as a compass. The information from these two sensors can be used to calculate the orientation of the device. However, the output of these two sensors is not precise, including There is a lot of noise, and the gyroscope provides the angular velocity of the rotation along the three axes. This information is very accurate and the response is fast, but drift errors will occur for a long time. The reason is that the angular velocity needs to be integrated to obtain the direction information, and the The integration process will lead to small numerical errors, and the long-term accumulation of errors will form a relatively obvious drift

In order to maximize strengths and avoid weaknesses, the above three sensors are combined into a sensor group, and the signals of all sensors are calculated in an appropriate way to form more accurate motion detection results, which is sensor fusion. People have done research on sensor fusion and Some effective calculation methods have been obtained, but further improvement and optimization of fusion calculations are still conducive to technological progress. In particular, the error of a single sensor group is relatively large and even certain failures may occur. How to obtain more accurate detection results and ensure It is still a technical problem that needs to be solved to be able to operate effectively even in the event of a partial failure.

Images