Formant-frequency-based Mandarin single final vioce visualizing method

Abstract

The invention provides a formant-frequency-based Mandarin single final voice visualizing method. The method comprises the following steps: framing and windowing an original voice signal; extracting short-time energy, formant frequency and fundamental tone frequency of each frame of signal; correcting errors of specific values of the formant frequency and the fundamental tone frequency by adopting a median smoothing method; mapping different pronunciations into different color aspects by utilizing the formant frequency, and correcting; reflecting variation tendency of pronunciation time, energy and fundamental tone frequency in an image; and differentiating different Mandarin single final pronunciations by colors. The method is easy to implement by only extracting acoustic phonetic parameters of short-time energy, formant frequency and fundamental tone frequency of a voice signal; soft decision is introduced, each pronunciation is not subject to hard decision, but represented by different colors, and visualizing effect of different speakers on the same pronunciation is based on the principle of seeking common grounds while reserving differences, so that the decision on pronunciation more accords with subjective perception of people.

Description

technical field [0001] The invention relates to a method for visualizing the speech of a single final in Mandarin Chinese, in particular to a method for visualizing the speech of a single final in Mandarin Chinese based on formant frequency, and belongs to the field of speech visualization. Background technique [0002] Speech is the sound that people make when they speak, and it is indispensable in people's daily life. But for the hearing-impaired, they cannot perceive speech through hearing, causing pain that normal people cannot understand. Studies have shown that in the process of people's perception of the outside world, the most information is acquired by vision, followed by hearing, and the combination of vision and hearing is more than any single sense of perception. In addition, experience tells us that charts are the most convenient and intuitive way for people to express their thoughts and understand things, so people also try to perceive speech visually, or use ...

AI Technical Summary

Problems solved by technology

However, in terms of its speech intelligibility, it is still difficult to achieve the ideal effect. Except for a very small number of experts, it is difficult for people to perceive the speech accurately and effectively by directly observing the movement of the vocal organs.

In addition, the visual effect is relatively simple and the expressive power is not strong

Images