Controllable emotion speech synthesis method and system based on emotion category labels

Abstract

The invention discloses a controllable emotional speech synthesis system and method based on an emotional category label. The method comprises steps of text feature extraction, extracting speech text features from an input phoneme sequence; a voice style feature extraction step for receiving acoustic features of a target voice corresponding to the phoneme sequence and extracting voice style features from the acoustic features; a voice style characteristic memorizing step used for obtaining emotional style characteristics of the target voice according to the voice style characteristics; and an acoustic feature prediction step used for predicting synthetic emotional speech acoustic features according to the speech text features and the emotional style features. According to the method, the decoupling degree of the voice style characteristics and the voice text characteristics can be improved, so the style regulation and control result of the synthesized voice is not limited by the text content, controllability and flexibility of the synthesized voice are improved, and emotional labels and emotional data distribution information of the voice in the corpus can be effectively utilized; therefore, the voice style characteristics of each emotion can be extracted more efficiently.

Description

technical field [0001] The invention relates to the technical field of artificial intelligence, in particular to a controllable emotion speech synthesis system and method based on emotion category labels. Background technique [0002] Emotion is an important paralinguistic information in human speech that reflects semantic information and speaker status in addition to text content. Emotional speech synthesis focuses on improving the richness of the speech output by the speech synthesis system in terms of expressiveness and the fidelity of the sense of hearing, thereby improving the naturalness of the synthesized speech, which is an important technical basis for improving the speech interaction experience. It has a variety of application prospects in various interactive scenarios such as novel generation. [0003] Among the traditional speech synthesis methods, the waveform splicing speech synthesis has high requirements on the corpus, and the sound quality and naturalness o...

AI Technical Summary

Problems solved by technology

[0006] However, the above methods have the following technical problems: (1) the flexibility and style controllability of the synthesis system are limited; (2) the synthesis system has defects in the use of style information in the corpus

Images