Chinese speech synthesis method based on phonemes and rhythm structures

Abstract

The invention provides a Chinese speech synthesis method based on phonemes and rhythm structures. The method is divided into a training stage and a synthesis stage, and comprises the steps of extracting therhythm structure features from the rhythm labeling information in a to-be-processed text according to the linguistic knowledge, and training a rhythm model based on the rhythm structure features; preprocessing the to-be-processed text and an audio to obtain a pinyin sequence containing the rhythm information and the corresponding acoustic features, then training an acoustic model, and deploying the trained rhythm model and acoustic model to a background; obtaining a text containing the rhythm information corresponding to the input text according to the rhythm model; converting into a pinyin sequence with rhythm information, and inputting into the acoustic model to obtain a linear frequency spectrum; and converting the linear frequency spectrum into the audio. According to the Chinesespeech synthesis method, the synthesized voice can be more natural, and especially for the longer clauses, the pause position can be determined. In addition, the model is deployed to the background at the synthesis stage, and the model loading time is saved, so that the voice synthesis speed can be increased.

Description

technical field [0001] The invention belongs to the field of artificial intelligence, and in particular relates to a Chinese speech synthesis method based on phoneme and prosodic structure. Background technique [0002] Speech synthesis, also known as Text to Speech, or TTS for short, is an AI technology that converts text into sound, and plays a vital role in human-computer interaction. Whether it is application software such as voice assistants, map navigation, entertainment and education, or hardware devices such as air conditioners, speakers, and TVs, you can see the shadow of speech synthesis. With more and more scenarios where people interact with people, such as smart homes, autonomous driving, and smart medical care, users have put forward new requirements for the experience of human-computer interaction—synthesized voices are more natural and more like real people. This makes speech synthesis technology an increasingly hot research direction. [0003] Traditional ...

AI Technical Summary

Problems solved by technology

[0007] In order to solve the problems existing in the prior art, the present invention provides a Chinese speech synthesis method based on phoneme and prosodic structure, which is used to solve the problems that the synthesized voice is not natural enough, the mechanical sense is strong and the synthesis speed is slow

Images