A Chinese Speech Synthesis Method Based on Phoneme and Prosodic Structure

A speech synthesis and rhythm technology, applied in speech synthesis, speech analysis, instruments, etc., can solve the problems of strong mechanical feeling, slow synthesis speed, unnatural sound, etc., to improve the speed of synthesis, sound quality and synthesis efficiency, Phoneme Set Simple Effects

Active Publication Date: 2022-04-22
XI AN JIAOTONG UNIV
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In order to solve the problems existing in the prior art, the present invention provides a Chinese speech synthesis method based on phoneme and prosodic structure, which is used to solve the problems that the synthesized voice is not natural enough, the mechanical sense is strong and the synthesis speed is slow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Chinese Speech Synthesis Method Based on Phoneme and Prosodic Structure
  • A Chinese Speech Synthesis Method Based on Phoneme and Prosodic Structure
  • A Chinese Speech Synthesis Method Based on Phoneme and Prosodic Structure

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The exemplary embodiments will be described in detail below in conjunction with the accompanying drawings:

[0033] Such as figure 1 As shown, the Chinese speech synthesis method based on phoneme and prosodic structure is divided into training phase and synthesis phase. During the training phase, the steps are as follows:

[0034] Step 1. Extract prosodic structural features from the prosodic labeling information of the text to be processed

[0035] Prosodic labeling information includes four pause levels of "#1", "#2", "#3", and "#4". The three levels of intonation phrase (IPH) and intonation phrase (IPH) have a certain inclusion relationship. The prosodic word boundary contains the prosodic phrase boundary, and the prosodic phrase boundary contains the prosodic intonation phrase boundary. Any position where a pause occurs in a sentence is a prosodic word boundary. The position where "#2", "#3" or "#4" appears is a prosodic phrase boundary, and the position where "#...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a Chinese speech synthesis method based on phoneme and prosodic structure, the method is divided into a training stage and a synthesis stage; according to linguistic knowledge, the prosodic structure features are extracted from the prosody marking information in the text to be processed, and the prosodic structure is based on the prosodic structure feature training prosodic model; preprocess the text and audio to be processed, obtain the pinyin sequence containing prosodic information and the corresponding acoustic features, then train the acoustic model, and deploy the trained prosody model and acoustic model to the background; The text corresponding to the input text contains its prosodic information; it is converted into a pinyin sequence with prosodic information and then input to the acoustic model to obtain its linear spectrum; the linear spectrum is converted into audio. It can make the synthesized voice more natural, especially for longer clauses, and can also determine the pause position. In addition, the model is deployed to the background during the synthesis stage, saving the time of model loading, which can speed up the speed of speech synthesis.

Description

technical field [0001] The invention belongs to the field of artificial intelligence, and in particular relates to a Chinese speech synthesis method based on phoneme and prosodic structure. Background technique [0002] Speech synthesis, also known as Text to Speech, or TTS for short, is an AI technology that converts text into sound, and plays a vital role in human-computer interaction. Whether it is application software such as voice assistants, map navigation, entertainment and education, or hardware devices such as air conditioners, speakers, and TVs, you can see the shadow of speech synthesis. With more and more scenarios where people interact with people, such as smart homes, autonomous driving, and smart medical care, users have put forward new requirements for the experience of human-computer interaction—synthesized voices are more natural and more like real people. This makes speech synthesis technology an increasingly hot research direction. [0003] Traditional ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G10L13/10G10L13/08G10L25/24G10L25/30
CPCG10L13/10G10L13/08G10L25/24G10L25/30
Inventor 张春霞谢壮壮
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap