Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Speech synthesis method and device, equipment and storage medium

A technology of speech synthesis and speech fragments, applied in speech synthesis, speech analysis, instruments, etc., can solve problems such as reducing user experience

Active Publication Date: 2020-08-11
ZHEJIANG TONGHUASHUN INTELLIGENT TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Because the voice generation of Tacotron2 under the tensorflow development platform is a non-streaming method, and the voice will be output after the overall processing of the text content is completed, so the user experience is reduced

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Speech synthesis method and device, equipment and storage medium
  • Speech synthesis method and device, equipment and storage medium
  • Speech synthesis method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0041] In some processes described in the specification and claims of the present application and the above-mentioned drawings, multiple operations appearing in a specific order are included, but it should be clearly understood that these processes may include more or fewer operations, and These operations can be performed sequentially or in parallel.

[0042] The embodiment of the present application provides a speech synthesis method, device, device and storage medium; specifically, figure 1 It is a schematic diagram of the implementation flow of the speech synthesis me...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a voice synthesis method and device, equipment and a storage medium. The method comprises the following steps: obtaining a text vector after encoding a target text to be subjected to speech synthesis; obtaining a first vector segment obtained by decoding the text vector, and a first attribute feature corresponding to the first vector segment; wherein the first attribute feature at least can represent a word order position feature corresponding to the first vector fragment in the text content of the target text; performing voice synthesis processing on the first vectorsegment to obtain and output a first voice segment; and obtaining a second vector segment at least based on the text vector and the word order position features represented by the first vector segmentand the first attribute features. Thus, the purpose of converting stream output into stream output is achieved, a foundation is laid for reducing the overall output time, and meanwhile a foundation is laid for improving user experience.

Description

technical field [0001] The present application relates to the field of speech synthesis, in particular to a speech synthesis method, device, equipment and storage medium. Background technique [0002] In voice interaction scenarios, when text content needs to be converted into voice, fast and high-quality voice response is required. However, although the existing neural network synthesis solutions are of high quality, the synthesis speed is very slow. Taking the end-to-end neural network synthesis solution Tacotron2 as an example, if the CPU is used to decode it under the tensorflow development platform, it takes about 2.5 seconds to wait for a sentence of 5 seconds. The time can be generated, and the longer the voice time, the longer the waiting time. Because the voice generation of Tacotron2 under the tensorflow development platform is a non-streaming method, the voice will be output after the overall processing of the text content is completed, thus reducing the user exp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G10L13/02G10L13/04G10L13/06
CPCG10L13/02G10L13/04G10L13/06
Inventor 张鹏胡新辉徐欣康
Owner ZHEJIANG TONGHUASHUN INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products