56 results about "Prosody" patented technology

A contour for a syllable (or other speech segment) in a voice undergoing conversion is transformed. The transform of that contour is then used to identify one or more source syllable transforms in a codebook. Information regarding the context and / or linguistic features of the contour being converted can also be compared to similar information in the codebook when identifying an appropriate source transform. Once a codebook source transform is selected, an inverse transformation is performed on a corresponding codebook target transform to yield an output contour. The corresponding codebook target transform represents a target voice version of the same syllable represented by the selected codebook source transform. The output contour may be further processed to improve conversion quality.

A prosody generation apparatus capable of suppressing distortion that occurs when generating prosodic patterns and therefore generating a natural prosody is provided. A prosody changing point extraction unit in this apparatus extracts a prosody changing point located at the beginning and the ending of a sentence, the beginning and the ending of a breath group, an accent position and the like. A selection rule and a transformation rule of a prosodic pattern including the prosody changing point is generated by means of a statistical or learning technique and the thus generate rules are stored in a representative prosodic pattern selection rule table and a transformation rule table beforehand. A pattern selection unit selects a representative prosodic pattern from the representative prosodic pattern selection rule table according to the selection rule. A prosody generation unit transforms the selected pattern according to the transformation rule and carries out interpolation with respect to portions other than the prosody changing points so as to generate prosody as a whole.

A language processing portion (31) analyzes a text from a dialogue processing section (20) and transforms the text to information on pronunciation and accent. A prosody generation portion (32) generates an intonation pattern according to a control signal from the dialogue processing section (20). A waveform DB (34) stores prerecorded waveform data together with pitch mark data imparted thereto. A waveform cutting portion (33) cuts desired pitch waveforms from the waveform DB (34). A phase operation portion (35) removes phase fluctuation by standardizing phase spectra of the pitch waveforms cut by the waveform cutting portion (33), and afterwards imparts phase fluctuation by diffusing only high phase components randomly according to the control signal from the dialogue processing section (20). The thus-produced pitch waveforms are placed at desired intervals and superimposed.

A method (and system) which autonomously generates a cohesive script from a text database for creating a speech corpus for concatenative text-to-speech, and more particularly, which generates cohesive scripts having fluency and natural prosody that can be used to generate compact text-to-speech recordings that cover a plurality of phonetic events.

Systems are configured for generating spectrogram data characterized by a voice timbre of a target speaker and a prosody style of source speaker by converting a waveform of source speaker data to phonetic posterior gram (PPG) data, extracting additional prosody features from the source speaker data, and generating a spectrogram based on the PPG data and the extracted prosody features. The systems are configured to utilize / train a machine learning model for generating spectrogram data and for training a neural text-to-speech model with the generated spectrogram data.

The present disclosure relates to a speech synthesis apparatus and method that can remove discontinuity between phoneme units when generating a synthesized sound from the phoneme units, thereby implementing natural utterances and producing a high-quality synthesized sound having stable prosody.

The invention belongs to the technical field of voice processing and image processing, and discloses an auxiliary detection method and a classifier for depression based on acoustic features and sparse mathematics, and a depression discrimination based on joint recognition of voice and facial emotion; realizing glottis through an inverse filter For signal estimation, global analysis is used for the voice signal, feature parameters are extracted, the timing and distribution characteristics of the feature parameters are analyzed, and the prosody of different emotional voices is found as the basis for emotion recognition; MFCC is used as the feature parameter to analyze the voice signal to be processed, and the Multiple sets of training data are collected from the recorded data, and a neural network model is established for discrimination; the sparse linear combination of test samples is obtained by using the sparse representation algorithm based on OMP, and the facial emotions are discriminated and classified, and the obtained results are compared with speech recognition The results are linearly combined to obtain the final probability representing each data point. The depression recognition rate has been greatly improved and the cost is low.

It would be desirable to have audio and / or video systems and processing tools that can automatically record audio / video and analyze such recordings to capture material that may be relevant to the user. In one or more embodiments disclosed herein, recordings may be compressed by using one or more tools, including but not limited to, converting speech to text and searching for relevant content, keywords, etc.; detecting and analyzing speakers and and / or classify content (e.g., events in a conversation); remove non-substantial content (e.g., silence and other extraneous content); adjust audio to increase playback speed; use rhythm and other markers in audio to identify areas of interest; Perform segmentation clustering; use pseudo-random or random samples to select content; and other methods of extracting information to provide a summary or representation of record content for user review.

The present application relates to the technical field of information processing, and discloses an audio detection method, device, electronic equipment, and a readable storage medium. The audio detection method includes: receiving the audio to be detected and the text corresponding to the audio sent by the terminal; combining the audio with the text Perform alignment processing to obtain the start and end time of each phoneme of multiple phonemes corresponding to the text in the audio; extract the phoneme feature vector of each phoneme in the audio, and obtain the audio sequence feature of the audio based on the start and end time of each phoneme; The phoneme feature vector and the audio sequence feature are used to obtain the prosody detection result of the audio; the prosody detection result includes the accent feature and the pause feature of the audio; the prosody detection result is returned to the terminal, so that the terminal displays the text corresponding to the accent feature and the pause feature. The audio detection method provided by the present application can improve the accuracy of prosody detection results.

The invention provides a rhythm marking method, device and equipment. The method comprises steps that voice data of a to-be-marked text is obtained; according to the voice data, the rhythm informationof the voice data is determined, and the rhythm information is used for indicating the pause duration of the voice data; rhythm symbols of the to-be-marked text are marked according to the rhythm information of the voice data. The method is advantaged in that rhythm marking efficiency and accuracy are improved.