Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Speech deep hash learning method and system based on CNN

A learning method and deep technology, applied in the field of speech retrieval based on deep learning, can solve the problems of manual feature defects, low query accuracy and efficiency, and achieve the effect of accelerating convergence speed, improving query accuracy and efficiency, and improving robustness.

Active Publication Date: 2020-12-04
LANZHOU UNIVERSITY OF TECHNOLOGY
View PDF9 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a method and system for deep hash learning of speech based on CNN, which can fully express the high-level semantic information of speech data, and solve the manual features existing in the feature extraction process of the traditional speech retrieval system based on perceptual hashing Defects and low query accuracy and efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Speech deep hash learning method and system based on CNN
  • Speech deep hash learning method and system based on CNN
  • Speech deep hash learning method and system based on CNN

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0096] This embodiment adopts the speech in the Chinese speech database--THCHS-3 released by Tsinghua University Speech and Language Technology Center (CSLT) to evaluate the proposed method, the speech sampling frequency is 16kHz, the sampling size is 16bits, and the speech content is 1000 sentences There are 13,388 speech clips in the database for news clips with different contents, each speech clip is about 10s long, and the total length is about 30 hours. In the experiment of the present invention, 10 sections of voices with different voice content spoken by 17 people were selected, and various voice content maintenance operations including volume adjustment, adding noise, weighting, resampling, MP3, etc. were carried out, and a total of 3060 voices were obtained. Speech training is expected to improve the robustness of the system while increasing the amount of data. In the experimental analysis stage, 1000 voices were randomly selected from the THCHS-30 voice library for e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a speech deep hash learning method and system based on CNN. The method comprises the following steps: preprocessing an original voice file to obtain a preprocessed original voice file; extracting spectrogram features of the preprocessed original voice file; inputting the spectrogram features into an improved convolutional neural network model for training and deep hash feature learning to obtain deep semantic features of an original voice file; performing deep hash sequence construction on the deep semantic features by using a learned hash function to obtain a deep hash binary code representing the original voice file; and performing voice retrieval according to the deep hash binary code. According to the method, the problems of limitation, poor feature representation and the like of manual features in the feature extraction process of an existing content-based voice retrieval system can be solved, and the retrieval precision and the retrieval efficiency can befurther improved.

Description

technical field [0001] The invention relates to the technical field of voice retrieval based on deep learning, in particular to a CNN-based voice deep hash learning method and system. Background technique [0002] With the explosive growth of the number of digital audio on the Internet, high-speed retrieval in speech / audio big data has become an urgent problem to be solved. Therefore, how to quickly retrieve the desired content from massive data has always been a hot issue in the field of speech retrieval research. Among them, speech has attracted extensive attention because of its special expressive function, and the importance and sensitivity of semantic content are reflected in applications such as conference recordings and court evidence. Therefore, the quality of speech feature extraction and the performance of feature expression will directly affect the subsequent retrieval effect. [0003] At present, most of the existing content-based speech retrieval methods const...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/683G06N3/04G06N3/08
CPCG06F16/683G06N3/08G06N3/045
Inventor 张秋余赵雪娇胡颖杰张其文白建赵振宇
Owner LANZHOU UNIVERSITY OF TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products