Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for carrying out semantic voice search by sound stimulation induced ERP (event related potential)

A technology of sound stimulation and semantics, applied in the field of brain-computer interaction, to achieve the effect of improving reliability

Inactive Publication Date: 2013-05-01
ZHEJIANG UNIV
View PDF6 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] Based on this characteristic of ERP, some people have applied ERP to image search. For example, Professor Paul Sajda of Columbia University in the United States used the classic RSVP (Rapid Serial Visual Presentation) paradigm to induce ERP, and combined the analysis of ERP with computer vision. Realized the rapid image search in the database, however, there is no report on sound search by using ERP

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for carrying out semantic voice search by sound stimulation induced ERP (event related potential)
  • Method for carrying out semantic voice search by sound stimulation induced ERP (event related potential)
  • Method for carrying out semantic voice search by sound stimulation induced ERP (event related potential)

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] A method for semantic sound search using ERP induced by sound stimulation in the present invention will be described in detail below in conjunction with the accompanying drawings.

[0032] A method for carrying out semantic sound search using ERP evoked by sound stimulation, comprising the following steps:

[0033] (1) Apply various semantically related sound stimuli to the user, so that the user generates corresponding original EEG signals for various semantically related sound stimuli;

[0034] (2) collecting the original EEG signal generated by the user to the applied sound stimulation while applying the sound stimulation, and amplifying and digitizing the original EEG signal;

[0035] (3) ERP detection and analysis is performed on the EEG signal processed in step (2), and a type of semantic voice required by the user is determined according to the result of the ERP detection and analysis.

[0036] Such as figure 1 As shown, the sound stimulation parameters are set...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for carrying out semantic voice search by sound stimulation induced ERP (event related potential). The method comprises the following steps that (1) various kinds of semantic related sound stimulation are sequentially exerted to users, and the users generate corresponding original electroencephalograms on various kinds of semantic related sound stimulation; (2) the sound simulation is exerted, meanwhile, the original electroencephalograms of the users generated by the exerted sound simulation are collected, and the original electroencephalograms are subjected to amplification and digital processing; and (3) the electroencephalograms obtained in the step (2) are subjected to ERP detection analysis, and the required one-kind semantic sound of the users is determined in various kinds of semantic related sound stimulation exerted in the step (1) according to the ERP detection analysis results. The method for carrying out the semantic voice search by sound stimulation induced ERP has the advantage that the required one-kind semantic sound of the users can be fast and accurately searched by utilizing differences of ERP induced by targeted one-kind semantic sound simulation and non-targeted semantic sound simulation of the users.

Description

technical field [0001] The invention relates to the technical field of brain-computer interaction, in particular to a method for semantic sound search using ERP induced by sound stimulation. Background technique [0002] In the process of human perception of the external environment, sound is a very important medium, accounting for about 20% of the total information. With the rapid development of Internet technology, sound data grows geometrically, how to quickly and effectively search massive sound data has become an urgent problem to be solved. [0003] The current sound data search method is mainly based on text, that is, first generate the text annotation of the sound file, and then use the text search technology to realize the search for the sound data. However, due to many important features of the sound, such as the semantics contained in the sound, it is difficult to It is expressed in simple text, so text-based search methods are not suitable for searching sound da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 王怡雯蒋磊肖思远蔡邦宇张嘉璐陈卫东郑筱祥
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products