Man-machine interaction method and device

A technology of human-computer interaction and human voice, applied in the input/output of user/computer interaction, computer components, mechanical mode conversion, etc., can solve the problems of uncertainty, indistinguishability, and indistinguishability of the speaker's focus, and achieve Accurately identify effective input and optimize the effect of human-computer interaction

Inactive Publication Date: 2021-01-29
AISPEECH CO LTD
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If the speaker is speaking within a relatively short distance, the technology cannot distinguish whether the speaker is speaking to the interactive device, cannot determine whether the speaker's focus is on the interactive device, and cannot distinguish which are the invalid audio of the speaker

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Man-machine interaction method and device
  • Man-machine interaction method and device
  • Man-machine interaction method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0075] As an implementation manner, the above-mentioned electronic equipment is applied to a human-computer interaction device, including:

[0076] at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor so that the at least one processor can:

[0077] collecting first continuous image frames based on the camera device;

[0078] Using the first continuous image frame to identify the face attribute, identifying the distance value between the face attribute and the imaging device, and determining whether the distance value is within an effective distance;

[0079] When it is determined that the distance value is within the effective distance, the face orientation angle is determined using the face attribute, and the face orientation angle is compared with the standard face orientation angle to determine...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human-computer interaction method and device, and the method comprises the steps: collecting a first continuous image frame based on camera equipment; recognizing a face attribute by using the first continuous image frame, recognizing a distance value between the face attribute and the camera equipment, and judging whether the distance value is within an effective distance or not; when it is judged that the distance value is within the effective distance, the face orientation angle is determined through the face attributes, whether the face orientation angle is an effective angle or not is judged, and whether the time when the face orientation angle is the effective angle lasts for preset duration or not is judged; if the face orientation angle is the effective angle and the time when the face orientation angle is the effective angle lasts for a preset duration, collecting audio and judging whether the audio contains human voice or not, collecting a second continuous image frame at the same time, obtaining face features in the second continuous image frame, and judging whether the speaker is speaking or not at least based on the face features; and if the speaker is speaking, combining the audio and the facial features to obtain an effective audio.

Description

technical field [0001] The invention belongs to the field of artificial intelligence, and in particular relates to a human-computer interaction method and device. Background technique [0002] Human-computer voice interaction in public places (such as subway ticket machines, vending machines, large screens in exhibition halls, etc.), there is a lot of background noise. At present, there are methods of rejecting long-distance noise based on front-end signal processing technology of microphone array and methods of rejecting noise based on lip movement. [0003] Among them, based on the front-end signal processing technology of the microphone array, the microphone array hardware device is configured to reject long-distance noise, and the audio is collected. Through signal processing technology, the position of the sound source is calculated, and the audio of the far sound source is rejected according to the position of the sound source, so that Achieve noise rejection. If the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/16G06K9/00
CPCG06F3/011G06F3/167G06V40/171
Inventor 宋洪博邓建凯樊帅
Owner AISPEECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap