Video input auditory sensation displaying blind guiding device and method based on voice control

A technology of voice control and video input, which is applied in the field of signal processing, can solve problems such as difficulty for users to focus on the area of ​​interest, low resolution of auditory display, inconvenient use by blind people, etc., to achieve convenient control, high resolution of auditory display, The effect of reducing the use of hands

Inactive Publication Date: 2018-10-26
SOUTH CHINA UNIV OF TECH
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But there are also some shortcomings in the existing visual input auditory display guide system, such as: (1) inflexible control
In the existing blind-guiding system with video input and auditory display, it is difficult for users to perform actions such as gazing at the area of ​​interest and focusing on the distance as conveniently as using visual organs. Some system settings also need to be performed through buttons, which is inconvenient for blind people to use.
(2) The resolution of the auditory display is low
In the existing blind-guiding system with video input and auditory display, the auditory display usually has a fixed mapping relationship with the video input screen, so the auditory display has a fixed resolution and it is difficult to provide users with more information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video input auditory sensation displaying blind guiding device and method based on voice control
  • Video input auditory sensation displaying blind guiding device and method based on voice control
  • Video input auditory sensation displaying blind guiding device and method based on voice control

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0056] The video input auditory display guide device based on voice control provided by this embodiment has a structure such as figure 1 As shown, it is composed of a video acquisition module, a video-audio conversion module, an audio playback module, a voice acquisition module, and a voice recognition module, wherein the video acquisition module, the video-audio conversion module, and the audio playback module are connected in sequence, and the voice acquisition module, The speech recognition module and the video-audio conversion module are connected in sequence. The voice acquisition module is used to collect voice signals; the video-audio conversion module is used to complete the functions of extracting image information from video signals, mapping image information into audio signals, and changing the current region of interest and mapping parameters according to the results of voice recognition; audio playback The module is used to play the audio synthesized by the proces...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video input auditory sensation displaying blind guiding device and method based on voice control. Through a voice instruction given out by a user, setting of area of interests and other system parameters in images is controlled, so quite high auditory sensation display resolution and a quite flexible control method are provided for users, the device and the method conformto habits of auditory sensation; hands of users can be released; users can do other things in most of time; and the system and the method can be widely applied to all kinds of application occasions where blind guidance is required. According to the invention, by setting area of interests through voice, the flexible auditory sensation displaying resolution and control method is provided for users;users are capable of sensing global information or local detail information of images through setting of the area of interests; and the disadvantage of low auditory sensation displaying resolution can be effectively overcome.

Description

technical field [0001] The invention relates to the technical field of signal processing, in particular to a video input auditory display guide device and method based on voice control. Background technique [0002] According to the statistics of the National Disabled Persons' Federation in 2015, there are about 17 million blind people in my country, and about 23 million elderly people with amblyopia. Due to the differences in individual causes of blindness, there are a large number of cases of incurable blindness, and even if some patients can be treated with surgery or organ replacement, there are still great risks in technology and use. Therefore, the guidance of assisting the blind to travel There is a huge demand for blind products in real life. [0003] Commonly used traditional blind guide products mainly include electronic guide devices and guide dogs. Most electronic blind guide devices use ultrasound to detect obstacles, including blind guide canes, electronic bl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L15/22G06K9/32
CPCG10L15/22G06V10/25
Inventor 张军戴兵兵王杰宁更新冯义志季飞
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap