Barrier-free entity interface interaction system based on smart phone interface

Abstract

The embodiment of the invention discloses a barrier-free entity interface interaction system based on an intelligent mobile phone interface, which comprises an interface layout unit, an input mode unit, a translation logic unit and an information feedback unit, and is characterized in that an interaction agent is established between a graphical interface and a user and consists of a mobile phone program and a mobile phone film, the agent converts visual and auditory information output by the smart phone into auditory and tactile information which can be understood by the visually impaired person, and converts sound and touch information which can be easily input by the visually impaired person into instructions for the smart phone, so that the man-machine interaction process is completed. The method can be universally used for an Android system and an IOS system, mutual conversion between graphic information and auditory sense and tactile sense information is achieved through the mobile phone pasting film with the entity protruding structure in combination with a program in a mobile phone, the problems occurring in information interaction of a visual impaired group in a graphic interface are solved, and the visual impaired group is more interesting. A visually impaired group can obtain content information and complete a task flow in an efficient and convenient manner when using the smart phone.

Description

technical field [0001] The invention relates to the technical field of human-computer interaction, in particular to a barrier-free physical interface interaction system based on a smart phone interface. Background technique [0002] With the development of the Internet and the maturity of mobile device hardware technology, modern advanced smart terminals for mobile devices such as smart phones are emerging in an endless stream. Since these products almost all use touch screen technology, the control method adopted is to affect the program through the touch screen. And display the corresponding feedback information on the screen, and then proceed to the next step of control and operation after visually seeing the feedback information. But for the visually impaired people in society, they cannot obtain the information displayed on the screen through their eyes, so they cannot perform touch operations on traditional smart terminal devices, and thus cannot obtain the convenience...

AI Technical Summary

Problems solved by technology

[0005] Regardless of barrier-free programs or Smart touch, assistive technologies such as screen readers and hardware devices have certain adaptation limitations to the application of the environment, resulting in visual impairment People have certain obstacles when using mobile terminals

The main manifestations are: 1. The operation process of the barrier-free program that comes with the Android and Apple systems is complicated. 2. There are major obstacles in transferring the content of the icon. 3. Compatibility with third-party applications. 4. Smart touch can only be compatible with Alibaba Group. Some of its products are adapted

Images