Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Interface element processing method and device and electronic equipment

A technology of interface elements and elements, which is applied in the direction of program control devices, user interface execution, electrical digital data processing, etc., can solve the problem of loss of effectiveness, failure of GUI analysis programs to scan and analyze, and inability to respond to user operations on interface elements in a timely and accurate manner, etc. question

Pending Publication Date: 2021-04-06
SHENZHEN LIANDI INFORMATION ACCESSIBILITY CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, when the application does not follow the relevant development specifications, it loses its effectiveness
For example, because Microsoft Word does not follow MSAA, the GUI analysis program cannot scan and analyze the GUI information of Microsoft Word, resulting in the inability to respond to user operations on interface elements in a timely and accurate manner.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Interface element processing method and device and electronic equipment
  • Interface element processing method and device and electronic equipment
  • Interface element processing method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0042]The method and device provided by the embodiment of the present invention for allowing the GUI analysis program to identify and operate the interface elements that do not support Accessibility in the mobile device app, mainly for labeling the application program interface controls that do not follow the NVUI technology, and the graphical user interface program for labeling The information is loaded to obtain the graphical user interface information of the application program interface elements. The method and device for allowing the GUI analysis program to identify and operate interface eleme...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of graphical user interfaces of application programs, in particular to a method and a device for enabling a GUI analysis program to recognize and operate interface elements, which do not support Activity, of a mobile device app, and electronic equipment, and the method comprises the following steps: acquiring operation of a user on the interface elements of the application program; when it is detected that the operation is not responded within preset time, obtaining identification information of the interface element operated by the user from a screen road sign database, wherein the screen road sign database comprises at least one interface element and identification information corresponding to the interface element; and controlling a graphical user interface program to load the identification information to obtain graphical user interface information corresponding to the interface element. According to the invention, the operation of the user on the interface elements can be timely and accurately responded, and particularly when the GUI of the application program cannot be analyzed by the graphical user interface program, the user experience of the user who urgently uses the GUI of the application program can be obviously improved.

Description

technical field [0001] The invention relates to the technical field of graphic user interface of application programs, in particular to a processing method, device and electronic equipment of interface elements. Background technique [0002] A graphical user interface or a graphical user interface (Graphical User Interface, GUI) refers to a computer operating environment user interface displayed in a graphical manner. Graphical interfaces are easier for users to use than command-line interfaces used by early computers. The wide application of GUI is one of the major achievements in the development of today's computers. It greatly facilitates the use of non-professional users. People no longer need to memorize a large number of commands by rote. Easy to operate. [0003] As the GUI evolved, it became more complicated to run the GUI parser. Therefore, the GUI parsing program is forced to adopt the underlying technology to collect the information of the operating system to b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/38G06F9/451
CPCG06F8/38G06F9/451
Inventor 吴益明王孟琦
Owner SHENZHEN LIANDI INFORMATION ACCESSIBILITY CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products