Automatic detection and positioning method for application program user interface defects and electronic device

Abstract

The invention provides an automatic detection and positioning method for defects of a user interface of an application program and an electronic device. The method comprises steps of zooming a to-be-detected user interface picture to a set size, and obtaining a zoomed picture; carrying out convolution on the zoom image for one or more times, and carrying out batch standardization on the mean valueand variance of each convolution result; pooling the batch standardization result, classifying the obtained pooled features, and judging whether the to-be-detected user interface picture contains defects and defect categories or not. The method is advantaged in that the feature information of defects of a user interface of an application program is obtained through automatic detection screenshotand modeling, the defects of the user interface are detected and positioned on the screenshot, detection accuracy is guaranteed, detection cost is reduced, the manual detection process is reduced, thespeed is high, adaptability is high, and the method can be suitable for various operating systems.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to an automatic detection and positioning method and an electronic device for defects in an application program user interface. Background technique [0002] User Interface (UI) is the bridge for the interaction between the application and the user. A good UI design helps the user to use the application conveniently and efficiently, thereby improving the user experience of the application. UI design often requires proper user interaction, information architecture, and UI visual effects. At the same time, if there are UI bugs, it will greatly affect the user experience, resulting in the loss of users and economy. In the case of a relative shortage of professional testers in software companies, automated UI testing technology has been widely adopted by many software development companies. [0003] Automated testing tools mainly test various GUI components by simulating ...

AI Technical Summary

Problems solved by technology

Common application user interface defects are mainly divided into 5 categories: pictures cannot be displayed, components are blocked, text overlaps, the display is null, and the screen is blurred

Most of these defects are caused by compatibility issues. Although they will not cause the program to crash, UI rendering errors will greatly reduce the user experience

[0004] Most of the existing UI testing methods focus on code and UI coverage, and these application user interface defects will not cause problems such as program crashes, so it is difficult for traditional automated detection methods to detect them

At the same time, most of the existing automated UI testing tools will obtain a large number of application screenshots during the testing process, and these screenshots may contain application user interface defects that cannot be detected by the testing tools

Although the Chinese patent application CN108549608A discloses a UI screenshot testing method and system of an APP, it uses a large number of screenshots for simple similarity comparison, and cannot cross platforms and cannot obtain defect types.

Images