A computer vision-based mobile application testing system and method

Abstract

The present invention discloses a computer vision based mobile terminal application testing system and method. The system comprises an image script test module and an automatic test module. The image script test module obtains screen images and screen information simultaneously, reads a template image in a script and information in the template image, and executes a template matching algorithm; if the match is successful, an image matching result is returned, and if the match fails, a feature point matching algorithm is executed; and if the match is successful, the image matching result is returned, and if the matching fails, failure codes are returned. The automatic test module obtains an original image, calculates a saliency grayscale image of the original image by using a saliency detection algorithm, converts the saliency image into a binary image, and applies a random algorithm or a K-means algorithm to the saliency binary image to determine a saliency point set to automatically finish clicking and recording. The system and the method disclosed by the present invention improve test efficiency, are applicable to a wide variety of mobile devices, and greatly reduce the learning cost and provide test convenience for a tester by using two manners of a given script and full-automation.

Description

technical field [0001] The invention belongs to the technical field of software testing, and relates to a mobile terminal application software testing method and a complete software testing system. In particular, computer vision algorithms are used to automatically identify and locate controls, which can be applied to automatic testing of mobile terminal software, using image scripts fit test. Background technique [0002] At present, mobile devices have a very large market. The operating systems of mobile devices mainly include IOS, Windows and Android, and the market for Android is very large. On the other hand, there are many types and quantities of applications and games on mobile, and a large number of developers develop mobile devices and make money through advertisements in the market and applications. Whether an application can be used and played by people for a long time, stability is very important. Whether there will be bugs, flashbacks, or black screens will dir...

AI Technical Summary

Problems solved by technology

[0004] However, at present, most Android application development, especially mobile game development, is usually generated using OpenGL, Cocosplay2D, Unity3D and other rendering tools. The entire operable controls are deployed on a canvas (covering the entire screen), which cannot To obtain its control information in the background service, it is impossible to use current tools such as Robotium for automated testing

[0005] Now the Android platform comes with a test tool Monkey, instead of testing with control information, this test tool can automatically generate random coordinates and random events to operate, because it is a completely random operation, so the efficiency is low, and it can only be used as a rough one at present. Stress testing tools cannot return accurate test results to meet accurate test requirements

Images