Image matching method, application testing method, device and system

A matching method and image technology, which is applied in the directions of software testing/debugging, error detection/correction, character and pattern recognition, etc., can solve the problems of wrong matching and low accuracy of image matching, so as to reduce wrong matching, improve accuracy, The effect of high image recognition accuracy

Pending Publication Date: 2021-07-16
ALIBABA GRP HLDG LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the different resolutions of the test terminals, the accuracy of image matching is low, and it is prone to mismatching

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image matching method, application testing method, device and system
  • Image matching method, application testing method, device and system
  • Image matching method, application testing method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0070] Embodiment 1 of the present invention provides an image matching method, referring to figure 1 shown, including the following steps:

[0071] Step S11: Obtain zoom images of multiple zoom ratios of the screenshot.

[0072] Specifically, starting from a preset minimum zoom ratio, multiple zoom images of the screen shot at preset intervals may be acquired until the zoom image of a preset maximum zoom ratio is obtained. For example, if the preset minimum zoom ratio is 50%, the maximum zoom ratio is 150%, and the preset interval is 1%, then 50%, 51%, 52%, ..., 100%, ..., 149 of the screenshot will be obtained sequentially % and 150% zoom scale.

[0073] Step S12: For each scaled image, determine at least one candidate matching area in the scaled image that matches the template image to be matched, and the similarity between the candidate matching area and the template image.

[0074] In one embodiment, before step S12 is performed, each scaled image and the template imag...

Embodiment 2

[0080] Embodiment 2 of the present invention provides a specific implementation of an image matching method, the process of which is as follows figure 2 shown, including the following steps:

[0081] Step S201: Perform grayscale processing on the screenshot and the template image to be matched.

[0082] Step S202: Determine the combined value of the hash fingerprint of the processed screenshot and the hash fingerprint of the processed template image.

[0083] Specifically, the hash fingerprints of the screenshot and the template image may be determined respectively by using a perception hash (perception hash, phash) algorithm; optionally, the hash fingerprints of the screenshot and the template map may be determined separately by using a gradient hash (difference hash, phash) algorithm The hash fingerprints of screenshots and template images can also use other hash fingerprint algorithms, and the specific algorithm is not limited in this embodiment, as long as it is consiste...

Embodiment 3

[0116] Each application needs to be tested on different types of terminals before it is released, or before an updated version of the application is released. It can be obtained by obtaining a screenshot of the user interface of the application on the specified terminal that contains only one functional component, as the to-be-matched the template image; capture a screenshot of the corresponding user interface on the terminal to be detected; determine the matching area of ​​the template image in the captured screenshot, and perform preset operations in the matching area to detect whether the components in the matching area are normal; Follow the method above to complete the detection of all components included in the application.

[0117] Embodiment 3 of the present invention provides a specific implementation of an application testing method, the flow of which is as follows Figure 4 shown, including the following steps:

[0118] Step S41: Obtain a screenshot of the user int...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an image matching method, an application testing method, a device and a system. The image matching method comprises the following steps: obtaining a plurality of scaling images of a screenshot; for each zoomed image, determining at least one alternative matching area matched with the template image to be matched in the zoomed image and the similarity between the alternative matching area and the template image; and determining the most similar alternative matching area as the matching area of the template image according to the similarity between the alternative matching area and the template image. The matching area of the template drawing can be accurately determined for screenshots with various resolutions.

Description

technical field [0001] The invention relates to the technical field of application development, in particular to an image matching method, an application testing method, a device and a system. Background technique [0002] Before the release of each application, or before the release of an updated version of the application, it is often necessary to conduct a walkthrough to investigate its performance, and manual walkthroughs are time-consuming and labor-intensive. Therefore, it is necessary to verify the image display layer and have good multi-terminal compatibility. Automated testing tools. [0003] During the automated testing process, image recognition needs to be performed, for example, matching small template images in the large screenshots of each test terminal, and then performing corresponding automated operations on the small regional images in the matched large screenshots. Since the resolutions of each test terminal are different, the accuracy of image matching ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06F11/36
CPCG06F11/3688G06V10/751G06F18/22
Inventor 姚建伟
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap