Mobile application crowdsourcing test report automatic evaluation method and computer storage medium

Abstract

The invention discloses a mobile application crowdsourcing test report automatic evaluation method and a computer storage medium, and the method comprises the following steps: 1), inputting a test report set and the historical credibility of a worker, removing an invalid test report, and carrying out the word segmentation and stop word removal of the remaining test report set; 2) clustering the test reports according to the discovered defects to form a plurality of types of defect test reports, and selecting the grade of the maximum proportion as the defect grade of the type of defect test reports; 3) constructing a plurality of normativity indexes and corresponding step type metric functions, evaluating the test report, and converting the evaluation into a normativity score of the test report; 4) according to the defect grade and the normativity score, obtaining the final score of the test report. The defect that an existing crowdsourcing test report quality evaluation method lacks test report content quality evaluation is overcome, and the overall performance of a crowdsourcing test platform is improved.

Description

technical field [0001] The invention relates to an automatic evaluation method and a computer storage medium, in particular to an automatic evaluation method and a computer storage medium for a mobile application crowdsourcing test report. Background technique [0002] The working method of mobile application crowdsourcing testing is to distribute the testing tasks of mobile application software performed by employees in the past to anonymous network users for testing through the Internet. Due to the improvement of defect discovery efficiency brought about by the diversity and complementarity of personnel in the crowdsourcing testing mode, crowdsourcing testing has attracted widespread attention in the industry, and many crowdsourcing testing commercial platforms (such as Applause, BaiduMTC, MoocTest, Testin, etc.) have emerged. ). The working method of crowdsourcing testing can help task demanders obtain a large number of freelance workers, and solve practical problems by ...

AI Technical Summary

Problems solved by technology

[0005] Purpose of the invention: The technical problem to be solved by the present invention is to provide a mobile application crowdsourcing test report automatic evaluation method and computer storage medium, which solves the deficiency that the existing crowdsourcing test report quality evaluation method lacks the quality evaluation of the test report content, from Evaluate the performance of workers from the two aspects of the level of defect content found and the standardization of test reports, which can correctly measure the quality of task completion of workers, eliminate workers with lax attitudes or malicious gold diggers, and encourage rational and excellent workers to be high Complete tasks qualitatively and improve the overall performance of crowdsourced testbeds

Images