Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

39 results about "Crowdsourced testing" patented technology

Crowdsourced testing is an emerging trend in software testing which exploits the benefits, effectiveness, and efficiency of crowdsourcing and the cloud platform. It differs from traditional testing methods in that the testing is carried out by a number of different testers from different places, and not by hired consultants and professionals. The software is put to test under diverse realistic platforms which makes it more reliable, cost-effective, fast, and bug-free. In addition, crowdsource testing allows for remote usability testing because specific target groups can be recruited through the crowd.

Text description generating method, system and device of crowdsourcing test report

The invention discloses a text description generating method, system and device of a crowdsourcing test report. The method comprises the steps that screenshots and text descriptions in the test reportare acquired, key word sequences used for embodying test information in the text descriptions are determined, and hierarchical clustering is conducted on the screenshots according to a preset hierarchical clustering standard to obtain a plurality of sets of screenshot class clusters; the key word sequences which correspond to the test report and to which each screenshot in each set of screen capture class cluster belongs are input to a probability language model, and a class cluster text description generated by the probability language model is obtained; according to a preset classificationstrategy, the screenshot class cluster to which each to-be-diagnosed screenshot belongs in the to-be-diagnosed test report is determined, and a class cluster text description corresponding to the screenshot class cluster to which the to-be-diagnosed screenshot belongs is obtained. The number of the screenshots is large, the obtained text descriptions are rich, a developer can understand the test report, and the efficiency of diagnosing and understanding the test report is improved for the developer; the screenshots are objective, so that the diagnosis and understanding of the developer are noteasy to mislead.
Owner:SUZHOU UNIV

Mobile application crowdsourcing test report automatic evaluation method and computer storage medium

The invention discloses a mobile application crowdsourcing test report automatic evaluation method and a computer storage medium, and the method comprises the following steps: 1), inputting a test report set and the historical credibility of a worker, removing an invalid test report, and carrying out the word segmentation and stop word removal of the remaining test report set; 2) clustering the test reports according to the discovered defects to form a plurality of types of defect test reports, and selecting the grade of the maximum proportion as the defect grade of the type of defect test reports; 3) constructing a plurality of normativity indexes and corresponding step type metric functions, evaluating the test report, and converting the evaluation into a normativity score of the test report; 4) according to the defect grade and the normativity score, obtaining the final score of the test report. The defect that an existing crowdsourcing test report quality evaluation method lacks test report content quality evaluation is overcome, and the overall performance of a crowdsourcing test platform is improved.
Owner:ARMY ENG UNIV OF PLA

Voice recognition system crowdsourcing test case generation method based on test requirements

The invention discloses a voice recognition system crowdsourcing test case generation method based on test requirements. The method is characterized in that a provided voice recognition system is tested based on a crowdsourcing technology, the test requirements submitted by a task requester are recognized and extracted, a voice recognition keyword list in a preset keyword library is used for filtering out texts related to test case content from recognized text information fragments, and the texts serve as candidate test requirements. Three parts are included: a voice recognition test parametercollection module, a text extraction module and a test case generation module. Input is a text test demand, feature extraction is performed based on a user demand, and a test template is generated. The method has the following beneficial effect that the multi-dimensional and diversified requirements of ASR testing are met. The test participation threshold of crowdsourcing workers is reduced, testtasks are not limited by places and identities, and the crowdsourcing workers can sign up to participate in the test as long as the crowdsourcing workers have test tools and test capabilities, so that the test loss is reduced, and the product research and development period is shortened.
Owner:深圳慕智科技有限公司

Crowdsourcing test task selection method and electronic device

The invention provides a crowdsourcing test task selection method and an electronic device, and the crowdsourcing test task selection method comprises the steps: collecting task demand description andcorresponding crowdsourcing reports of n open crowdsourcing test tasks, and calculating each descriptive term vector of each open crowdsourcing test task; extracting task selection features and inputting the task selection features into a task selection model through acquired activity information of a crowdsourcing test person and preference information and specialty information of each descriptive term vector of an i-th open crowdsourcing test task, and predicting the defect discovery probability of the crowdsourcing test person in each open crowdsourcing test task, i being greater than or equal to 1 and less than or equal to n; and selecting an optimal crowdsourcing test task based on the probability of discovering the defects. According to the crowdsourcing test task selection method,task information and crowd-testing personnel information on the crowd-testing platform are better represented; proper tasks are selected for crowd-testing personnel by mining and modeling historical records of the personnel; the task selection and exploration time of the personnel is shortened; the defect discovery efficiency of the personnel is improved; and the income of the personnel on the crowd-testing platform is improved.
Owner:INST OF SOFTWARE - CHINESE ACAD OF SCI

Crowdsourcing system-oriented simulation test case generation method and device

PendingCN113342655AAssessment reliabilitySolve the problem that the posterior distribution is not easy to estimateSoftware testing/debuggingCrowdsourced testingEngineering
The invention discloses a crowdsourcing system-oriented simulation test case generation method and device, and the method comprises the steps: firstly inputting a sample obtained by a crowdsourcing platform into a VAE encoder, and learning a mean value and a variance of worker capability and task difficulty labeled for a real sample, namely obtaining the normal distribution of the corresponding worker capability and task difficulty; meanwhile, generating Gaussian mixture distribution of the capabilities and task difficulties of all workers participating in labeling; secondly, obtaining hidden variables of the VAE by using a reconstruction technique, inputting the hidden variables into a decoder of the VAE, and training the decoder by using gradient descent; and finally, inputting the worker ability and task difficulty randomly generated by Gaussian mixture distribution into a trained decoder, and generating a large number of crowdsourcing test cases which are independent and identically distributed with a real sample. According to the method, the neural network is combined to solve the problem that the crowdsourcing test cases are few and the coverage is narrow due to the cost, so that the result convergence method is difficult to comprehensively evaluate, and the crowdsourcing result convergence method can be comprehensively and effectively evaluated.
Owner:ZHEJIANG GONGSHANG UNIVERSITY

Test coverage calculation method and device based on execution path tracking technology

The invention discloses a test coverage calculation method and device based on an execution path tracking technology. The method comprises the following steps: collecting change data when a user triggers a control; sorting the change data according to the order of responding to the user triggering controls to obtain a sorted chart; counting execution paths based on the response chart, and performing gathering to generate a test execution path event set; and respectively calculating the test coverage rate and the trigger proportion of each execution path by adopting the test execution path event set. According to the method and device, test execution paths of different crowdsourcing workers can be tracked, and respective test coverage rates of the crowdsourcing workers can be counted and calculated and are fed back to the crowdsourcing workers in real time, so that the crowdsourcing workers can better understand the test defects of the crowdsourcing workers, and then more sufficient testing is carried out to ensure test coverage in crowdsourcing testing; and meanwhile, according to the triggering proportion of each event, a developer can better find the problem and the part in which people are interested, so that the mobile application is further perfected.
Owner:广东拓思软件科学园有限公司

Chinese crowdsourcing test report clustering method based on semantic similarity

The invention discloses a Chinese crowdsourcing test report clustering method based on semantic similarity, and the method comprises the steps: inputting a Chinese test report set, removing invalid test reports, and carrying out the sentence segmentation of effective test reports, and obtaining a test report sentence pair data set; constructing a test report sentence pair training set to train the semantic similarity model to obtain a semantic similarity calculation model; inputting the test report sentence pair data set into a semantic similarity calculation model for semantic similarity calculation to obtain a test report similarity matrix; setting an expected bug number of the test item, and performing spectral clustering according to the test report similarity matrix to obtain a test report class cluster; and decomposing the test report similarity matrix according to the test report class clusters to obtain the test report similarity matrix of each class cluster, and calculating a test report with an accumulated similarity score Top-5 in each class cluster as a final output result. The test report review automation process of the crowdsourcing test platform is improved, and the test report review efficiency is effectively improved.
Owner:ARMY ENG UNIV OF PLA

Quality control method for collaborative crowdsourcing testing

The invention provides a cooperative crowdsourcing test oriented quality control method, and realizes a cooperative crowdsourcing test oriented quality control system on the basis of the cooperative crowdsourcing test oriented quality control method. The method is characterized in that 1, each operation of the crowdsourcing workers is evaluated and fed back in real time, so the quality awareness of the crowdsourcing workers is improved, and the disastrous behaviors of the crowdsourcing workers are recorded; 2, the quality grade of the report is determined through automatic scoring of the report, and a favorable reference is provided for managers to identify effective reports; and 3, a report auditing function is provided, so that a manager can conveniently check all information of the report and quickly and accurately auditing the report. The invention has the beneficial effects that the quality consciousness of crowdsourcing workers is improved through various designed quality controlmethods, the ratio of effective Bug reports in test tasks is improved, and managers are helped to identify the Bug reports and the quality of the crowdsourcing workers more quickly and accurately.
Owner:NANJING MUCE INFORMATION TECH

Crowdsourcing test report recommendation method and device, and electronic equipment

The embodiment of the invention provides a crowdsourcing test report recommendation method and device, and electronic equipment. The method comprises the following steps: obtaining a first defect report and a plurality of historical defect reports, determining a first feature vector of the first defect report and a second feature vector of each historical defect report, determining the similarity between the first feature vector and each second feature vector, and sorting the similarities; the historical defect reports are recommended on the basis of the sorting result, whether the defect reports similar to the first defect report exist in the historical defect reports or not can be determined, and therefore the defect reports with repeated content are prevented from occurring in the process that a user edits the first defect report, and the accuracy of the crowdsourcing test task is improved.
Owner:广东拓思软件科学园有限公司

Cooperation method for crowdsourcing test platform

The invention provides a cooperation method for a crowdsourcing test platform, and the method has a reasonable guide mechanism and a real-time similar report recommendation mechanism, so crowdsourcingworkers carry out crowdsourcing software testing in a cooperation mode. The method is characterized in that the method comprises the steps: 1, analyzing the page structure of an application to be tested, enabling a defect report to carry a page label, and guiding the crowdsourcing workers to test by displaying page coverage of defects through Echarts Graph; 2, recommending similar defect reportsin real time through defect report label screening and text similarity calculation. 3, adding the user cooperation such as Fork modification, like clicking and treading of the defect reports, so thatthe defect reports are divided into a single type and a tree type, and crowdsourcing workers can audit the defect reports. The method has the beneficial effects that the test path is visualized through the page structure of the to-be-tested application, crowdsourcing workers are guided to reasonably test, and the test coverage rate is increased; through similar report recommendation, the number ofrepeated reports is reduced; and through a user cooperation mode, the quality of the defect report is iteratively improved.
Owner:NANJING MUCE INFORMATION TECH

Crowdsourcing test report clustering method based on AP affinity propagation algorithm

The invention discloses a crowdsourcing test report clustering method based on an AP affinity propagation algorithm. According to the method, firstly, keywords are extracted by utilizing a natural language processing technology, and identical or similar words are replaced by the same word by utilizing a synonym forest, so that the semantic deviation problem caused by different words is effectively solved. Then an asymmetric similarity strategy is adopted to calculate the similarity between test reports, and the strategy can effectively solve the problem that the similarity calculation is inaccurate under the condition that the length difference of the test reports is large. Finally, the test reports are clustered by using an AP affinity propagation clustering algorithm. Through the method, a crowdsourcing test report clustering effect can be improved, a developer only needs to select one test report from each cluster for examination, the examination time of the developer is greatly shortened, and the method has very important significance on software maintenance.
Owner:HANGZHOU DIANZI UNIV

Crowdsourcing test task allocation method based on student ability matching

The invention discloses a crowdsourcing test task allocation method based on student ability matching, which depicts student ability based on multiple dimensions and quantitatively evaluates the student ability level of each dimension through a fuzzy analytic hierarchy process. A test task attribute is taken as a demand guide to assign a weight of each dimension capability level, and a comprehensive capability matching value is calculated to serve as a matching basis for distributing crowdsourcing test tasks, so that a test platform can formulate an accurate and reasonable crowdsourcing test distribution strategy, the efficiency of the crowdsourcing test tasks is effectively improved, the quality of a test report is guaranteed, and the purposes of generating industry and education deep cooperation, providing professional talents for the industry and improving talent training quality for colleges and universities are achieved.
Owner:GUANGZHOU PANYU POLYTECHNIC

Crowdsourcing test report fusion method based on public and private information mining

A crowdsourcing test report fusion method based on public and private information mining comprises the steps that (1) feature mapping is carried out, each mode comprises public information shared by all modes and private information of the modes, and the modes extracted from an original feature space are mapped into public vectors and private vectors of the same dimension; (2) public information shared by all the modes included in different modes and private information of each mode are obtained; 3) modal relationship mining is carried out, and the obtained d-dimensional public information Ci and private information Sim are sequentially input into the LSTM for processing; and 4) label prediction is carried out, in multi-label learning, each mode has a specific contribution to multi-label prediction, and the relationship between labels is obtained by using the information of the different modes stored in an LSTM memory unit. According to the method, the low-dimensional common representation of all modes can be learned, the distinguishing information of each mode is extracted through forced orthogonal constraint, meanwhile, the common representation serves as a new mode to be added into a specific mode sequence, and label correlation mining based on the extracted mode sequence is achieved.
Owner:NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products