801 results about "Test management" patented technology

Embodiments relate to systems and methods for testing and evaluating software in the network cloud. A developer or other operator may wish to debug, modify, or update a set of test software based on testing of that software. The developer can instantiate a set of virtual servers or other test beds in the cloud, and install the subject software to the virtual test beds. A test management module can monitor the execution of the set of test software on the set of virtual test beds, to detect execution faults, measure processing performance, stress-test the software with predetermined data inputs, and manage other aspects of software life cycle development. The test management module can provide or access a set of application programming interfaces to a set of software tools external to the cloud, so that the set of test software can be tested and optimized using external programming development tools.

A virtual reality (VR)-based test battery wherein various neurobehavioral performance skills, including motor skills, sensory-perceptual skills, attention, and decision-making can be measured in human subjects. The invention can be used as a screening method within a virtual environment to provide an overall measure of general brain function relating to behavioral ability. In addition, the invention provides comprehensive VR-based neurobehavioral examinations tailored to individual subjects which can automatically self-adjust during operation in accordance with the specific purpose of the assessment, or for forms of cognitive or physical rehabilitation. According to the invention, patients with neurological and psychiatric dysfunctions can be assessed with physiologic monitoring as well as with anatomical and functional neuroimaging to non-invasively map the functional neuroanatomic correlates of VR-based test performance. In a preferred embodiment, the VR-based neurobehavioral testing system is portable allowing computerized tests to be administered in a desk-top or lap-top configuration, or via the Internet for tele-assessment of human subjects who are physically inaccessible to the test administrator. In a particularly preferred embodiment, the method of the invention is used for vocational assessment and training, wherein individual test scores are combined into a final metric useful for assessing a candidate's qualifications for employment, or certification in a particular skill.

The invention discloses an automatic detection system of an embedded type system based on a testing script technique, comprising a crosslink environment modeling module, a testing panel allocation module, a testing script interpreter, a multi-task scheduling module, an interface drive module, a data collection module, a testing report generation module and a testing management module. The multi-task scheduling module transmits registered tasks interpreted by the script interpreter to the interface drive module through the crosslink environment modeling module, then the interface drive module excites a system to be tested to finish the test, wherein the interface drive module provides uniform interfaces for the system. The invention is a solution to the defects that the traditonal testing system has poor universality and low automatization degree and has the capability for secondary development.

A system for automated testing of functionally complex systems, comprising a test manager module operating on a server computer, a test data storage subsystem coupled to the test manager module and adapted to store at least test results, a test execution module operating on a server computer, and a test analysis module operating on a server computer and adapted to receive test data from the test data storage subsystem. The test manager module causes tests to be executed by the test execution engine, and on detection of an anomalous test result, the test manager module at least causes additional testing to be performed and causes the test analysis module to analyze the results of at least some of the additional testing in order to isolate at least one component exhibiting anomalous behavior.

A test manager software program includes an interactive test graphical-user-interface (GUI) for testing network devices using high-level networking commands. The test GUI allows the test engineer user to enter high-level commands such as Simple Networking Management Protocol (SNMP) commands that read values in a management information database in a network device under test. The high-level commands can be sent from the test manager using a command-line interface (CLI) in a telnet session opened to the network device during testing. The user specifies high-level test, analyze, and restore commands in test cases that are collected into test suites. Rules for logging on to the network device under test are stored that include expected prompts from the network device and user responses such as passwords. Addresses of the network device under test can be re-mapped for testing other devices so the test suites can be reused.

A system and method for automatically managing a distributed software test execution, management and reporting system that includes a network of test computers for executing a plurality of test jobs and at least one client computer for controlling the test computers is disclosed. The method and system include providing the test computers with a service program for automatically registering availability of the computer and the attributes of the computer with the client computer. The execution requirements of each test job are compared with the attributes associated with the available computers, and the test jobs are dispatched to the computers having matching attributes. The method and system further include providing the service programs with a heartbeat function such that the service programs transmit signals at predefined intervals over the network to indicate activity of each test job running on the corresponding computer. The client computer monitors the signals from the service programs and determines that a failure has occurred for a particular test job when the corresponding signal is undetected. The client then automatically notifies the user when a failure has been detected.

The invention relates to an automatic test system of a movable terminal, which comprises a testing and management server, a testing personal computer (PC) client terminal and a movable testing terminal. The testing and management server is used for managing testing resources, managing testing tasks, monitoring testing state, sending testing reports and storing testing logs, the testing PC client terminal comprises a testing script developing and debugging environmental module and a testing execution module, and the movable testing terminal is the movable terminal provided with a movable testing terminal agent module. The automatic test system organizes user testing tasks by using a mode of separating testing logic and testing using cases, improves maintainability, greatly reduces working capacity for creating, amending and maintaining a testing script, lowers cost of users on using the automation testing system, and brings convenience for customers in amending the testing using cases.

The invention provides a performance test system, which comprises a tested server pool, a load client pool, a pressure control center, a script server and a test management server, wherein the script server is used for centrally managing test scripts according to the mode of a performance scene; the test scripts are used for dispatching programs to be operated according to the performance test strategy in load clients; the pressure control center is used for calling the test scripts on the script server after a test start command from the test management server is received, and stopping operating the current test script after a test stop command from the test management server is received; and the test management server is used for sending the test start command or the test stop command to the pressure control center, monitoring the software and hardware resources of the load clients, the pressure control center and the tested server, and providing real-time monitoring and data analysis for performance test personnel.

An apparatus, method and computer program product are provided for performing a sequence of verification tests to perform hardware and software co-verification on a system under verification. The apparatus comprises a plurality of signal interface controllers operable to be coupled to the system under verification, with each signal interface controller being operable to perform one or more test actions transferring at least one of one or more stimulus signals and one or more response signals between a corresponding portion of the system under verification and the signal interface controller during performance of the sequence of verification tests. A debugger is also provided which is operable to control operation of a processing unit associated with the system under verification, the processing unit being operable to execute software routines. A debugger signal interface controller is arranged to interface with the debugger and to perform one or more test actions transferring at least one of one or more stimulus signals and one or more response signals between the debugger and the debugger signal interface controller during performance of the sequence of verification tests. A test manager coupled to the plurality of signal interface controllers and the debugger signal interface controller is operable to transfer test controlling messages to these interface controllers identifying the test actions to be performed. By this approach, the test manager is operable to control the operation of the processing unit via the debugger signal interface controller and the debugger in order to co-ordinate the execution of the software routines with a sequence of verification tests. This has been found to be a particularly efficient technique for performing hardware and software co-verification.

The present invention provides for a test management system that maintains fine-grained versioning information without sacrificing query, filtering, and reporting capabilities. Metadata associated with a test is stored in an XML file that is versioned with the test assets and source code. Furthermore, the XML file can contain all the attributes necessary for query and management, for example via XSLT transformations.

Provided is an online application distribution system. The online application distribution system, in this aspect, includes an application reservoir. The online application distribution system, in this aspect, further includes a beta test manager configured to determine if a user associated with the system will participate in beta testing for a beta application in the application reservoir.

A system and method for improving integration testing in a cloud computing environment includes collecting one or more input parameters associated with each of one or more products, deployed in cloud computing environment, from one or more external resources and test management systems. The input parameters include one or more defect parameters, user requirements, test parameters or performance parameters associated with the product. The integration testing improvement system determines one or more failure issues associated with the product and analyzes the behavior of the product over a predetermined time period to identify a failure pattern associated with the product. Each of the determined failure issues is mapped with the identified failure pattern to detect one or more critical scenarios in each of the products. Later the critical scenarios are automated by executing associated test scripts thereby improving the integration testing in the cloud computing environment.

This invention discloses one network property test method, which comprises the following steps: generating by analogue one test operation flow same to business flow to be tested; sending the test business from network start to test terminal; testing the network property according to the got test business on test terminal; processing the test business into test start for back business test. This invention also discloses one network property test system, which comprises start network device and test terminal device and test management device.

The invention discloses a test system and method of a data-driven rail traffic vehicle-mounted operation control system, belonging to the technical field of rail traffic signal system test. The test system comprises a test management module, a test execution module, a test interface adaption module and a test analysis and assessment module and is connected with a tested vehicle-mounted operation control system by the test interface adaption module, wherein the test management module finishes the functions of storing, modifying and configuring test data, the test execution module finishes the function of executing the test data, the test analysis and assessment module finishes the functions of recording, treating, analyzing and assessing the test data, and the test interface adaption module finishes the functions of adapting to the interface characteristics of real tested vehicle-mounted equipment and interacting practical information with the tested equipment. The invention can be conveniently used for various types of tests on the vehicle-mounted equipment of a train operation control system, wherein the tests comprise function test, interconnection test and the like; and in addition, the invention has good popularity and flexibility.

The invention relates to an automatic test case development system and method based on web. According to the automatic test case development system and method based on the web, which are disclosed by the invention, a web automatic test case development tool independently researched and developed, an automatic test cast execution tool, an automatic test management end and other third-party tools are packaged and integrated, so that testing personnel can easily, conveniently and rapidly develop a web automatic test case and execute automatic testing without learning and mastering relatively deep professional knowledge of development, programming and the like; and moreover, the tools are suitable to apply to any type of web application system to carry out automatic testing.

An approach for enabling maintenance of a test bed for use in executing software testing is described. A test management platform collects production data relating to execution of a prior release of an application within a production environment. The test management platform extracts unique messages from the collected production data to create a test bed including a plurality of test cases. Input messages to be processed by the application are generated based on a determination of which unique messages require a change based on a current release of the application.

The invention discloses a distributed test method, a system and a test server, wherein, the test server comprises the following units: a communication management unit is used for realizing the communication connection between a test client end and the test server and between a test executing end and the test server, a test management unit is used for managing the implementation of a test task and visiting the information of a test entity needed by a test entity management unit to get the test task, wherein, the test entity comprises the test client end, the test executing end and a tested device, a test entity management unit is used for managing or monitoring the test entity and a safety monitoring unit is used for authenticating and approving the test client end, monitoring the test executing end to implement the test task and monitoring the operation of the test entity towards a test data base. The invention can solve the problem in the related technology that test procedure automated management in the distributed test system is not concentrated.

A system for automated testing of functionally complex systems, comprising a test manager module operating on a server computer, a test data storage subsystem coupled to the test manager module and adapted to store at least test results, a test execution module operating on a server computer, and a test analysis module operating on a server computer and adapted to receive test data from the test data storage subsystem. The test manager module causes tests to be executed by the test execution engine, and on detection of an anomalous test result, the test manager module at least causes additional testing to be performed and causes the test analysis module to analyze the results of at least some of the additional testing in order to isolate at least one component exhibiting anomalous behavior.

A method and system for well test optimization provides test parameters and variation range therefor, independently from preliminarily reservoir and downhole fluid data; and repeatedly executes the test for each parameter to obtain real-time measured data, and interpreted data that is compared to the variation range for meeting a test objective. A method and system for well test design and interpretation, includes a testing manager having testing hardware / gauge metrology; a geological model; dynamic / static engineering data acquisition; and a reservoir model generator. A method and system for well test design and interpretation generates a test plan and an initial reservoir model and data from real / near-real-time, surface / downhole / manual data, aggregated data based on quality control / assurance, and optimization data based thereon and simulated downhole data; models / interprets the optimization data to meet test objectives for terminating / continuing the test plan; modifies the optimization; and / or generates reports from the modeling / interpretation when terminating the test plan.

The invention relates to the field of computers, in particular to a detection device and method for a security vulnerability of a dedicated information system. According to the detection device and method disclosed by the invention, a tester can not only access a target system to a testing network but also access the detection device to a production system by connecting a test terminal with the target system, wherein the target system is located in the production system. As the core of the detection device, a system security analysis and test management platform comprises a vulnerability discovering system, a vulnerability authenticating and analyzing system, a permeability testing system, a vulnerability library, a test case library, a report outputting system, a user and permission management system, a system management platform and the like. When the detection device and method for the security vulnerability of the software, provided by the invention, are adopted, the vulnerability can be found before the application of the software, and corresponding strategies can be provided, so that the detection device and method meet the requirement on the emphasis on information security in the current society in a better manner; and moreover, the detection device and method have a higher application value.

The invention provides a test case description oriented GUI (Graphical User Interface) automatic test system and a test method thereof, belonging to the field of software test. The test system comprises a test management subsystem and a test executive subsystem, wherein the test management subsystem is used for providing test case oriented normalized description language elements to generate a test case in a test step; and the test executive subsystem is used for transmitting a corresponding test script to a corresponding test node in an automatic conversion test step and is used for executing the test script to generate a test result. In the test method, a normalized test step is generated, the test script is automatically generated aiming at the step, a test execution coordination message is increased in the test script, and automatic testing is realized aiming at a distributed test system. Through the system and the method, the conventional heavy test script editing task of GUI automatic testing is simplified, time and labor are saved, and the problem of coordination confronted by performing the GUI automatic testing aiming at the distributed system is solved.

The invention discloses a regression test automation method which comprises the steps that: a test plan framework is generated and submitted to a test plan library; a regression test environment is constructed; test environment configuration and a topological mapping framework are generated and submitted to a regression test library; a regression test management module extracts the test plan framework and generates a test suite construction framework; a test suite management module constructs a test suite construction strategy according to the test suite construction framework, extracts test cases, generates a regression test suite and submits the regression test suite to the regression test library; the regression test management module detects the test plan and starts a test operating dispatcher; the test operating dispatcher informs a test environment management module to apply for test resources; the test operating dispatcher dispatches the regression test suite and starts a test operating engine; the test operating engine executes the regression test suite and generates test executing results in an operating result library. The invention also discloses a regression test automation system. The method and the system of the invention can reduce human intervention and realize regression test automation.

The invention relates to a test managing method, a test managing system master control center and a test managing system. The test managing method comprises the following steps of: receiving a test application table from a user terminal, wherein the test application table comprises a test task; scheduling and executing the test application table; obtaining a test version and a test use case according to the test task; transmitting the test version and the test user case to a secondary control center of a test subsystem based on the scheduled result so that the secondary control center controls the test terminal to run the test use case, and testing the test version; and receiving a test report from the test terminal by the secondary control center of the test subsystem and storing the test report. The technical scheme of the invention aims to save the test cost and improve the test efficiency of the test managing system.

The invention discloses an automatic test method and a test platform of a network server-side interface. The method comprises the following steps: leading test case data; extracting and encapsulating the test case data; simulating a client to transmit a request, and testing the network server-side interface; monitoring a test process, and recording a log; analyzing the test result and generating a test report. The test platform comprises a test management unit, a test control unit, a log unit and a test report unit, wherein the test management unit is used for leading and managing the test case data; the test control unit is used for encapsulating the test case data, simulating the request of the client, testing the network server-side interface and monitoring the test process; the log unit is used for generating a log according to the data fed back by the test control unit, and recording an alarm, an error parameter value and position information; and the test report unit is used for carrying out cumulative statistics analysis based on anticipation of the test management unit according to an execution state of the test case data fed back by the test control unit, and automatically generating a test report.

A system and computer-implemented method for automating build deployment and testing processes related to development of software is provided. The system comprises a user interface configured to facilitate users to provide input parameters for build deployment and testing. The system further comprises a build manager configured to facilitate deploying code if the users provide the input parameters related to build deployment. Further, the system comprises a scheduler configured to schedule execution of test scripts for testing the code based on the input parameters. Furthermore, the system comprises a run manager configured to assign the test scripts to testing machines for execution based on execution schedule, monitor execution status of the test scripts and send the execution status to test management systems and the users via communication channels. In addition, the system comprises a reporting module configured to generate reports related to build deployment and test scripts execution.

A cognitive and / or motor skill testing system and method may include a processor that records respective time information for each of multiple positions of a display device that are traced during administration of a test, that determines speed and / or velocity values based on the recorded time information, and that outputs test result information based on the determined values. The test result information may be based on a comparison between a graphed curve of such values to an ideal curve. The positions may correspond to a path between displayed targets whose size and / or distance therebetween depend on past test performance. The system and / or method may output a change expected with a change to therapy parameters for a patient, where the expected change is determined based on changes which occurred in other patients having similar test results and therapy parameters as those of the patient.

The invention relates to the field of software development process control and discloses a control method of the integrated iteration software development process and a method thereof. The system comprises a database unit, a demand management module, a task management module, a primary code version control module, a test management module, an item management module and a release management module; the control of the project progress is carried out under the uniform iteration development management by the relation among modules, and the software quality is ensured and the project process is controlled. The invention has the advantages that the progress of the whole software development process can be controlled, the quality is ensured and the software which can be developed is easy to expand and maintain; and the difficult problems of the integrated project changing management are solved really, especially the uniform difficult problems which exist through the software life cycle are solved in the process of iteration development management including software requirements, project progress, primary software code, software configuration, software test, software building and software release and maintenance.

The presently disclosed invention provides for the security of a computing device in the context of a test taking environment. By securing a computing device, an individual (or group of individuals) may more effectively proctor a large examination without worrying about a test taker illicitly accessing information on their computer or via a remote source of data. Securing a computing device includes locking out or preventing access to any application not deemed necessary or appropriate by the test administrator.

Methods and systems for providing an extensible testing framework are provided. An extensible testing framework may use field objects to represent test data values of various data types, including char, int, string, and the like. The framework is extensible in that new field objects may be added as new data types are needed during testing. The extensible testing framework may use transport objects to communicate test values to and from the target software being tested, e.g., using TCP Client, TCP Server, UCP Client, and the like. The framework is extensible in that new transport objects can be added as new transport protocols are needed, e.g., for a command line interface. Each test executes under the control of a test manager, as defined by configuration information provided in a configuration file or via an external executable control application.