Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

RPA element pickup same-screen switching method and system

A technology of screen switching and elements, which is applied in the field of RPA element picking and switching on the same screen, can solve the problems that the element picking scheme does not support the same screen application switching, the image matching picking method has low precision, and the software application cannot be invoked, etc., to achieve excellent picking effect, Increased efficiency and stability, wide-ranging effects

Active Publication Date: 2022-05-10
杭州实在智能科技有限公司
View PDF9 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] The present invention aims to overcome the problems in the prior art that the existing scope-based element picking scheme does not support the switching of applications on the same screen, and the software application cannot be invoked in the picking state, and the picking method based on image matching has low precision and poor matching effect. Provides a front-end and back-end processing strategy that combines service sharding mechanism, operation mode distinction, and floating window display, and has better picking effect and wider application range. RPA element picking and switching method and system on the same screen

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • RPA element pickup same-screen switching method and system
  • RPA element pickup same-screen switching method and system
  • RPA element pickup same-screen switching method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] Such as Figure 5 The shown RPA element picking switching method on the same screen, enter the picking process operation: when designing and editing the RPA automation process, the user first needs to open the RPA process editor, select the element picking related components such as "element click"; drag it Move to the editing window and canvas, and then click the pick entry in the component to enter the element pick state. At this time, the RPA process editor will be minimized, and the screen interface will be switched to the state and interface before opening the process editor.

[0063] S1. After starting to pick, the user first selects the element picking method according to the prompt of the floating window selector. The style example of the floating window selector is as follows figure 2 As shown, the normal picking corresponds to the traditional picking method based on operating system instructions and source code analysis, and the smart picking corresponds to t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of RPA element recognition, and particularly relates to an RPA element pickup same-screen switching method and system. The method comprises the following steps: S1, selecting an element pickup mode; s2, moving the mouse to a specific software interface; s3, obtaining interface related information and interface screenshots, and transmitting and analyzing the interface related information and the interface screenshots; s4, forwarding the interface screenshot, and judging whether the specified time T is exceeded or not; s5, performing analysis processing on the interface screenshot algorithm to obtain an algorithm analysis result; s6, packaging an algorithm analysis result, and displaying the algorithm analysis result on a software interface; s7, judging an operation mode of the user; and S8, after the user selects the corresponding element, the picked element is highlighted again, and picking is completed after the user confirms that the element is correct. The method combines a service fragmentation mechanism, operation mode distinguishing and a front-end and rear-end processing strategy of floating window display, and has the advantages of being more excellent in pickup effect and wider in application range.

Description

technical field [0001] The invention belongs to the technical field of RPA element recognition, and in particular relates to a method and a system for picking and switching RPA elements on the same screen. Background technique [0002] RPA (Robotic Process Automation, Robotic Process Automation) is a rapidly developing computer software automation technology. Element picking is an important component function of RPA, including element detection and identification. [0003] The existing element picking technologies are basically divided into three types: traditional element picking with the help of operating system instructions and source code parsing, matching element picking using image matching or template matching, and CV picking based on deep learning models. Among them, traditional element picking has basically become a necessary method, while image-based matching picking technology and deep learning model-based CV picking technology each account for roughly half of th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/04845G06F3/0481G06F3/0354G06F9/451G06F3/04842
CPCG06F3/04845G06F3/0481G06F3/03543G06F9/451G06F3/04842
Inventor 欧阳小刚孙林君
Owner 杭州实在智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com