Workflow scheduling method for data analysis tasks
A scheduling method and data analysis technology, applied in the direction of electrical digital data processing, program startup/switching, program control design, etc., can solve problems such as data analysis task execution failure, achieve efficient workflow scheduling methods, and reduce system redundant input Output and reduce the effect of strong dependencies
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0071] S1: Receive the task sequence, analyze and encapsulate the smallest task unit in the task sequence. The smallest task unit includes the various identifiers mentioned above.
[0072] S2: Construct a data flow graph according to the minimum task unit, and divide the data flow graph into several production-consumption relationships. The data flow graph contains nodes; when constructing the data flow graph, if it is detected that the received sequence task contains an end flag In the task of searching for the complete workflow submitted by the current user this time according to the unique identifier of the current operating environment, this complete workflow is used as a data flow graph, which contains nodes; figure 2 There are 7 minimum task units in total, node 1 represents streaming data, node 2 represents offline data, node 3 represents merging by column, node 4 represents feature conversion / feature importance selection, node 5 represents model training, and node 6 repres...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com