A cross-platform adaptive data processing workflow system and method
A data processing and workflow technology, applied in the field of computer systems, can solve problems such as difficult debugging for performance users, and achieve high-performance cross-platform data processing, high scalability, and optimal global performance
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0043] Embodiment 1 of the present application provides a cross-platform adaptive data processing workflow system.
[0044] A cross-platform adaptive data processing workflow system, comprising:
[0045] The client, configured to build workflows based on API calls and canvas drag-and-drop, pass the built workflows through Istio The security gateway sends it to the server;
[0046] The server is configured to receive the workflow constructed by the client based on the server interface, and optimize and adapt the computing environment of the workflow logic operator based on the operator computing platform adapter.
[0047] As one or more implementation manners, the cross-platform adaptive data processing workflow system adopts such as figure 1 The system architecture shown includes three layers: presentation layer, service layer, and data layer. Among them, the display layer provides API The list is called by the user and provides a visual drag-and-drop canvas front end. ...
Embodiment 2
[0059] The second embodiment of the present application provides a cross-platform adaptive data processing workflow method, which adopts the cross-platform adaptive data processing workflow system provided in the first embodiment.
[0060] User use based on Kubernetes The cross-platform adaptive data processing workflow method of the framework uses relevant operators in accordance with the framework-specific rules when constructing the workflow. In this embodiment, the operators include data object operators, logical operator operators, flow control operators, etc. The data object operators abstract the data to be processed into standardized data objects, which define data structures, data Scale, data path and other information; logical operator operator is a standardized encapsulation of commonly used data processing algorithms and data processing interfaces provided by various platforms. The operator only describes information such as function, usage, input and output rules...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com