Big data scheduling parameter management method and device and distributed platform

A technology for scheduling parameters and management methods, applied in data processing applications, electrical digital data processing, special data processing applications, etc., can solve problems such as heavy workload, prolonging the final online time of processing tasks, and error-prone, so as to reduce workload , Shorten the final online time and improve the speed

Pending Publication Date: 2020-09-11
CHINA PING AN PROPERTY INSURANCE CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Based on this, it is necessary to address the above problems, and propose a big data scheduling parameter management method, device and distributed platform, which are used to solve the problem of heavy workload, error-prone, and prolonged processing tasks for developers to input scheduling parameters in the prior art. Technical issues with final launch time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data scheduling parameter management method and device and distributed platform
  • Big data scheduling parameter management method and device and distributed platform
  • Big data scheduling parameter management method and device and distributed platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0060] Such as figure 1 As shown, in one embodiment, a big data scheduling parameter management method is proposed, which is applied to the deployment of processing tasks, and the processing tasks are used to process data according to processing requirements in the big data server to obtain target data;

[0061] The processing task is implemented as a program for processing data by the Hive library (data warehouse tool) in the big data server, which is written in H...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a big data scheduling parameter management method and device and a distributed platform. The method comprises the steps of obtaining a parameter verificationrule and a parameter input permission; obtaining processing task scheduling parameter data input by a user according to the parameter verification rule and the parameter input permission, wherein theprocessing task scheduling parameter data comprises processing task information and scheduling parameter information; according to processing task information carried by the deployment request, obtaining the processing task scheduling parameter data as to-be-deployed processing task scheduling parameter data; sending the to-be-deployed processing task scheduling parameter data to a deployment auditor; obtaining an auditing result sent by a deployment auditor; and when the auditing result is successful, submitting the to-be-deployed processing task scheduling parameter data to a scheduling system. In addition, the invention also relates to a blockchain technology, and the auditing result can be stored in the blockchain node.

Description

technical field [0001] The present invention relates to the technical field of charging equipment, in particular to a big data scheduling parameter management method, device and distributed platform. Background technique [0002] With the development of the Internet, mobile Internet, and the Internet of Things, business systems generate massive business data. For the analysis of massive business data, different analysis needs use different processing tasks, resulting in a large number of processing tasks, and each processing task There are relatively many scheduling parameters, resulting in a large number of scheduling parameters. In order to facilitate the modification of the processing task code, the scheduling parameters of the processing task need to be managed separately. The prior art adopts the method of inputting scheduling parameters in Excel, and then importing the Excel table into the relevant system and then deploying it to the big data server where the business ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/245G06F21/62G06Q10/10
CPCG06F21/6218G06F2221/2141G06Q10/103G06F16/21G06F16/245
Inventor 刘雪
Owner CHINA PING AN PROPERTY INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap