System and method for realizing optimization treatment of startup scheduling service loading plan based on data sharing platform

Abstract

The invention relates to a system for realizing the optimization treatment of a startup scheduling service loading plan based on a data sharing platform. The system comprises an online operation configuration module used for managing a data source according to a resource directory, and completing single operation information; a frequency setting module used for increasing frequency setting information; a planned operation configuration module; an optimization module provided with a frequency planning module and used for calculating and optimizing a scheduling trigger time list and filtering error data; and a scheduling engine service startup module. The invention further relates to a method for realizing the optimization treatment of the startup scheduling service loading plan based on thedata sharing platform. According to the system and the method for realizing the optimization treatment of the startup scheduling service loading plan based on the data sharing platform, the startup scheduling service loading plan can be optimized. By optimizing and loading the plan with frequency and filtering out error data, the job scheduling engine service is enabled to be normally started andavailable. The stability and the availability of the whole platform are improved. The purpose of efficiently and fully using the data is achieved, so that the adaptability of the data sharing platform and the value of data assets are improved.

Description

technical field [0001] The present invention relates to the field of data asset management, in particular to the field of data asset optimization management, and specifically refers to a system and a method for optimizing the start-up scheduling service loading plan based on a data sharing platform. Background technique [0002] Current data is a very important resource. The degree of data sharing reflects the level of information development in a region or even a country. The higher the degree of data sharing, the higher the level of information development. To achieve data sharing, a set of unified and statutory data exchange standards should be established first, and the data format should be standardized so that users can adopt the specified data standards as much as possible. For example, other countries have their own spatial data exchange standards, and our country is doing this work at this stage. [0003] The data sharing platform is an important way to deal with d...

AI Technical Summary

Problems solved by technology

[0010] According to the above steps, in the process of starting the configuration job scheduling engine service in the data sharing platform, it can be started normally under the premise that the data is strictly correct and accurate, and the logs and startup status are also correct. However, in actual project use, the data deviates The scene often occurs, and the data configured by the customer without familiarity with the system is also prone to problems, which will affect the startup of the service and make the data sharing platform unable to use normally

[0011] In the process of starting the job scheduling engine service in the existing data sharing platform, it can be started normally under the premise that the data is strictly correct and accurate, and the logs and startup status are also correct. However, in actual project use, the scenario where the data deviates is It often happens that the data configured by customers who are not familiar with the use of the system is also prone to problems, which will affect the start of the service and make the data sharing platform unable to use normally

For example, in the frequency interval associated with the scheduled job, users can easily ignore this setting, resulting in the inability to start the scheduling engine service during the process of loading the plan, making the data sharing platform unable to use normally

Images