Dynamic data storage prediction method and system, equipment and storage medium

A technology of dynamic data and prediction methods, applied in electrical digital data processing, error detection/correction, instruments, etc., can solve problems such as system crash, business task squeeze, system paralysis, etc., to improve storage efficiency and applicability , the effect of increasing the risk

Pending Publication Date: 2021-11-02
济南浪潮数据技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, there are a large number of monitoring devices in the data center. At present, there are tens of thousands of devices, and the amount of data collected is relatively large. Unrestricted storage will exhaust the maximum capacity of mysql, causing mysql to freeze or load for a long time. In the end, Cause system paralysis; or the thread data setting is too small, the system load and database load are too low, resulting in low utilization rate, wasting performance, unable to make reasonable use of hardware and software resources, making the overall system utilization rate low, business tasks squeezed, and vicious Loop, eventually leading to bad situations such as system crashes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic data storage prediction method and system, equipment and storage medium
  • Dynamic data storage prediction method and system, equipment and storage medium
  • Dynamic data storage prediction method and system, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] Embodiment 1 of the present invention proposes a dynamic data warehousing prediction method, which can effectively recommend a reasonable number of warehousing threads by collecting effective information that affects the warehousing load, and then analyzing and predicting the existing data. Make the database load smooth instead of sudden drop and sudden rise, so that it will be stuck or the storage congestion will cause inefficiency, which may further affect the system load and increase the risk. Using this method can effectively avoid the above hazards, improve storage efficiency, and reduce risk. Greatly reduced.

[0040] Such as figure 1 A flow chart of a method for predicting dynamic data storage in Embodiment 1 of the present invention is given.

[0041] In step S101, the dynamic data of the equipment to be put into storage is acquired regularly. In this step, set up the collector, which is a program used to collect device information. The collector has a timing ...

Embodiment 2

[0056] Based on the dynamic data storage prediction method proposed in the first embodiment of the present invention, the second embodiment of the present invention also proposes a dynamic data storage prediction system. Such as Figure 5 It is a schematic diagram of a dynamic data storage prediction system according to Embodiment 2 of the present invention, the system includes an acquisition module, a comparison module and a prediction module;

[0057] The acquisition module is used to regularly acquire the dynamic data of the equipment to be stored in the warehouse, and store the dynamic data; the dynamic data includes database load information within a period of time, data storage time, the number of threads that have been opened for the current storage, and the current CPU core. number and CPU utilization.

[0058] The comparison module is used to compare whether the current dynamic data stored in the database is the same as the previous dynamic data in the database, and ...

Embodiment 3

[0077] The invention also proposes a device comprising:

[0078] memory for storing computer programs;

[0079] When the processor is used to execute the computer program, the method steps are as follows:

[0080]In step S101, the dynamic data of the equipment to be put into storage is acquired regularly. In this step, set up the collector, which is a program used to collect device information. The collector has a timing function to regularly capture database load information, data storage time, and current storage has been enabled for a period of time. Number of threads, current number of CPU cores, and CPU utilization. For example, to collect database load information, you can regularly view the occupancy and utilization of the database through the "top" command. Such as figure 2 It is a working diagram of the collector in Embodiment 1 of the present invention.

[0081] In step S102, the dynamic data of the equipment to be stored is stored, and the current dynamic data...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a dynamic data storage prediction method and system, equipment and a storage medium. The method comprises the following steps: obtaining dynamic data of to-be-stored equipment at regular time, and storing the dynamic data, wherein the dynamic data comprises database load information within a period of time, data storage time, the number of currently opened threads in storage, the number of current CPU cores and a CPU utilization rate; comparing whether the current stored dynamic data is the same as previous dynamic data in a database or not, and if not, updating the current stored dynamic data to the latest dynamic data; and according to the latest dynamic data, predicting the number of to-be-stored threads in a manner of active analysis or passive analysis. Based on the prediction method, the invention further provides the dynamic data storage prediction system, the equipment and the storage medium. Effective information influencing storage loads is collected, and analysis and prediction processing is carried out on existing data, so that a reasonable number of storage threads can be effectively recommended, and the loads of the database are smooth.

Description

technical field [0001] The invention belongs to the technical field of server data management, and in particular relates to a method, system, device and storage medium for predicting dynamic data storage. Background technique [0002] In the current server management platform, the platform usually manages the asset information, monitoring information, and alarm information of the current equipment. The collection of these information often needs to be stored in the database, and then displayed to the user in a visual form. [0003] However, there are a large number of monitoring equipment in the data center, which has reached tens of thousands of equipment at present, and the amount of data collected is relatively large. Unrestricted storage will exhaust the maximum capacity of mysql, causing mysql to freeze or load for a long time, and eventually Cause system paralysis; or the thread data setting is too small, the system load and database load are too low, resulting in low ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30
CPCG06F11/302G06F11/3024G06F11/3051G06F11/3093
Inventor 贾伟韦冰江
Owner 济南浪潮数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products