Historical data cleaning method and device

A technology of historical data and cleaning methods, which is applied in the field of historical data cleaning methods and devices, can solve problems such as not supporting concurrent processing, and historical data cleaning methods cannot be directly reused, so as to reduce system development and maintenance costs, balance resource utilization, The effect of improving efficiency

Active Publication Date: 2019-11-08
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The present invention provides a historical data cleaning method and device to at least solve the problem that the historical data cleaning method in the prior art cannot be directly reused in each system and does not support concurrent processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Historical data cleaning method and device
  • Historical data cleaning method and device
  • Historical data cleaning method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0034] The embodiment of the present invention provides a historical data cleaning method, figure 1 It is a flow chart of the historical data cleaning method of the embodiment of the present invention. Such as figure 1 As shown, the method includes the following steps S101 to S104.

[0035] Step S101, automatically start the historical data cleaning process according to the preset system startup time, obtain the cleaning strategy configuration fi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a historical data cleaning method and device. The historical data cleaning method comprises the steps that a historical data cleaning procedure is started automatically according to preset system starting time, a cleaning strategy configuration file is acquired, and at least one cleaning task is generated according to the cleaning strategy configuration file; predicted processing time of each cleaning task is calculated according to the historical task processing time; at least one cleaning task in a queue of tasks to be allocated is allocated to an idle cleaning unit according to the predicted processing time, wherein the cleaning unit processes the cleaning tasks and outputs a processed state after each cleaning task is processed; whether processing is successful or not is judged according to the processing states, if not, the states of the cleaning tasks failing to be processed are changed into states to be allocated and put into the queue of tasks to be allocated and wait to be allocated again. Configuration files can be reused in all systems, and therefore the system development and maintenance cost can be reduced; multi-process concurrent processing is supported, and the data cleaning efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of data cleaning, in particular to a method and device for cleaning historical data. Background technique [0002] In the application system database in many fields, a large amount of data is added every day, and the stock data of the database shows a state of continuous growth. As the amount of data increases, if the scale of online data cannot be effectively controlled, the access efficiency of production data and the overall efficiency of application system operation will be affected. Therefore, it is necessary to scan application data regularly, and delete data that has exceeded a certain storage time and is no longer useful. [0003] For the cleaning of historical data, the current main method is as follows: create a configuration file, scan the records in the configuration file one by one, and delete the data in the table in the corresponding database. This method has the following disadvantages: ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/21
CPCG06F16/219
Inventor 陈霞陆登刘姗姗王斑
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap