A mass data cleaning system for workflows

A technology of massive data and cleaning system, applied in the field of big data cleaning, can solve the problems of data source complexity, different measurement units, data chaos and redundancy, etc., to solve the problem of data cleaning, improve scalability and strong reusability. Effect

Inactive Publication Date: 2019-06-28
广州明领基因科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The main causes of these problems are the complexity of the data source when the business system enters the data, including the misuse of abbreviations, idioms, data entry errors, embedded information errors in the data, duplicate records, missing values, spelling changes, different Units of measurement and outdated codes, etc.; during data integration and data warehouse construction, differences in the original business systems will also cause data confusion and redundancy
These data with quality problems are likely to provide wrong information when providing decision-making to leaders, and cannot be used by new business systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A mass data cleaning system for workflows
  • A mass data cleaning system for workflows
  • A mass data cleaning system for workflows

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] The present invention will be described in more detail and complete below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.

[0016] refer to figure 1 , a massive data cleaning system for workflow of the present invention, the system includes: a knowledge base module, a logic layer module and a workflow management subsystem module; wherein, the knowledge base module is the lowest layer of the system, providing required knowledge; the logic layer module is the second layer of the system, and the cleaning process is established through certain logic components; the workflow management subsystem module is the third layer of the system, providing workflow management and user interactive interface.

[0017] The scheme of the present invention introduces the layered mode and component technology of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a mass data cleaning system for workflows. The system comprises a knowledge base module, a logic layer module and a workflow management subsystem module, Wherein the knowledgebase module is the lowest layer of the system and provides required knowledge for cleaning; The logic layer module is the second layer of the system, and establishes a cleaning process through a certain logic component; And the workflow management subsystem module is the third layer of the system and provides a workflow management and user interaction interface. According to the scheme of the invention, a JavaEE hierarchical mode and a component technology are introduced, so that a loosely coupled system architecture is realized.

Description

technical field [0001] The invention belongs to the technical field of big data cleaning, and relates to a massive data cleaning system for workflow. Background technique [0002] Data quality problems generally exist in various application systems, and data quality problems mainly refer to problems in the correctness, consistency, integrity, and reliability of data. The main causes of these problems are the complexity of the data source when the business system enters the data, including the misuse of abbreviations, idioms, data entry errors, embedded information errors in the data, duplicate records, missing values, spelling changes, different Units of measurement and outdated codes, etc.; during data integration and data warehouse construction, differences in the original business systems will also cause data confusion and redundancy. These data with quality problems are likely to provide wrong information when providing decision-making to leaders, and cannot be used by ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215G06Q10/06
Inventor 徐继峰周峻松祁建明陈墩金
Owner 广州明领基因科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap