Evaluation method for general data quality based on entropy weight method

A data quality assessment and quality assessment technology, which is applied in the fields of electronic digital data processing, structured data retrieval, special data processing applications, etc., can solve the problems of large workload of data quality verification rules maintenance and management, and difficulty in multiplexing verification algorithms. To achieve the effect of reducing the workload of writing, improving the reuse of work results, and improving work efficiency

Inactive Publication Date: 2017-03-15
STATE GRID CORP OF CHINA +2
View PDF0 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a general data quality evaluation method based on the entropy weight method to solve the problems of heavy maintenance and management workload of data quality verification rules, difficulty in reusing verification algorithms, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Evaluation method for general data quality based on entropy weight method
  • Evaluation method for general data quality based on entropy weight method
  • Evaluation method for general data quality based on entropy weight method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The present invention will be further described below in conjunction with accompanying drawing:

[0040] Information entropy is used to measure the degree of uncertainty of random variables, and can be used to solve the problem of measuring the amount of information. If the entropy of an evaluation index is smaller, it means that the amount of information provided by the index is greater, and it plays a role in comprehensive evaluation. The larger the weight, the higher the weight; the application of the evaluation model to verify data quality refers to the use of information technology to solidify the evaluation dimensions and evaluation index algorithms of the general data quality evaluation model into program components, and provide a flexible call for verification data interface. Input interface and verification control interface, combined with the results of the first two processes, the application program dynamically combines each component, completes the instantia...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an evaluation method for general data quality based on an entropy weight method. The evaluation method comprises the following steps: (1) establishing an index data quality evaluation model according to an evaluation index; (2) optimizing an evaluation index weight according to an evaluation index model and a data quality evaluation scene; and (3) checking the data quality by using the evaluation model. According to the evaluation method, the problems of high maintenance management workload and difficulty in reusing the checking algorithm of the data quality check rule are solved. Compared with the traditional data quality check working mode, the method provided by the invention has the advantages that the writing workload of the artificial script is effectively reduced, the reuse degree of the working achievement is increased and the average working efficiency is improved by 46% or above.

Description

technical field [0001] The invention relates to the technical field of data quality assessment, in particular to a general data quality assessment method based on an entropy weight method. Background technique [0002] For a long time, because data quality involves many complex factors including business, it is difficult to use a general method to evaluate. At present, the method based on verification rules is generally used. , consistency and other quality dimensions to define verification rules, calculate the proportion of the data verified by the verification rules to the total data volume, evaluate and quantify the data quality. Using this method, there are mainly the following problems: 1. Manage and maintain a large number of business-related Data quality rules are beyond the scope of work and capabilities of the IT department; 2. Complex rule configuration operations make business departments daunting; 3. Data quality rules are based on specific data item definitions,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/24553G06F16/21
Inventor 刘夫新李毅松周春雷梁文杨栋枢王超郭振蔡云飞
Owner STATE GRID CORP OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap