Data verification method and device, electronic equipment and storage medium

A data verification and data technology, applied in the field of big data, can solve the problems of low efficiency of data cleaning and verification, achieve the effect of quickly debugging cleaning functions, simplifying steps, and improving effectiveness

Pending Publication Date: 2021-07-16
YIDU CLOUD (BEIJING) TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present disclosure is to provide a data verification method and device, electronic equipment, and storage media, and then at least to a certain extent overcome the problem of low data cleaning and verification efficiency due to limitations and defects of related technologies

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data verification method and device, electronic equipment and storage medium
  • Data verification method and device, electronic equipment and storage medium
  • Data verification method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details being omitted, or other methods, components, devices, steps, etc. may be adopted. In other instances, well-known technical solution...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention relates to a data verification method and device, electronic equipment and a storage medium, and relates to the technical field of big data, the method comprises the following steps: obtaining test data according to a sampling mode, and obtaining a to-be-tested cleaning function; performing cleaning operation on the test data according to the to-be-tested cleaning function to obtain cleaned data of the test data; and verifying the to-be-tested cleaning function based on the cleaning data to obtain a verification result. According to the technical scheme, the cleaning result can be quickly and timely verified, so that the accuracy of data cleaning is improved.

Description

technical field [0001] The present disclosure relates to the technical field of big data, and in particular, to a data verification method, a data verification device, electronic equipment, and a computer-readable storage medium. Background technique [0002] With the rapid growth of data volume, the data standards of different sites may vary greatly, so data cleaning can make the data consistent. [0003] In related technologies, monitoring logs are usually added to the program to record the debugging information. After the task is completed, the problems in the data cleaning process are checked through the system logs; or the problem data is extracted to create a small data set, and only the extracted small data sets are cleaned during iteration. Data set, after the verification of the small data set results is passed, the full amount of data will be reprocessed. [0004] In the above method, when the amount of data is large, there are many output logs, and it is difficul...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215G06F16/23
CPCG06F16/215G06F16/2365
Inventor 贾宇楠
Owner YIDU CLOUD (BEIJING) TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products