Big data matching verification method and implementation device

A technology of data verification and verification method, applied in the field of big data, can solve problems such as large amount of data, difficulty in extracting data, deduplication of unrepeatable data, etc., to achieve the effect of improving efficiency, ensuring accuracy, and reducing redundancy

Pending Publication Date: 2020-01-03
杭州轶丞网络科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, the above-mentioned scheme still has certain defects. It cannot deduplicate the repeated data, which makes the data volume too large, which brings great difficulties to the later extraction of data and has certain limitations.
Moreover, only the feature extraction of the data is processed, but how to be self-consistent with the data verification method is also a blank

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data matching verification method and implementation device
  • Big data matching verification method and implementation device
  • Big data matching verification method and implementation device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] A verification method for big data matching, the method performs the following steps:

[0046] Step S1: Perform data feature extraction, and output the extracted data features;

[0047] Step S2: Perform data matching verification according to the extracted data features, and obtain a data verification result.

Embodiment 2

[0049] On the basis of the previous embodiment, in the step S1, the method for extracting data features performs the following steps:

[0050] Step S1.1: After acquiring the data, divide and encapsulate the data into sub-packets according to the preset configuration information; deliver the sub-packets;

[0051] Step S1.2: preset several cluster analysis nodes, and receive the sub-packets; after the cluster analysis nodes receive the sub-packets, perform data deformation, reorganization and data preprocessing on each sub-packet to obtain standardized input data;

[0052] Step S1.3: The standardized input data is used as the input of the convolutional neural network convolution layer, and the standardized input data is convoluted through n trainable filters and offsets to obtain n different feature maps, n is a positive integer; each neuron in each feature map is connected to a local receptive field of standardized input data for extracting corresponding local features, and all...

Embodiment 3

[0059] On the basis of the previous embodiment, in the step S2, the method for performing data matching verification according to the extracted data features performs the following steps:

[0060] Step S2.1: Obtain the verification process image file according to the characteristics of the acquired data, obtain the verification result upload process image file and the verification parameter configuration file;

[0061] Step S2.2: Start the data verification process by using the data verification process image file;

[0062] Step S2.3: The data verification process invokes the verification parameter configuration file, verifies the characteristics of the data, and obtains a verification result.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of big data, and particularly relates to a big data matching verification method and an implementation device. The method comprises the following steps ofS1, performing data feature extraction, and outputting extracted data features; and S2, performing data matching verification according to the extracted data features to obtain a data verification result. According to the verification method and device, firstly, data feature extraction is carried out, and then data verification is carried out on the data after feature extraction, so that the dataverification efficiency is improved, and meanwhile, the data verification accuracy is also improved.

Description

technical field [0001] The invention belongs to the technical field of big data, and in particular relates to a verification method and an implementation device of big data matching. Background technique [0002] With the advent of the cloud era, more and more platforms generate big data from sources such as social networks, e-commerce, and access records, that is, very large amounts of data, for example, between 100T and 100P a day, or even larger The amount of data, and the total number of machines producing these data is between 10,000 and 1 million, or even more. Data generated by many services under the cloud, such as pv (view volume) logs generated by websites, generally need to be stored in real time to verify the integrity of the data and ensure the accuracy of data mining and other processing. However, when matching and verifying big data, due to the huge amount of data, it often takes a long time to verify and match the data, and the processing efficiency is very ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/2458G06N3/04
CPCG06F16/2471G06N3/045
Inventor 莘河
Owner 杭州轶丞网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap