Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A data processing method and device, an electronic device and a computer storage medium

A data processing and data technology, applied in the Internet field, can solve the problem of not supporting data consistency check and so on

Active Publication Date: 2018-12-18
JIANGSU PAYEGIS TECH CO LTD +1
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But because a large number of files are created, in the worst case, all files have to be searched when performing a read operation; and data consistency check is not supported

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method and device, an electronic device and a computer storage medium
  • A data processing method and device, an electronic device and a computer storage medium
  • A data processing method and device, an electronic device and a computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] figure 1 A schematic flowchart of a data processing method according to Embodiment 1 of the present invention is shown. Among them, the data is stored in the form of data key-value pairs (KV, Key-Value), such as figure 1 As shown, the method includes the following steps:

[0053] Step S100, according to the data key of the data to be stored, the node list coordinates corresponding to the data key are obtained, wherein the length of the node list coordinates is n.

[0054] The length of the node list coordinate refers to the number of values ​​contained in the node list coordinate. For example, if the node list coordinate is 636174, the length of the node list coordinate is 6. The length of the node list coordinate is an important basis for constructing the prefix tree structure , which determines the depth of the constructed prefix tree structure.

[0055] The node list coordinates are related to the nodes in the prefix tree structure, the node list coordinates can b...

Embodiment 2

[0095] Figure 4 A schematic flowchart of a data processing method according to Embodiment 2 of the present invention is shown. Among them, the data is stored in the form of data key-value pairs (KV, Key-Value), such as Figure 4 As shown, the method includes the following steps:

[0096] Step S400, according to the data key of the data to be stored, the node list coordinates corresponding to the data key are obtained, wherein the length of the node list coordinates is n.

[0097] Specifically, the embodiment of the present invention can use the following two methods to determine the coordinates of the node list corresponding to the data key:

[0098] Method 1: Use the preset hash algorithm to hash the data key of the data to be stored to obtain the hash value corresponding to the data key, and use the hash value corresponding to the data key as the coordinate of the node list corresponding to the data key.

[0099] Method 2: Calculate the character code corresponding to th...

Embodiment 3

[0148] Figure 5 A schematic structural diagram of a data processing device according to Embodiment 3 of the present invention is shown. Among them, the data is stored in the form of data key-value pairs (KV, Key-Value), such as Figure 5 As shown, the device includes: a first determination module 500 , a construction module 501 , a setting module 502 , a storage module 503 and a calculation module 504 .

[0149] The first determining module 500 is configured to obtain the node list coordinates corresponding to the data key according to the data key of the data to be stored, wherein the length of the node list coordinates is n.

[0150] The construction module 501 is used to construct a prefix tree structure according to the length of the coordinates of the node list, wherein the depth of the prefix tree structure is n+1, and the nodes in the prefix tree structure are a list whose length is a preset number of digits, and the last one in the list is The bit is the data value ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and device, an electronic device and a computer storage medium. Where data storage structures are connected with hash pointers, Each time the stored data is recursively reflected to the root node of the prefix tree structure, take advantage of that method to store data, which provides convenience for subsequent data reading and data checking, The invention can quickly find the data value of the stored data, and can avoid the huge calculation amount caused by the Meckel tree of the entire database data which must be recalculated in the data checking process after the data changes, and only the hash value of the root node in the final prefix tree structure is needed to be compared during the checking.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a data processing method, device, electronic equipment and computer storage medium. Background technique [0002] Over the past decade, the computing world has changed. Organizations of all sizes are beginning to have the need to deal with big data, and relational databases have almost reached their limits in terms of scalability. One solution is to use key-value storage, which is a form of NoSQL storage in which data is organized, indexed, and stored in the form of data key-value pairs. Key-Value storage system has good scalability, reliability and high efficiency. KV storage supports read and write operations, and can also periodically process expired data by merging updated data and historical data. [0003] The database is the most important resource in the information system. The security of the database will directly affect the security of the information system. On...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 汪德嘉葛彦霆
Owner JIANGSU PAYEGIS TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com