Data processing method and device, electronic equipment and storage medium

An electronic equipment and data processing technology, applied in the network field, can solve the problems of large data volume, affecting disk life, bandwidth waste, etc., to achieve the effect of improving disk life, saving bandwidth, and reducing write volume

Pending Publication Date: 2022-07-01
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present disclosure provides a data processing method, device, electronic equipment, and storage medium to at least solve the problems in the related art that a large amount of data needs to be read / written during merging, resulting in waste of bandwidth and affecting the life of the disk

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] In order to make those skilled in the art better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0071] It should be noted that the terms "first", "second" and the like in the description and claims of the present disclosure and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances so that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data processing method and device, electronic equipment and a storage medium, and relates to the technical field of networks. According to the method and the device, the specified operation is executed on the to-be-stored data according to the to-be-stored data in the memory of the electronic equipment, so that the operation of writing the to-be-stored data into the specified hierarchy of the disk in the electronic equipment is completed. Wherein the specified operation comprises the following steps: on the basis of the to-be-stored data, generating at least two sorting character string table files corresponding to at least two currently defined sorting character string table groups, so as to store the to-be-stored data in the form of the at least two sorting character string table files; wherein the key name range corresponding to any sorting character string table file does not exceed the grouping range of sorting character string table groups corresponding to the sorting character string table file; and dividing the sorted character string table file into the corresponding sorted character string table groups. Therefore, the bandwidth can be saved to a certain extent, the write-in amount to the disk is reduced, and the service life of the disk is prolonged.

Description

technical field [0001] The present disclosure relates to the field of network technologies, and in particular, to a data processing method, apparatus, electronic device, and storage medium. Background technique [0002] At present, in the case of data key-value storage, the key-value storage method based on Log Structured Merge Tree (LSM-Tree) is more and more widely used. Among them, LSM-Tree is a layered, ordered, disk-oriented data structure, and its core idea is to make full use of the sequential write of disk batches to ensure data write performance. [0003] In the key-value storage method of LSM-Tree, multiple levels (Levels) are divided, and the data to be stored in the memory is stored in the form of a sorted string table (Sorted Strings Table, SST) to the multiple levels located on the disk. . Among them, a sorting string table may include a plurality of stored key name-key-value pairs (key-value). In the related art, when sorting string tables in multiple level...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0616G06F3/0643G06F3/0629G06F3/0676
Inventor 贺伟吕信
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products