Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method, processor readable medium and system for partition splitting and merging

A technology of processor and index data structure, which is applied in electronic digital data processing, special data processing applications, input/output process of data processing, etc. Cloud service performance and other issues

Pending Publication Date: 2021-08-24
ALIBABA SINGAPORE HLDG PTE LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, existing partition splitting or merging operations require data migration, which is not only time-consuming, but also consumes bandwidth and computation
Additionally, key-value stores and cloud services become unavailable, or at least partially unavailable, to serve users during existing partition split or merge operations
This not only affects the performance of cloud services, but also reduces the incentive to perform partition split or merge operations, thereby increasing the cost of load balancing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, processor readable medium and system for partition splitting and merging
  • Method, processor readable medium and system for partition splitting and merging
  • Method, processor readable medium and system for partition splitting and merging

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] This application describes a number of different examples and implementations. The following sections describe an example framework suitable for practicing various embodiments. Next, the application describes example systems, devices, and processes for implementing a storage engine.

[0016] example environment

[0017] figure 1 An example environment 100 is shown that may be used to implement a storage system. Environment 100 may include storage engine 102 . In an embodiment, the storage system 102 may include a key-value engine 104 and one or more storage devices 106-1, . . . , 106-N (collectively, storage devices 106), where N is an integer greater than or equal to one. The key-value engine 104 and the plurality of storage devices 106 may communicate data with each other via one or more connections 108-1, . . . , 108-M (collectively connections 108), where M is an integer greater than or equal to one. In this example, one or more storage devices 106 are said to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Methods, systems, and processor-readable media are provided for performing partition splitting or merging on key value index structures. In response to receiving or detecting a trigger event that merges a plurality of indexed data structures to form one indexed data structure, one or more data files of the plurality of indexed data structures may be hardlinked into a directory of the indexed data structure. Neighboring nodes of a plurality of indexed data structures may be iteratively merged to form the indexed data structures in a bottom-to-top manner, and a new mapped data structure for the indexed data structures is constructed from an original mapped structure associated with the plurality of indexed data structures.

Description

technical field [0001] The present application relates to methods, processor readable media and systems for partition splitting and merging of key-value index structures. Background technique [0002] Persistent key-value stores play a fundamental and important role in Internet-scale services such as cloud services that use key-value stores to persist or maintain system state and facilitate fast lookups. A key-value store is a storage paradigm configured to store, retrieve, and manage associative arrays and store data as a set of unique identifiers, each associated with a corresponding value. The unique identification may serve as a key for the data segment, and the corresponding value associated with the unique identification may be the data segment itself or the location of the data segment. For example, data structures commonly used for key-value storage could be called dictionaries or hash tables. Traditional relational databases need to pre-define the data structure i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/901G06F16/84G06F3/06
CPCG06F16/9017G06F16/9027G06F16/84G06F3/061G06F3/0644G06F3/0683
Inventor 陈硕黄建庞柱陆庆达王睿周文翠吴结生
Owner ALIBABA SINGAPORE HLDG PTE LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products