High-availability optimization method of memory computing system in combination with principal-subordinate backup and erasure codes

An optimization method and memory computing technology, applied in the field of high-availability systems, can solve problems such as memory redundancy and reduce memory utilization efficiency, and achieve the effects of improving availability, shortening unavailable time, and reducing redundancy

Active Publication Date: 2015-08-26
SHANGHAI JIAO TONG UNIV
View PDF5 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the slave node maintains the same memory information as the master node, the slave node uses the same memory as the master node, thus introducing a large amount of memory redundancy and reducing the utilization efficiency of memory

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-availability optimization method of memory computing system in combination with principal-subordinate backup and erasure codes
  • High-availability optimization method of memory computing system in combination with principal-subordinate backup and erasure codes

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0036] The high-availability optimization method of the memory computing system combined with master-slave backup and erasure code proposed by the present invention includes the following steps:

[0037] Step 1: Divide the distributed system into multiple groups, each group protects M master nodes and N slave nodes, and the values ​​of M and N are both greater than or equal to 1;

[0038] -The memory on each master node includes: A zone and B zone, the A zone is used to store metadata, and the B z...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a high-availability optimization method of a memory computing system in combination with principal-subordinate backup and erasure codes, which comprises the steps that a distributed system is divided into multiple groups, M principal nodes and N subordinate nodes are protected by each of the groups, and values of M and N exceed 0; memory on each of the principal nodes comprises an area A and an area B, wherein the area A is used to save metadata, the area B is used to save value data, the metadata comprises indexes of key-to-value data addresses and memory distribution information, and the value data comprises value data corresponding to all the keys on the node; the memory of each of the subordinate nodes comprises an area C and an area D; the area C is used to save and backup the metadata, and the area D is used to save codes of the value data; the value data is protected by introducing an update operation of the erasure codes; and when the principal nodes are down, any of the subordinate nodes will constitute a recovery node to take the place of the principal node in order to deal with a request, and lost data is recovered by an online recovery protocol.

Description

technical field [0001] The invention relates to the technical field of high-availability systems, in particular to a high-availability optimization method for a memory computing system combined with master-slave backup and erasure codes. Background technique [0002] Due to its volatility, in-memory computing systems such as in-memory key-value systems usually need to use master-slave data backup to prevent data loss and service unavailability caused by downtime, such as Redis. The method of implementing a high-availability memory key-value system by using master-slave data backup mainly divides the server cluster into multiple groups, where each group includes a master node and one or more slave nodes. The master node provides key value update requests and key value query requests, and the slave nodes save the same memory information as the master node, and only receive update requests sent by the master node. When the master server fails, the slave node can become the new...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F12/02G06F11/14
Inventor 陈海波张恒董明凯臧斌宇管海兵
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products