High-availability database log receiving queue, synchronization method and device

A technology for receiving queues and databases, which is applied in the field of synchronization methods and devices, and high-availability database log receiving queues, which can solve the problems that the log sending speed cannot reduce the transmission delay, the receiving and processing speed affects the high availability of the database, and so on, so as to reduce the log synchronization delay , improve high availability, improve the effect of receiving and processing speed

Active Publication Date: 2021-04-06
TIANJIN NANKAI UNIV GENERAL DATA TECH
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003]However, limited by the speed at which slave nodes receive and process log data, the unilateral increase in log sending speed cannot reduce the transmission delay. The slave nodes receive and process logs Speed ​​can have a big impact on database high availability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-availability database log receiving queue, synchronization method and device
  • High-availability database log receiving queue, synchronization method and device
  • High-availability database log receiving queue, synchronization method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] It should be noted that, in the case of no conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other.

[0026] The present invention will be described in detail below with reference to the accompanying drawings and examples.

[0027] The participants of high-availability database log synchronization are the master node (the sender of the log) and the slave node (the receiver of the log). When there is a write operation in the transaction processed by the master node of the database, the master node starts to record the log and sends it to the slave node.

[0028] Sender: The master node processes the log stream data and divides it into small log block data (logfragment, hereinafter referred to as log_frag). In order to ensure the sequence and correctness of the log data, each log block data is added with The log header data (including the sending sequence number, etc.) is used as control information, which is...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a high-availability database log synchronization method, which comprises the following steps: a slave node creates at least one recv-thread thread to process and receive log block data, the log block data is formed by segmenting log stream data by a master node, and each piece of log block data comprises log header information and log data; when the recv-thread thread receives one piece of log block data each time, header information is extracted from the log block data, and the log block data is placed in a receiving queue according to the header information, wherein the log receiving queue is a pointer array, each member in the array is a structural pointer, each structural pointer points to a structural head, two linked lists, namely a sequence linked list and an out-of-order linked list, are arranged in the structural head, and each node in the linked lists is log block data. The log receiving and processing speed of the slave nodes in the cluster can be effectively increased, log synchronization delay of the master nodes and the slave nodes is reduced, and high availability of the database cluster is improved.

Description

technical field [0001] The invention belongs to the technical field of databases, and in particular relates to a highly available database log receiving queue, synchronization method and device. Background technique [0002] In a highly available database cluster, master and slave nodes are kept in sync through log shipping. In a high-concurrency scenario, the master node needs to process a large number of write requests, so more log data will be generated. A large amount of log data needs to be sent to the slave node, and the slave node receives the log data and processes it, performs log playback and storage, and maintains synchronization with the data and status of the master node. [0003] However, limited by the speed at which slave nodes receive and process log data, a unilateral increase in log sending speed cannot reduce transmission delays, and the log receiving and processing speed of slave nodes will have a greater impact on the high availability of the database....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27
CPCG06F16/275
Inventor 赵伟陈文亭莫爱玲王雪松吕迅
Owner TIANJIN NANKAI UNIV GENERAL DATA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap