Distributed data reading method and device

A distributed data and data technology, applied in the field of data processing, can solve the problem of inconsistency of global read data of distributed data

Active Publication Date: 2019-09-03
TENCENT TECH (SHENZHEN) CO LTD
View PDF6 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a method and device for reading distributed data to solve the problem of inconsistency in global read data of distributed data in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data reading method and device
  • Distributed data reading method and device
  • Distributed data reading method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0160] 1) Because the transaction status information that has been submitted globally will no longer be used, if it is determined that the transaction has been submitted globally, the transaction status of the transaction will be marked as invalid, and moved into the garbage collection area, waiting for the cleaning thread to clean up. And this batch cleaning mode can use asynchronous cleaning to improve performance.

[0161] 2) For the transaction that has been rolled back globally, it can be maintained through an independent rollback transaction stack for use by the retry mechanism.

[0162] Based on the above application architecture diagram, it can be seen that in the embodiment of the present invention, there is no need to set up a single-point, complex and time-consuming global transaction manager, and the distributed data reading method can act on the components of the distributed system, which can be considered as a Decentralized distributed data reading method, and in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of data processing, in particular to a distributed data reading method and device. The method comprises the steps of sending a global transaction reading request toeach corresponding data node; obtaining the data of one version or a plurality of versions returned by each data node according to the locally recorded sub-writing transaction state respectively; determining the version data conforming to the global consistency from the returned one or more versions of data; therefore, when the data on each data node is read, not only is one version of data read,but also one or more versions of data can be returned at the same time, and the data conforming to the global consistent version can be identified through one-time reading, so that the problem that the global transaction reads the data abnormally is solved, the time is saved, and the efficiency is improved.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a distributed data reading method and device. Background technique [0002] At present, in a distributed system, when performing a cross-node global write transaction operation, assuming that the global write transaction involves two data nodes, the PREPARE stage has passed, and the transaction can be submitted. The first data node is submitted, and the second The data node has not been submitted yet. If a new global read transaction operation comes at this time, the data submitted by the first data node is read, but the second data node has not yet completed the submission, so the new data has not been read, resulting in a global read transaction. The data versions read by transaction operations are inconsistent, resulting in data exceptions. [0003] Therefore, in the global read transaction operation, how to ensure the consistent version of the read data is a problem that needs...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/23
CPCG06F16/2329G06F16/2365
Inventor 李海翔卢卫杜小勇赵展浩
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap