Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

System and method for guaranteeing distributed data processing consistency

A distributed data and consistent technology, applied in the direction of digital transmission system, transmission system, data exchange network, etc., can solve problems such as inconsistent expected results, abnormal data processing, etc., and achieve the effect of reducing delay and ensuring reliability

Active Publication Date: 2014-03-19
SHANGHAI STOCK EXCHANGE
View PDF5 Cites 43 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to solve the consistency problem existing in the distributed data processing in the existing transaction system and the technical problem that when the log mechanism is used, the abnormal data processing leads to the incomplete log record and the system replay will appear inconsistent with the expected result. A complete mechanism for ensuring the consistency of basic data processing in the trading system combined with a new type of basic data memory organization structure

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for guaranteeing distributed data processing consistency
  • System and method for guaranteeing distributed data processing consistency
  • System and method for guaranteeing distributed data processing consistency

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] Such as figure 1 as shown, figure 1 It is a framework diagram of basic data maintenance in the distributed transaction system of the present invention. The computer distributed transaction system platform is composed of several transaction platforms responsible for transaction business processing. Inside the transaction host, one host will be used as the master node, and the other nodes will become transaction nodes. Backup machine, the master node is responsible for all order processing tasks, and is responsible for log recording and maintenance, and triggers the basic data synchronization of the slave node. The slave node does not perform real-time order processing, but can maintain the consistency of the basic data memory with the master node through synchronization. There is a synchronization router inside. The synchronization router obtains order messages and basic data update messages from order generation software, front-end data management software or other plat...

Embodiment 2

[0059] The basic data memory organization structure diagram is as follows figure 2 As shown, each record in the figure consists of multiple versions. In addition to the KEY (password) value used for indexing, a TAG (tag) field is added in the record header structure to record the current version number, where TAG ( The tag) field is of INT64 type, and the reading and writing of the TAG (tag) field are atomic operations without conflicts. The basic data memory supports one write and multiple reads, and supports undo commands for write operations. While the HFM (basic data management module) updates the basic data records, the read operations of the application are not affected.

Embodiment 3

[0061] A method to ensure the consistency of distributed data processing. The request messages involved in the data processing process mainly include order requests and basic data update requests. The order messages come from the order generation software, and the basic data update messages are sent by the front-end data management software or other platforms. Generated, the specific method is as follows:

[0062] a. After the request message arrives at the host, the synchronization router will deliver it to the shared message queue according to the message category, and hand it over to the corresponding process for processing;

[0063] b. During the order processing process, the application process first connects to the basic data memory, and then verifies the order according to the information recorded in it. After the verification is successful, it writes to the order book memory and updates the status information recorded in the application log file. The application proces...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the distributed data processing technology field and particularly relates to a system and a method for guaranteeing distributed data processing consistency. The system comprises a computer transaction system platform. The computer transaction system platform comprises multiple transaction platforms for transaction business processing, a host in a transaction host is taken as a main node, other nodes are taken as standby transaction machines, the main node is for processing tasks of all orders and further for log record, maintenance and triggering basic data synchronization of secondary nodes, the secondary nodes do not carry out real-time order processing but realizes consistency with the main node through synchronization maintenance of basic data memory. Compared with the prior art, the system is advantaged in that a log structure with a message execution state is employed; a problem of time delay conflict of real-time reading and updating of the basic data of the transaction system can be solved; complexity of replay of the transaction system is reduced; consistency during data processing between platforms and switching between main and standby machines, system performance and reliability are improved.

Description

[technical field] [0001] The invention relates to the technical field of distributed data processing, in particular to a system and method for ensuring the consistency of distributed data processing. [Background technique] [0002] For transaction systems that require high reliability and real-time performance, the design and implementation of good data processing methods are of great significance. Among them, the data consistency strategy in distributed systems has always been the most complicated issue in data system design, such as highly parallel Problems caused by multi-task parallelism in the machine, difficulties caused by multi-machine parallelism, unpredictable network delay, multiple copies in the system, data modification is usually performed on different copies, etc. A design can often only solve several of the above problems and cannot cover them all. [0003] In the current distributed system, the methods used to ensure data consistency are based on the lock m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L12/24H04L29/08
Inventor 胡丽聪武剑锋王泊黄俊杰林征刘乐黄寅飞白硕
Owner SHANGHAI STOCK EXCHANGE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com