Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed queue processing method and system

A processing method and processing system technology, which are applied in the field of distributed queue processing methods and systems to reduce interaction and ensure safety and reliability.

Active Publication Date: 2015-05-06
MICRO DREAM TECHTRONIC NETWORK TECH CHINACO
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present application provides a distributed queue processing method, which is used to solve the problem that the sender needs to re-push data to the queue when the data processing fails
[0005] The embodiment of the present application also provides a distributed queue processing system, which is used to solve the problem that the sender needs to re-push data to the queue when the data processing fails

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed queue processing method and system
  • Distributed queue processing method and system
  • Distributed queue processing method and system

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment 1

[0063] Figure 4 It is a detailed flowchart of a distributed queue processing method provided by the embodiment of the present application.

[0064] The distributed queue processing method, whose execution subject is the queue processing process in the queue processor, includes:

[0065] S201: Create a reprocessed data storage directory, a pending data storage directory and a log directory (corresponding to the processing failure data storage device in claim 3).

[0066] S202: Read the configuration file.

[0067] If the queue processing process is configured to stop, then the queue processing process ends. If the queue processing process is configured as a working state, it will continue to execute.

[0068] S203: Read data.

[0069] First access the reprocessed data storage directory. If there is data in the reprocessing data storage directory, read data from the reprocessing data storage directory to the pending data storage directory instead of reading data from the q...

specific Embodiment 2

[0102] Figure 6 It is a detailed flowchart of another distributed queue processing method provided by the embodiment of this application.

[0103] The distributed queue processing method, whose execution subject is the queue processing process in the queue processor, includes:

[0104] S301: Create a reprocessing data storage device.

[0105] The reprocessing data storage device may be a reprocessing data storage directory, a reprocessing data server, and the like.

[0106] S302: Read the configuration file.

[0107] S303: Read data and process the data.

[0108] According to the set predetermined time interval, when the predetermined time interval is reached, the data that fails to be processed in the reprocessing data storage device is preferentially processed. Otherwise, the data is read from the queue server to the reprocessing data storage device and the data is processed. The set predetermined time interval is much greater than the average time interval between two...

specific Embodiment 3

[0122] Figure 8 It is a detailed flowchart of another distributed queue processing method provided by the embodiment of this application.

[0123] The distributed queue processing method, whose execution subject is the queue processing process in the queue processor, includes:

[0124] S401: Create a log directory (corresponding to the reprocessing data storage device in claim 4).

[0125] S402: Read the configuration file.

[0126] S403: Read data and process the data.

[0127] According to the set predetermined time interval, when the predetermined time interval is reached, the failed data in the log directory will be processed first. Otherwise, read data from the queue server to the log directory and process the data. The set predetermined time interval is much greater than the average time interval between two adjacent data readings.

[0128] S404: After the data processing is completed, transmit the data and the name of the business program to the data synchronizati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed queue processing method and system. The method comprises reading data from a queue server; processing the data; if the data processing failed, storing the data into a reprocessing data storage device for reprocessing. The failed data is stored through the system for subsequent reprocessing. Therefore, when data processing failure occurs, a sender does not need to push data to a queue again, and safety and reliability of the system can be further ensured, and interaction between the sender and the system can be saved.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a distributed queue processing method and system. Background technique [0002] Distributed queue is an asynchronous message processing mechanism widely used in the Internet. It runs in one or more nodes of the network, maintains a set of data structures as the storage and exchange format of messages, and provides corresponding message management and access and other functions. The message sender sends the message, the message is transmitted to the queue and resides in the queue until the message receiver receives it, thus ensuring the reliability of message transmission. Distributed queues decouple complex systems, and the sender and receiver do not need to establish direct contact. As long as the data structure of the message remains unchanged, any change in one party will not affect the other. [0003] At present, for the processing of messages in distributed que...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L12/863
Inventor 韦昌佗王玥高洋
Owner MICRO DREAM TECHTRONIC NETWORK TECH CHINACO
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com