Data processing method and device

Abstract

The invention discloses a data processing method and device which are used for making the data processing process simpler and more intelligent. The method comprises the steps that an information collector sends collected information of different subjects to an information backbone corresponding to the subjects, the information backbone pushes the information to consumers subscribing to the subjects, and the consumers push the obtained information to a corresponding processor for processing. According to the technical scheme, an intelligent consumption method based on a subscribing model is provided, an information producer becomes a publisher, information consumers become subscribers, subject information subscription of multiple dimensions is supported, the subjects are separated from oneanother and not affected, on the basis of an existing queue base, multiple standard entities are abstracted compared with an original queue, the business side only needs to pay attention to topic defined by himself / herself and information processing logic of the processor, internal information transfer details are completely shielded, and then the whole processing process is simpler and more automatic and intelligent.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data processing method and device. Background technique [0002] The production consumer model is a common technique in various programming languages. This model is also widely used in production and life, such as calling and queuing. It has at least three entities: producer, consumer, and buffer queue. Producers, there can be one or more producers of some kind of data, and the produced data will first enter the buffer queue; the buffer queue is used to temporarily store the production data. At both ends of the buffer queue, one end is connected to the producer, and the other end is connected to the consumer. When the queue is full, the producer can no longer add data to the queue. When the queue is empty, the consumer can no longer obtain consumption data from the queue; consumption Alternatively, there can be one or more consumers who obtain and consume data from t...

AI Technical Summary

Problems solved by technology

The above-mentioned existing implementation scheme still has the following problems in actual use scenarios: it only provides a queue, and all operations on the queue need to be operated by the business side; who is the producer and the consumer depends entirely on the business side to specify ;Multiple producers and multiple consumers cannot be realized through only one queue; the mapping relationship between multiple producers and consumers cannot be reflected; for a single queue, the throughput of a single consumer must be very low, and consumers cannot be dynamically adjusted number to increase throughput

Images