Data processing, issuing and obtaining method and system

Abstract

The invention relates to a data processing, issuing and obtaining method and system. The data processing method comprises the steps that an issuing end pushes data extracted from a date generating end in real time to an access layer; the access layer obtains first screened data from the data extracted in real time and stores the data into a corresponding first mail box according to a first matching mode; a distributing layer obtains second screened data from the first mail box according to a second matching mode and a preset channel mode and stores the second screened data into a corresponding second mail; a submitting end obtains the second screened data from the corresponding second mail according to the second matching mode and the preset channel mode, the whole service is constructed through the distribution technology of the Pub / Sub pattern, the issuing end and the submitting end can be related through a flexible subject submission issuing mechanism, the nodes of the issuing end, the submitting end, the distributing layer and the access layer are highly decoupled, and are coupled only through the mail boxes, all interactions are conducted in the mail boxes, and one-to-many mass distribution of the data according to different subjects is achieved.

Description

technical field [0001] The invention relates to a data processing, distribution and acquisition method and a data processing system. Background technique [0002] At present, Shanda Games has many games such as AION, Dragon Valley, Star Transformation, Legend, Handed down, Demon World 2, etc. These games generate a large amount of dynamic and static data every day. According to the current incomplete statistics, Xingchenbian can generate more than 17 kinds of game dynamic data of up to 20 million per day, and Dragon Nest can generate more than 11 kinds of game dynamic data of up to 60 million per day; each game generates less static data every day Then dozens of megabytes, or even hundreds of megabytes. [0003] The game servers of Shanda Games are generally deployed in many IDC computer rooms across the country, while the servers of the open platform are deployed in a centralized manner. Due to the complex network environment and huge data volume, how can these data be pro...

AI Technical Summary

Problems solved by technology

[0006] 1. All static data is provided in the form of T+1 or even T+2, which cannot guarantee real-time requirements;

[0007] 2. The full amount of data is provided, and a large amount of repeated data leads to a waste of network bandwidth and a large amount of labor costs;

[0008] 3. For the situation of massive data, the original processing method will not be able to be implemented in the whole project

Images