Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing, release, acquisition method and system

A data processing system and data publishing technology, applied in the direction of electrical digital data processing, special data processing applications, transmission systems, etc., can solve problems such as the inability to use the processing method, the inability to guarantee real-time requirements, and the waste of network bandwidth and labor costs.

Active Publication Date: 2018-12-07
SHENGQU INFORMATION TECH SHANGHAI
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] 1. All static data is provided in the form of T+1 or even T+2, which cannot guarantee real-time requirements;
[0007] 2. The full amount of data is provided, and a large amount of repeated data leads to a waste of network bandwidth and a large amount of labor costs;
[0008] 3. For the situation of massive data, the original processing method will not be able to be implemented in the whole project

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing, release, acquisition method and system
  • Data processing, release, acquisition method and system
  • Data processing, release, acquisition method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0107] like figure 1 As shown, the present invention provides a data processing method, comprising:

[0108] Step S11, the publishing end pushes the data extracted in real time from a data generating end to the access layer, wherein the data generating end includes a game server.

[0109] Specifically, in order to provide real-time and punctual data distributed in different places to open platforms that require specific data, a data extraction program can be customized according to the characteristics of the data generation end, such as the characteristics of each game. The database is used for data interaction between the generators, that is, the database is used to store the real-time extracted data.

[0110] Preferably, the data extracted in real time includes dynamic data and static data, and all dynamic data and static data are written into the database, and the dynamic extraction program will generate all specified data, such as the game dynamic and static data of the d...

Embodiment 2

[0132] like figure 2 As shown, the present invention also provides a data publishing method, including:

[0133] Step S21, the publishing end pushes the data extracted in real time from a data generating end to the access layer, wherein the data generating end includes a game server.

[0134] Specifically, in order to provide real-time and punctual data distributed in different places to open platforms that require specific data, a data extraction program can be customized according to the characteristics of the data generation end, such as the characteristics of each game. The database is used for data interaction between the generators, that is, the database is used to store the real-time extracted data.

[0135] Preferably, the data extracted in real time includes dynamic data and static data, and all dynamic data and static data are written into the database, and the dynamic extraction program will generate all specified data, such as the game dynamic and static data of ...

Embodiment 3

[0155] like image 3 As shown, the present invention also provides a data acquisition method, including:

[0156] In step S31, the subscriber sets a second matching method.

[0157] Preferably, an additional management terminal or interface can be set up to support online modification of the second matching method such as subscription rules and take effect in real time.

[0158] Preferably, the subscriber supports multi-process horizontal expansion or multi-node horizontal expansion. A single server can break through the excessive dependence on memory for real-time processing of massive data, and use low-cost and high-capacity hard disks to persist data, providing The high performance and data security of the processing system, the subscriber can support the horizontal free expansion of more servers according to the size of the data volume to process business requests, and maintain the real-time requirements for massive data processing. Distributed technology is used here , ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data processing, issuing and obtaining method and system. The data processing method comprises the steps that an issuing end pushes data extracted from a date generating end in real time to an access layer; the access layer obtains first screened data from the data extracted in real time and stores the data into a corresponding first mail box according to a first matching mode; a distributing layer obtains second screened data from the first mail box according to a second matching mode and a preset channel mode and stores the second screened data into a corresponding second mail; a submitting end obtains the second screened data from the corresponding second mail according to the second matching mode and the preset channel mode, the whole service is constructed through the distribution technology of the Pub / Sub pattern, the issuing end and the submitting end can be related through a flexible subject submission issuing mechanism, the nodes of the issuing end, the submitting end, the distributing layer and the access layer are highly decoupled, and are coupled only through the mail boxes, all interactions are conducted in the mail boxes, and one-to-many mass distribution of the data according to different subjects is achieved.

Description

technical field [0001] The invention relates to a data processing, distribution and acquisition method and a data processing system. Background technique [0002] At present, Shanda Games has many games such as AION, Dragon Valley, Star Transformation, Legend, Handed down, Demon World 2, etc. These games generate a large amount of dynamic and static data every day. According to the current incomplete statistics, Xingchenbian can generate more than 17 kinds of game dynamic data of up to 20 million per day, and Dragon Nest can generate more than 11 kinds of game dynamic data of up to 60 million per day; each game generates less static data every day Then dozens of megabytes, or even hundreds of megabytes. [0003] The game servers of Shanda Games are generally deployed in many IDC computer rooms across the country, while the servers of the open platform are deployed in a centralized manner. Due to the complex network environment and huge data volume, how can these data be pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08H04L29/06G06F17/30
Inventor 王林侯庭凯
Owner SHENGQU INFORMATION TECH SHANGHAI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products