Data processing method and device

A data processing and metadata technology, applied in the field of mobile communications, can solve the problems of relational database load, data redundancy, and unsatisfactory performance, and achieve the effect of ensuring response speed

Active Publication Date: 2014-06-11
XINYANG BRANCH HENAN CO LTD OF CHINA MOBILE COMM CORP
View PDF5 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 1. Due to the large number of customers in the mobile communication industry, although the massive customer attribute data based on relational database storage has been optimized for query, the performance is still not ideal, and it is easily affected by the load of the relational database. The response speed, throughput and stability of customer attribute services need further improvement
[0006] 2. For each application, it is necessary to develop a set of customer attribute summary programs and generate a set of customer attribute data tables. The scalability and flexibility are poor, and there is data redundancy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] Embodiment 1 of the present invention provides a data processing method, the step flow of the method can be as follows figure 2 shown, including:

[0030] Step 101, perform data conversion.

[0031] In order to write the full amount of customer attribute data into memory, in this step, for each customer information table in the data warehouse, the customer information table can be periodically converted into a file to be cached. The file to be cached includes a metadata file and a customer data file, the metadata file includes the table structure information of the customer information table, and the customer data file includes each piece of customer information in the customer information table, a piece of customer information Include customer attribute data corresponding to at least one customer attribute.

[0032] Step 102, perform data loading.

[0033] In this step, the metadata file and the client data file may be loaded into a distributed cache system, such a...

Embodiment 2

[0050] Embodiment 2 of the present invention provides a data processing device, the structure of which can be as follows Figure 4 shown, including:

[0051] The conversion module 11 is used for periodically converting the customer information table into a file to be cached for each customer information table in the data warehouse, and the file to be cached includes a metadata file and a customer data file, and the metadata file Including the table structure information of the customer information table, the customer data file includes each piece of customer information in the customer information table, and a piece of customer information includes customer attribute data corresponding to at least one customer attribute;

[0052] The loading module 12 is used for loading the metadata file and the client data file converted by the conversion module into the distributed cache system.

[0053] The loading module 12 is specifically configured to load the metadata file to the dist...

Embodiment 3

[0060] Embodiment 3 of the present invention provides a method for loading customer attribute data. The schematic flow chart of the method can be as follows Figure 5 As shown, the conversion module in the data processing device can periodically extract the customer information table from the data warehouse, and convert the customer information table into a cache file, and the loading module can read the cache file converted by the conversion module, and store the Cache files are loaded into the distributed cache system.

[0061] The method may specifically include the following steps, such as Figure 6 Shown:

[0062] Step 201, perform data conversion.

[0063] For each customer information table in the data warehouse, the customer information table may be periodically converted into a file to be cached. The files to be cached include metadata files and client data files. The metadata file may include a piece of metadata, which represents the table structure information o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention provides a data processing method and device. Each client information table in a database is converted into metadata files carrying table structure information and client data files carrying client information in the table periodically, and total client attribute data are loaded to a distributed cache system actively by loading the metadata files and the client data files to the distributed cache system. By means of the method and the device, mass client attribute data are cached through the distributed cache system, so that the response speed, the throughput and the stability of client attribute data providing can be effectively guaranteed.

Description

technical field [0001] The present invention relates to the technical field of mobile communication, in particular to a data processing method and device. Background technique [0002] In the business analysis system, various customer-level data scattered in various systems are reorganized and reasonably classified through customer attribute services to form customer attribute data sets, business operation support system (BOSS), customer service system, and outbound call management system , marketing management system, handheld business analysis system and other application systems need to realize efficient and reliable access to different customer attribute data through customer attribute services. [0003] In order to meet the access requirements of the application system, the existing customer attribute service develops a corresponding customer attribute summary program according to the requirements of each application system, periodically summarizes the corresponding cus...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/27G06F16/283
Inventor 杜怀忠李明崔刚高啸颖杨晓博李远
Owner XINYANG BRANCH HENAN CO LTD OF CHINA MOBILE COMM CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap