Data processing method and data processing device

Abstract

The invention discloses a data processing method and a data processing device, which are used for avoiding the bottleneck problem of disk input I / O (input / output) and improving the data storage and query speed. The data processing method provided by the invention comprises the following steps of: writing acquired data into a plurality of storage tables which are divided according to time granularity in advance, wherein each storage table is used for storing data acquired in a specific time segment; and when the operation of writing the data into the storage tables is completed, merging the data in the storage tables into subareas of subarea tables, which correspond to the storage tables, wherein the subsareas are used for providing data which need to be queried for a user.

Description

technical field [0001] The present invention relates to the field of communication technologies, in particular to a data processing method and device. Background technique [0002] The development of communication technology has enriched people's communication and life. While enjoying this convenience, people have higher and higher requirements for communication quality. For example, the signaling monitoring system is a statistical analysis system that analyzes communication quality by monitoring link signaling. Based on the collected signaling data, the system analyzes the quality of voice communication and data communication from multiple dimensions. [0003] However, due to the huge scale of the current network, the signaling and other data collected by the system are massive. Therefore, in the process of processing these data, the existing technology has the following problems: [0004] The existing technology cannot dynamically adjust the storage method according to t...

AI Technical Summary

Problems solved by technology

[0004] The existing technology cannot dynamically adjust the storage method according to the actual situation of the bureau site, and cannot support storage and query of different dimensions of the application system, so it cannot save storage space on the premise of ensuring system functions

[0005] The establishment of the index required for data query is not convenient and fast enough to balance the contradiction between resource consumption caused by query and index maintenance

[0006] When writing and reading operations on the same database table at the same time, it will cause the disk input (I) / output (O) bottleneck problem, and the query speed is slow

[0007] Delayed arrival of collected data, resulting in incomplete data in the database

Images