Method and device for realizing counting of independent user number

Abstract

The invention discloses a method and a device for realizing counting of an independent user number. The method comprises the steps of splitting user numbers in logo information into grouping information and number information according to a splitting strategy; grouping according to the grouping information, setting a corresponding byte array for the number information in each group, to generate bit mapping information of all number information in each group; scanning the byte arrays and counting each bit with each bit byte being 1 of the bit mapping information in each group to obtain counting information of independent user number of each group; accumulating the counting information of all groups to obtain the independent user number information of all records. A controllable counting speed is realized by splitting the user numbers, the number information in the groups can be subjected to bit mapping, the aim of realizing the counting of the independent user number without sequencing is realized, counting is performed by counting the byte bit of 1 in the arrays instead of sequence changing, and the storage space consumption of data sequencing is saved.

Description

technical field [0001] The invention relates to the field of data analysis, in particular to a method and device for realizing the statistics of the number of independent users. Background technique [0002] With the coverage and development of network communication, the number of unique users for network access or traffic analysis (the number of unique visitors (UniqueVisitor referred to as UV) refers to the number of unique users who visit the statistical object within a statistical period.) Statistics can help companies analyze business growth and promotion effects within a certain period. Therefore, effective statistics on the number of unique users can obtain information such as traffic and user growth in a timely manner, providing an important reference for enterprises. [0003] At present, the statistical method of the number of independent users is mainly to obtain all the user numbers that need to be counted from the logs obtained from the server by obtaining the l...

AI Technical Summary

Problems solved by technology

[0004] However, with the increase of communication applications, the number of network access groups is also increasing, and the number of users accessing the network has increased sharply. According to the current statistical method of the number of independent users, it has been unable to adapt to the current data statistics.

Taking mobile operators as an example, according to the statistical results of operators, the number of independent users that need to be counted in a province is about 80 billion pieces of information every day. If the data analysis is carried out according to a longer cycle, the data that is too large cannot be guaranteed in time. The number of independent users is counted, and the acquisition of original data and the storage of sorted data bring a lot of consumption to storage space

In addition, with the rise of big data services, the distributed file system stores the record information of users online in different spaces according to the distributed storage method, which cannot support the unified sorting of all user numbers, let alone scan to determine independent Statistics of the number of users

[0005] To sum up, the current method of counting the number of independent users has the problems of difficult control of the statistics speed and large consumption of storage space in the process of counting large amounts of data, and cannot support distributed computing.

Images