Dynamic consistency control method in massive data management

Abstract

The invention discloses a dynamic consistency control method in a massive data environment, comprising the following steps of: (1) carrying out initialization work on an environment by a main thread; (2) starting to monitor a read-write request, which is sent by a client-side, by a service node; (3) when the service node receives a data read-write request task sent by the client-side, firstly reading an operation type of the request task; (4) reading a deviation type of the request task and reading a deviation value of the request task; comparing a read result with an existing threshold value and then putting the read result to the tail part of a corresponding array; and (5) returning back to the step (2) and continuously monitoring requests sent by the client-side. According to the dynamic consistency control method provided by the invention, the difficulty that an existing key assignment type database cannot be used by different applications due to the difference between consistency requirements of service data can be overcome. Therefore, a user only needs to care about indexes and values of operated data to the consistency and does not need to spend a great deal of efforts to redevelop one set of the key assignment type database which only meets own service requirements.

Description

technical field [0001] The invention belongs to the field of copy placement methods in a massive data environment, and proposes a method for reasonably placing data when there are multiple copies of the data, that is, a dynamic consistency control method in massive data management. It comprehensively considers various factors that affect the copy placement method, and provides users with a flexible consistency control method on the premise of meeting the consistency requirements of each data record. Background technique [0002] In recent years, with the emergence of typical Internet applications such as social networking sites, online video, online photo album sharing, and microblogging, the era of web 2.0 has come. Facing the information explosion of the Internet, how to process and store large-scale data has brought great challenges to the industry and academia. [0003] Before the emergence of massive data, if the centralized architecture still has a reason for its exis...

AI Technical Summary

Problems solved by technology

2) Different data types within an application will also have different consistency requirements. For example, compared with text, the consistency requirements of pictures and text are obviously not as high as the latter, so when the two use the same consistency method, it must be By improving the consistency requirements of the former to meet the consistency requirements of the system as a whole, the performance of the system as a whole will decrease

Judging from the current situation, neither the industry nor academia has a good solution to the above two problems.

Images