Data storage method and device

Abstract

The invention discloses a data storage method and device. The data storage method and device are used for storing data of different structures into the same data table, and the data storage method comprises the steps of: acquiring source data to be stored; converting each row of data of the source data into single-value data respectively, wherein each single-value data value carries key value pair information of each column of the row of source data; writing each row of converted single-value data into a content field of the data table, and writing a corresponding main key field value for identifying for each row of single-value data. By adopting the solution, the data having different structures can be uniformly stored in the same data table, so that the overall maintenance overhead of data is effectively reduced. In addition, the quantity of fields to be processed practically in the data write process is obviously reduced, so that the storage and processing efficiency can be effectively improved.

Description

technical field [0001] The present application relates to the technical field of data management, in particular to a data storage method and device. Background technique [0002] Data management refers to the process of collecting, storing, processing and applying various data. In the era of big data, in order to cope with the significantly increasing amount of data, in addition to providing sufficient storage space, more data management technologies are also proposed. high demands. [0003] For the data manager, the data that needs to be managed often involves multiple types. Taking the personnel management of a school as an example, the data that needs to be involved may include: teacher information, staff information, student information, etc. Due to these differences Types of data have different attributes, so it is necessary to create data tables with different structures for each type of data to store data. [0004] The above data storage scheme can meet general data...

AI Technical Summary

Problems solved by technology

[0004] The above data storage scheme can meet general data management needs, but it is not suitable for application scenarios involving many types of data. For example, for some professional data collection platforms, various types of source data entities may be involved, such as people, companies, etc. , items, events, etc., and even for two entities of the same type, their data structures are hardly identical, such as teacher information data and student information data, teacher information collected from different data sources, etc.

If the existing data storage scheme is used, data tables with corresponding structures need to be established for entities with different data structures, and the number of data tables that need to be maintained will increase with the type of stored data, and the overall maintenance cost is difficult to control

In addition, for the source data of each structure, it is necessary to write the established data table one by one according to the field correspondence during the storage process. If the source data has many fields, it will have a great impact on the efficiency of storage processing

Images