A data export method and device for a distributed large single table

Abstract

The invention discloses a method for exporting data of a distributed large single table, comprising: receiving a request for exporting data sent by a client; searching a distributed database through sphinx, and obtaining a server ID and a data partition ID that meet the request; according to the server ID and the data partition ID to obtain the target data item corresponding to the request; write the target data item into the target file and export it to the client. This method first queries the server and data partition that meet the request, and then directly obtains the target data item according to the server ID and data partition ID, thereby improving the data query efficiency and the data export efficiency of distributed large single tables; at the same time, it can reduce the computer resources. Consumption, improve user experience. Correspondingly, the data exporting device, equipment and readable storage medium of a distributed large single table disclosed in the present invention also have the above-mentioned technical effects.

Description

technical field [0001] The present invention relates to the technical field of databases, and more specifically, to a data export method, device, equipment and readable storage medium of a distributed large single table. Background technique [0002] With the advent of the era of big data, high availability of databases has become increasingly important. Relational database technology has become a core technology in information systems. Due to the poor readability of the database, if you use database tools to query the database, security and authority issues may be involved, so the data in the database can be exported for easy query. [0003] At present, multi-threading is generally used to query a single table of the database, and then multi-threading is used to query the table again to obtain and export data in the database. However, this method is only applicable to the case where there is less data in a single table in the database. When there is a lot of data in a sin...

AI Technical Summary

Problems solved by technology

However, this method is only applicable to the case where there is less data in a single table in the database. When there is a lot of data in a single table in the database, that is, when a large single table needs to be exported, the efficiency of using database tools is relatively slow and consumes There are many computer resources, which is not conducive to cost control and also reduces the user experience; among them, a large single table refers to a single table with millions of data entries or more in a single table, and a distributed large single table refers to a distributed Large single table in database

Images