File transfer method and system capable of clustering and supporting multiple users to upload simultaneously

Abstract

The invention provides a file transfer method and system capable of clustering and supporting multiple users to upload simultaneously. The system comprises a user layer including a plurality of clients, an access layer including an LVS (Low Velocity Scanning) module and a plurality of file transfer modules, and a storage layer including a plurality of file storage modules. The method comprises the following steps: step S1 of transmitting an uploading request by the clients; step S2 of selecting one file transfer module by the LVS module to process the uploading request, segmenting the new file into a plurality of file blocks by the file transfer module, and returning an uploading response; step S3 of transmitting a file block uploading request by the clients after receiving the uploading response; step S4 of returning a write file block response by the file transfer module based on the not yet uploaded file blocks; step S5 of transmitting file blocks to the file transfer module by the clients according to the write file block response; step S6 of selecting one file storage module to store the file blocks by the file transfer module, turning to step S4 and continuing to upload the next file block. The file transfer method and system capable of clustering and supporting multiple users to upload simultaneously provided by the invention improve the system throughput and risk resistance capacity through clustering, and support multiple users to upload the same one file simultaneously and perform breakpoint transmission.

Description

technical field [0001] The invention relates to the communication field, in particular to a file transmission method and system capable of clustering and supporting simultaneous uploading by multiple users. Background technique [0002] In the development task of Internet file transfer service, there are problems of frequent reading and writing IO in the program and relatively large uploaded files, which requires high network throughput. It is necessary to support high concurrency and high IO disk access, and to ensure the integrity of files in cluster deployment. Consistency, and at the same time reduce problems such as abnormal program exit, network bandwidth usage, and disk fragmentation. [0003] Landing file, that is, a file saved to the disk of the local computer. refer to figure 1 , in the existing file transfer service, the landing file and the file transfer service are on the same server, and the local disk is read and written. Therefore, the existing file transf...

AI Technical Summary

Problems solved by technology

Therefore, the existing file transfer service does not support clustering, and the landing file and file transfer service are deployed on the same server. Due to the impact of server performance and network IO, the processing capacity of the stand-alone service cannot be maximized. When a large number of users and large files are uploaded , unable to meet the requirements of high concurrency and high real-time performance; on the other hand, when the server fails, the service restarts, the system is powered off and other abnormal situations occur, the file transfer function cannot be used without a backup machine

Images