File distributed writing, reading and processing mechanism and system under micro-service system

Abstract

The invention discloses a file distributed writing, reading and processing mechanism and system under a micro-service system, and the processing mechanism comprises a distributed file writing processing mechanism under the micro-service system and a matched distributed file reading processing mechanism under the micro-service system, and comprises the following steps: configuring file types and business classification related information; configuring a file generation opportunity; performing data segmentation, and forming a verification file; processing the data in parallel and generating a file, and generating a signature file; performing file sharing; verifying the file information, and segmenting the file information by taking the file as a basic unit; processing each file in parallel,verifying the files, and analyzing the processed files; according to the file distributed processing mechanism and system under the micro-service system, the file can be written in a distributed modeafter service distributed processing is carried out according to the service scene configuration file type; the file user processes the files in a classified and distributed manner according to the service; and the file processing capability and security of the system can be greatly improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a mechanism and system for distributed writing, reading, and processing of files under a microservice system. Background technique [0002] The development of Internet financial services has put forward higher requirements on the processing capabilities of bank IT systems. Traditional huge single applications (or SOA services with very coarse granularity) can no longer meet the requirements in terms of maintainability, scalability, and rapid iteration. To meet the needs of business development, the microservice architecture has become an inevitable choice for industry development. Choosing an appropriate microservice batch interaction and processing method is a key technology for the microservice architecture to cope with the Internet financial business scenario of massive data processing. [0003] But at present, there are mainly two types of interactions between micros...

AI Technical Summary

Problems solved by technology

[0003] But at present, there are mainly two types of interactions between microservices. One is to directly call another microservice through a real-time communication protocol (such as tcp / http, etc.). It causes great pressure; the services are strongly coupled and cannot be truly decoupled; the second is to process the batch interaction between microservices through a single file. This processing method will serialize the business that can be processed in parallel and cannot Give full play to the advantages of distributed processing of microservices; and if the middle of the file is tampered with or lost, the server cannot perceive it, which will directly lead to business risks

This leads to the limited processing capacity of the microservice architecture in the process of banking business development

Images