File splitting method and device

A file and to-be-split technology, applied in the field of big data, can solve problems such as inability to meet user needs

Pending Publication Date: 2020-09-04
WEBANK (CHINA)
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, with the popularization of financial management concepts, the base of financial management people has increased, and this method has been unable to meet the needs of users.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File splitting method and device
  • File splitting method and device
  • File splitting method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0037] figure 1 A system architecture for file splitting provided by the embodiment of the present invention is applicable to a distributed cluster; multiple servers in the distributed cluster are used to perform respective splitting tasks. Such as figure 1 The server cluster 103 in can be used for splitting the file to be split, the server cluster 105 can be used for storing each classified file after the file to be split is split, an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a file splitting method and device, and is suitable for a distributed cluster. A plurality of servers in the distributed cluster are used for executing respective splitting tasks; the method comprises the steps that for any server in the multiple servers, the server obtains a to-be-split fragment from a to-be-split file according to the fragment position ina splitting task; the server determines a classification corresponding to each row of data in the to-be-split fragment according to service logic in file processing configuration and records the classification into a local variable of the classification; and the server writes the local variables of each classification into each classification file in a locking manner according to the classification storage information in the file processing configuration. By adopting the method, the file splitting speed can be increased, and the time cost and the labor cost are reduced.

Description

technical field [0001] The invention relates to the technical field of big data, in particular to a file splitting method and device. Background technique [0002] With the development of computer technology, more and more technologies are applied in the financial field, and the traditional financial industry is gradually transforming into financial technology (Finteh). However, due to the security and real-time requirements of the financial industry, higher requirements are also placed on technology. Require. In recent years, through the application of computer technology, the development of the financial industry has been changing with each passing day. It is precisely because of the rapid development of the financial industry that the financial-related data has exploded, making it difficult for the corresponding computer technology to support the subsequent development of the financial industry. [0003] In the prior art, by setting business logic and running related log...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/16G06F16/182G06F16/176G06F9/445G06K9/62
CPCG06F16/16G06F16/182G06F16/1774G06F9/4451G06F18/24
Inventor 符修亮万磊李毅钱进
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap