Editing method and system of large-file data stored based on FICS objects

Abstract

The invention discloses an editing method and system of large-file data stored based on FICS objects. The method comprises following steps: S1, file storage: saving each data of files to be stored and generating file addresses of files to be stored; S2, file editing: editing files by processing file addresses with following four situations of file combination, file segmentation, data insertion and data rejection. The editing method and system of large-file data stored based on FICS objects have following beneficial effects: during storage, each data of files can be saved and file addresses can be generated; during file editing, file combination, file segmentation, data insertion and data elimination are achieved by processing file addresses; file editing speed is improved; and occupation space of file editing is saved.

Description

technical field [0001] The invention relates to a method and system for editing large file data based on FICS object storage. Background technique [0002] File storage and file editing are an essential task in the user's work. File editing mainly includes file merging, file deletion, data insertion and data removal; [0003] In the current file merging process, in the management storage of the local file system and other distributed file systems, it is necessary to sequentially read the data of all source files and write them into new files; in the current file splitting process, the local file system and other distributed file system management storage, it is necessary to read all the data content of large files in sequence and write them into small files respectively, which is very time-consuming; if the source files to be merged or split are hundreds of gigabytes size, then the merging or splitting of files may consume tens of minutes or even hours; at the same time, it...

AI Technical Summary

Problems solved by technology

[0003] In the current file merging process, in the management storage of the local file system and other distributed file systems, it is necessary to sequentially read the data of all source files and write them into new files; in the current file splitting process, the local file system and other distributed file system management storage, it is necessary to read all the data content of large files in sequence and write them into small files respectively, which is very time-consuming; if the source files to be merged or split are hundreds of gigabytes size, then the merging or splitting of files may consume tens of minutes or even hours; at the same time, it will also consume a large amount of storage read and write bandwidth; and, although most of the data content of the source file and the target file are the same, However, the actual occupied disk space is still relatively large, which is the sum of the file data size used

[0004] In the current data insertion or data removal process, in the current local file system and other distributed file system management storage, it is necessary to overwrite all the new data content generated by editing large files in order, and then the data can be saved; This is very time-consuming and bandwidth-consuming; for example: in a signal data file of several hundred M or several G, excel or other format files, we need to insert 10 characters, or delete 10 characters, before saving the file , all the content must be rewritten once, which is very time-consuming and bandwidth-consuming

[0005] The current document editing system is a waste of time and resources

Images