Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

File storage method, device and equipment and storage medium

A file storage and storage block technology, applied in the file system, file access structure, digital data information retrieval, etc., can solve the problems of wasting time and affecting the data storage rate.

Pending Publication Date: 2020-07-07
GUANGZHOU BAIGUOYUAN INFORMATION TECH CO LTD
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The above scheme has the following disadvantages: the current file can only be written into each data block in turn, which affects the data storage rate and wastes time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File storage method, device and equipment and storage medium
  • File storage method, device and equipment and storage medium
  • File storage method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] figure 1 It is a flow chart of a file storage method provided by Embodiment 1 of the present invention. This embodiment is applicable to the case of storing large files. The method can be executed by a file storage device, which can be composed of hardware and / or software , and can generally be integrated into a device with a file storage function, which can be an electronic device such as a server, a mobile terminal, or a server cluster. Such as figure 1 As shown, the method specifically includes the following steps:

[0041] Step 110, create a plurality of storage blocks with a set size according to the size of the file to be stored, and generate an index file of the file to be stored according to information of the multiple storage blocks.

[0042] Wherein, the set size may be 64MB, assuming that the size of the file to be stored is 100G, 1600 storage blocks need to be created. The information of the storage block may include the number of the storage block, the c...

Embodiment 2

[0090] figure 2 It is a schematic structural diagram of a file storage device provided by Embodiment 2 of the present invention. Such as figure 2 As shown, the device includes: a storage block creation module 210 , a target block determination module 220 , a data storage module 230 and a storage completion determination module 240 .

[0091] The storage block creation module 210 is used to create a plurality of storage blocks of a set size according to the size of the file to be stored, and generate an index file of the file to be stored according to information of a plurality of storage blocks;

[0092] The target block determination module 220 is configured to scan the storage block information in the index file according to the storage request of at least one client, and determine at least one target block that meets the storage conditions;

[0093] A data storage module 230, configured to store data of a set size in the file to be stored in the target block respectivel...

Embodiment 3

[0114] image 3 It is a schematic structural diagram of a computer device provided by Embodiment 3 of the present invention. image 3 A block diagram of a computer device 312 suitable for implementing embodiments of the invention is shown. image 3 The computer device 312 shown is only an example, and should not impose any limitation on the functions and scope of use of the embodiments of the present invention. Device 312 is typically a computing device that performs file storage functions.

[0115] Such as image 3 As shown, computer device 312 takes the form of a general-purpose computing device. Components of computer device 312 may include, but are not limited to: one or more processors 316, storage 328, bus 318 connecting various system components including storage 328 and processor 316.

[0116] Bus 318 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a file storage method and device, equipment and a storage medium. The method comprises: creating a plurality of storage blocks with set sizes according to thesize of a to-be-stored file, and generating an index file of the to-be-stored file according to the information of the plurality of storage blocks; scanning storage block information in the index file according to storage requests of a plurality of clients, and determining a plurality of target blocks meeting storage conditions; respectively storing the data with the set size in the to-be-storedfile into a target block; and determining that the target block completes storage, returning to execute the operation of scanning the storage block information in the index file according to the storage request of the at least one client, and determining at least one target block meeting the storage condition until it is determined that all the storage blocks complete storage. According to the file storage method provided by the embodiment of the invention, the data of the to-be-stored file can be written into the plurality of storage blocks at the same time, the storage rate of a large file is improved, and time is saved.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of data storage, and in particular, to a file storage method, device, equipment, and storage medium. Background technique [0002] In Internet products, as multimedia applications and big data applications become more and more popular, there are more and more large single files, such as hundreds of GB or even TB files. The storage of a single large file of hundreds of gigabytes or even terabytes poses a corresponding challenge to the current distributed storage technology. [0003] The current distributed storage system, such as Hadoop Distributed File System (Hadoop Distributed File System, HDFS), adopts the scheme of: dividing the super large file into data blocks of 64MB by default, storing these data blocks on different data disks and The file manager (NameNode) records which data blocks the current file consists of. In the process of writing a large file, the client uses the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/13G06F16/182
CPCY02D10/00
Inventor 郭军陈飞蒋德为
Owner GUANGZHOU BAIGUOYUAN INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com