Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data fragmentation field switching method for distributed file system

A technology for distributed files and system data, which is applied in electrical digital data processing, special data processing applications, instruments, etc., and can solve the problems of disk access data confusion and insufficient disk space.

Active Publication Date: 2013-11-13
WUXI CITY CLOUD COMPUTING CENT
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method leads to the need to switch to another data segment, that is, another group of disk shards, when the space in one shard is insufficient.
When there is a file hole, this space division will still cause the problem of insufficient disk space, resulting in confusion of disk access data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention is described in further detail below:

[0022] A marker object is added to the segment of each file fragment to store file holes in the segment due to insufficient disk space.

[0023] The mapping information of the position of the file hole in the object file and the position in the marked object is stored in the marked object header. This requires setting aside space in the header of the tag object to hold such information.

[0024] File hole mark: When the file hole caused by insufficient disk space is called a false hole, when the file hole caused by the lseek operation is a real file hole. When a hole is created while accessing an object in the data server, these two different cases need to be marked. Only fake file holes need to be redirected to the access token object. This method is more convenient to implement in the kernel mode, and it is difficult to check whether the markup page in the user mode is empty, but it is all achievable.

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data fragmentation field switching method for a distributed file system, which includes: adding a marking object which is used for storing information of file holes generated in a field due to insufficient disc space to the field of each file fragment; reserving space which is used for storing positions of the file holes in an object file and mapping information of the file holes in the marking object in a marking object header; executing corresponding process according to types of the file holes when file holes occur during reading and writing operations. Reading and writing operations cannot fail due to the file holes by adding marking bits on the file holes, and operation for storing and field switching of files is compatible.

Description

technical field [0001] The invention relates to a strategy for allocating and managing disk space in a file storage fragmentation mode in a distributed file system, and in particular relates to a space fragmentation method in a data fragmentation storage mode in an object-oriented storage distributed file system a strategy. Background technique [0002] In the file system, the allocation and management of data space is a key technical issue. In the local file system, disk space is generally allocated on demand in real time. Real-time allocation means that when the file system wants to write a block of data, it allocates a corresponding block of disk space on the disk at the same time. This strategy ensures that the data written to the memory cache will not be lost due to insufficient disk space. But this strategy also makes frequent calls to the space allocator affect performance when writing new files. [0003] On some of the more advanced file systems of the new genera...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 常涛付根希吕明强
Owner WUXI CITY CLOUD COMPUTING CENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com