33 results about "Sparse file" patented technology

Read-only and read-write snapshot copies of a production file in a Unix-based file system are organized as a version set of file inodes and shared file blocks. Version pointers and branch pointers link the inodes. Initially the production file can have all its blocks preallocated or it can be a sparse file having only an inode and its last data block. A protocol is provided for creating read-only and read-write snapshots, deleting snapshots, restoring the production file with a specified snapshot, refreshing a specified snapshot, and naming the snapshots. Block pointers are marked with a flag indicating whether or not the pointed-to block is owned by the parent inode. A non-owner marking is inherited by all of the block's descendants. The block ownership controls the copying of indirect blocks when writing to the production file, and also controls deallocation and passing of blocks when deleting a read-only snapshot.

Sequential media reclamation is usually performed after portions of a sequential access volume's data are no longer needed and the unused portion of the volume exceeds a threshold. Improved sequential media reclamation is provided by using a sequential access disk volume (for example, a volume of a virtual tape library (VTL)) embodied as a sparse file. Reclamation of objects stored in the volume is accomplished by nulling out regions of the sparse file that contain the objects that are no longer needed. A replication method is also provided in which information about the objects stored in the sparse file (such as offset and length) is used during replication to enable the correct portions of a target volume (embodied as a sparse file) to be nulled out to match a source volume (also embodied as a sparse file).

Provided are techniques for space recovery with storage management coupled with a deduplicating storage system. A notification is received that one or more data objects have been logically deleted by deleting metadata about the one or more data objects, wherein the notification provides storage locations within one or more logical storage volumes corresponding to the deleted one or more data objects, wherein each of the one or more data objects are divided into one or more extents. In response to determining that a sparse file represents the one or more logical storage volumes, physical space is deallocated by nulling out space in the sparse file corresponding to each of the one or more extents.

A database view of a database is created which provides a transaction-consistent view of an existing database at a previous time. Each database view contains all the information needed to, along with the primary database, determine the contents of the primary database at a previous time. The database view consists of a side file corresponding to each data file in the primary database. The side files contain a copy of all data from the corresponding data file which has been changed since the database view was created. Sparse files may be used for the side files in order to conserve space. Page table data is kept in order to allow a quick determination as to whether the page from the primary database has been modified and the old version stored in the database view side file.

Sequential media reclamation is usually performed after portions of a sequential access volume's data are no longer needed and the unused portion of the volume exceeds a threshold. Improved sequential media reclamation is provided by using a sequential access disk volume (for example, a volume of a virtual tape library (VTL)) embodied as a sparse file. Reclamation of objects stored in the volume is accomplished by nulling out regions of the sparse file that contain the objects that are no longer needed. A replication method is also provided in which information about the objects stored in the sparse file (such as offset and length) is used during replication to enable the correct portions of a target volume (embodied as a sparse file) to be nulled out to match a source volume (also embodied as a sparse file).

The invention provides a file data edge caching method in a cross-domain virtual data space, and provides an edge caching mechanism for the file data in allusion to the requirement of efficient accessof remote data in the cross-domain virtual data space and the IO bottleneck problem brought to an upper-layer application by a wide-area environment. The method comprises the following steps: cachingremote data in a place close to a client, establishing an edge cache to improve the overall performance of accessing the remote data by an upper application, and further reducing data redundancy through cache sharing; the edge cache establishes a memory-based file cache for the small file, and establishes a sparse file-based file system cache for the large file; the consistency of data in the virtual data space is improved by adopting a caching strategy of a central read-write mark based on file extension attributes; and through a cache replacement strategy based on the file popularity, the cache performance and efficiency are ensured.

The invention discloses a cross-host sparse file copying method, device and equipment and a computer storage medium. In the scheme, a source host reads metadata information of a to-be-copied target sparse file and then sends the metadata information to a target host, and the target host creates the to-be-filled sparse file by utilizing the metadata information; and the source host reads the targetsparse file, and sends the valid data determined in the reading process and the offset information of the valid data to the destination host, so that the destination host reconstructs the corresponding sparse file in the to-be-filled sparse file by using the valid data and the offset information. It can be seen that after the source host sends the effective data and the offset information of thesparse file to the target host, the target host can reconstruct the corresponding sparse file through the effective data and the offset information, and therefore cross-host copying of the sparse fileis achieved; moreover, only effective data is copied when the sparse file is copied, so that the file copying rate can be increased.

The invention relates to an achieving method of a high-performance elastic-capacity virtual machine disk. The achieving method is characterized by being achieved according to a sparse file mechanism, a logical volume management mechanism and a virtual machine disk aligning principle. The achieving method comprises the steps of (1) adopting the sparse file mechanism to achieve the elastic-capacity virtual machine disk, (2) adopting the logical volume management (LVM) mechanism to achieve on-line capacity expansion of a disk space, (3) adopting the virtual machine disk aligning principle. By means of the achieving method, at least more than 50% of memory space can be greatly saved in a cloud computing environment. In addition, the input-output (IO) performance of the virtual machine disk reaches to more than 90% of the IO performance of a physical file system.

The invention provides a data hierarchical storage method, a reading method, a storage host and a storage system, and the method comprises the steps: obtaining to-be-stored data; writing the to-be-stored data into a first sparse file in a storage component, wherein the storage component is formed by superposing the first sparse file and a second sparse file which are the same in size, and the read-write performance of a first hard disk stored in the first sparse file is superior to the read-write performance of a second hard disk stored in the second sparse file. According to the method and the device, the two sparse files falling into the first hard disk and the second hard disk respectively are superposed to form the storage component, so the data can be directly written into the sparsefiles of the first hard disk during data writing, additional metadata does not need to be written, and the writing performance is greatly improved.

Embodiments are provided herein for an efficient database storage model, which utilizes sparse file features to efficiently store and retrieve data. The embodiments provide database algorithms that utilize the file system abstraction layer to hide the complexity of managing disk space while providing the database a linear and contiguous logical address space for holding multiple database objects. An embodiment method includes pre-allocating, in a logical sparse file, a plurality of segments fixed in size and contiguous at fixed offsets. Upon receiving a command to write database objects to the segments, the database objects are mapped to the segments in a database catalog. The method further includes interfacing with a file system to initialize storage medium space for writing the data objects to the segments at the fixed offsets.

Examples disclosed herein provide systems, methods, and software for avoiding data replication using sparse files. In one example, a method of using a sparse file to manage modifications to read-only files includes identifying an open file request on a computing system for a read-only file, and generating the sparse file corresponding to the read-only file. The method further includes identifying a modification to the read-only file and, responsive to identifying the modification, initiate a write to the sparse file based on the modification and identifying the write in a region map.

A database view of a database is created which provides a transaction-consistent view of an existing database at a previous time. Each database view contains all the information needed to, along with the primary database, determine the contents of the primary database at a previous time. The database view consists of a side file corresponding to each data file in the primary database. The side files contain a copy of all data from the corresponding data file which has been changed since the database view was created. Sparse files may be used for the side files in order to conserve space. Page table data is kept in order to allow a quick determination as to whether the page from the primary database has been modified and the old version stored in the database view side file.

Embodiments are provided herein for an efficient database storage model, which utilizes sparse file features to efficiently store and retrieve data. The embodiments provide database algorithms that utilize the file system abstraction layer to hide the complexity of managing disk space while providing the database a linear and contiguous logical address space for holding multiple database objects. An embodiment method includes pre-allocating, in a logical sparse file, a plurality of segments fixed in size and contiguous at fixed offsets. Upon receiving a command to write database objects to the segments, the database objects are mapped to the segments in a database catalog. The method further includes interfacing with a file system to initialize storage medium space for writing the data objects to the segments at the fixed offsets.

The present application discloses a file data block addressing method, system, and device and computer readable storage medium. The file data block addressing method comprises obtaining a file block number of a file to be operated, and determining whether the file block number is within a preset range; if yes, according to a pointer corresponding to the file block number, a disk logical block number corresponding to the file to be operated is determined by directly addressing; if not, a target pointer is acquired, and according to the base tree pointed by the target pointer and the file blocknumber, a disk logical block number corresponding to the file to be operated is determined; the base tree is a base tree of a disk logical block number storing the file. The file data block addressingmethod uses a direct mapping and a base tree mapping to map a file block number to a disk logical block number. Through a direct index of a preset range of the file block number, small files can complete the disk request by accessing the disk twice, and the base tree mapping is adopted for sparse files and large files, thereby effectively reducing the disk occupation of the index block.

Examples disclosed herein provide systems, methods, and software for avoiding data replication using sparse files. In one example, a method of using a sparse file to manage modifications to read-only files includes identifying an open file request on a computing system for a read-only file, and generating the sparse file corresponding to the read-only file. The method further includes identifying a modification to the read-only file and, responsive to identifying the modification, initiate a write to the sparse file based on the modification and identifying the write in a region map.

In some embodiments, a cyber security method for preventing unauthorized file modification by malicious software and the like, the file accessible to an authorized handler may include: receiving a first access request from a program, the first access request having a first instruction set for modifying data of the file; determining if the file is associated with the authorized handler; processing the first instruction set to produce first modification data; and generating an initial virtual file object comprising the first modification data. In further embodiments, a cyber security method for preventing unauthorized file modification by malicious software and the like, the file accessible to an authorized handler may include: processing an instruction set for modifying a file to produce modification data; generating a virtual file object comprising the modification data; and associating the virtual file object with the file by identifying the file as a sparse file.

The invention provides a method for edge caching of file data in a cross-domain virtual data space. Aiming at the requirement of efficient access to remote data in the cross-domain virtual data space and the IO bottleneck problem brought by the wide-area environment to upper-layer applications, the edge cache of file data is proposed. caching mechanism. Cache remote data close to the client and establish an edge cache to improve the overall performance of upper-layer applications accessing remote data, and further reduce data redundancy through cache sharing; edge cache establishes a memory-based file cache for small files, and for large files The file establishes a file system cache based on sparse files; the cache strategy based on the central read-write flag of file extension attributes is adopted to improve the consistency of data in the virtual data space; the cache replacement strategy based on file popularity ensures the performance and efficiency of the cache .

The invention provides a method and a device for quickly verifying the consistency of multi-duplicate storage. The method includes S1, judging data writing volumes of head files when systems are in idle states, creating snapshot files by the aid of I / O (input / output) redirection technologies when the volumes of data written into the head files reach 30% of the volumes of integral spare files at least, utilizing new head files with continuously written data as null comparison sparse files, computing hash values of the snapshot files and storing the hash values of the snapshot files as extended attributes; S2, carrying out snapshot operation on the head files once at intervals of preset time and comparing hash values of the new head files to the hash values of the snapshot files when the consistency of multi-duplicate data need to be timely verified. The method and the device have the advantages that characteristics of distributed block storage are combined with one another, the method for quickly detecting the consistency of multiple duplicates on the basis of snapshot technologies is proposed, hash value computation tasks are divided to be carried out in multiple time slots, accordingly, influence on normal reading and writing tasks of the systems can be prevented, and the multi-duplicate storage consistency verification speeds can be increased.

The invention relates to a method for redirecting iSCSI mounted volume to read and write data and a backup recovery system thereof, wherein the method includes 1) creating a temporary sparse file with the same size as the original sparse file; During the write operation, directly write the data to the temporary sparse file described in step 1); 3) when the read operation to the original sparse file is captured, read the data from the original sparse file and merge the data from the temporary sparse file The changed data is read out to obtain the latest data block; the backup recovery system includes a storage module of the native file system and a SCSI protocol analysis module. Compared with the prior art, the invention improves the reading and writing performance of the mounted volume, thereby better meeting the storage performance required by the application on the production system and improving the availability of the iSCSI mounted volume.