52 results about "Journaling file system" patented technology

A method and system that reduces the length of time required to complete antivirus scans. An enhanced journal file system (JFS) includes an antivirus utility function, which utilizes a low level log of the JFS to store a history of transactions that occur since a previous scan operation. The log is immune from normal purge operations by the JFS and cannot be circumvented without driver level access. Thus, a virus that changes the timestamp on the file or otherwise attempts to hide its viral activity does not affect the log. When the antivirus scanning utility initiates an antivirus scan of the system, the antivirus scanning utility obtains the history since the last scan from the persistent log. The antivirus scanning utility “replays” the log and carries out the antivirus scan on all files, directories, etc. associated with any transactions that occurred since the last scan.

A method and apparatus for ensuring valid journaled file system metadata during a backup operation are provided. With the method and apparatus, mechanisms are provided for suspending write I/O operations to storage devices during a point-in-time backup operation. Once the point-in-time backup operation is completed, the suspended write I/O operations are released and may then be processed by the storage system. In one exemplary embodiment, when a point-in-time operation is initiated, a point-in-time backup flag is set in a logical volume manager. In response to receiving a write I/O operation, the logical volume manager checks the status of the point-in-time backup flag to determine if a point-in-time backup operation is currently being performed. If the flag is not set, then the write I/O operation is logged and performed in a normal manner. If the flag is set, then the write I/O operation is stored in a hold queue of the logical volume manager. The write I/O is not permitted to be sent to the storage system while stored in the hold queue. When the point-in-time backup operation is completed, the suspended write I/O operations in the hold queue are permitted to be sent to the storage system and the metadata for the file system is updated to reflect the committing of the write I/O operations.

The invention provides a multi-version control method of a memory file system, based on an HMFS (hybrid memory file system). The method includes the following steps of: data modification and updating: performing multi-version backup on a node address tree of the memory file system via a copy-on-write mode, and multiplexing nodes in the address tree to perform data modification and updating; data sharing: adopting level reference counting to realize metadata sharing of the multi-version file system, wherein metadata refer to data for describing data and are recorded data for realizing multi-file system versions. Files not modified are utilized to restore the file system to the file system before the files are modified, file sharing among the multi-version file systems is realized by level reference counting, and all the files of the original file system do not need to be back-upped when the file system is snapshot, so that time-space cost needed for snapshooting of the file system is reduced, and performance of the file system is improved.

A computer system includes a disk apparatus and a host computer including a journal file system. The disk apparatus includes a memory unit which is capable of permanently storing a journal, a storing control unit which stores a journal, which is sent from the host computer, in the memory unit, and an updating unit which executes data update corresponding to the journal stored in the memory unit in accordance with an instruction from the host computer. The journal file system of the host computer includes a writing unit which executes, each time the data on the disk apparatus is updated, writing of a journal, which corresponds to the data update, to the disk apparatus, and an informing unit which informs the disk apparatus of an instruction to execute the data update corresponding to the written journal.

A host of a multi-device file system may instruct an external data mover implementing a third party copy to move data from one storage device to another without the host reading or writing data as part of the move. The data being moved may remain accessible through the file system after being moved. A host may instruct an external data mover to write moved data to multiple mirrored devices. A host may instruct the data mover to move data between storage classes in a multi storage class file system. A journaling file system may utilize an external data mover implementing a third party copy to move data from a system log to another storage destination and may also instruct the data mover to move metadata as well as data.

The invention relates to a performance optimizing method for a log file system based on a nonvolatile memory. The method comprises the following steps: connecting an NVM and a DRAM to a memory bus ofa CPU, updating small data by in-situ write so as to minimize occupation of the memory, carrying out fine-grained backup on the data to be updated by using a small data log, and recording the newest data information, which requires to be changed, of the file; storing a global hash table by a fixed-length circular buffer region, and recording an initial address of every update for rapid indexing tothe data page when in next in-situ updating; recording the initial address of the updated data page for next rapid indexing to the data page; and after data writing is finished, updating log tail byupdating a pointer, which points to a data block, of metadata to submit write at this time as a mark for completion of operation at this time. Expenditure and performance for data consistency can be balanced, space distribution costs are reduced, write amplification in a small data updating process is avoided, and meanwhile, powerful data consistency is ensured.

The invention provides a log file system construction method based on an LSM-Tree structure.The method comprises the following steps of constructing a log file system fuse frame interface of the LSM-Tree structure, wherein the step of constructing multiple catalog operation functions and file operation functions of the log file system based on the LSM-Tree structure is included; adopting the Hash mapping function for adding recorded data into the constructed log file system based on the LSM-Tree structure and inquiring the recorded data.By means of the log file system construction method, on the premise that read-write performance of a large file is maintained unchanged, read-write performance of a catalog and a small file can be effectively improved.

A problem with a journaling file system is that the load on input/output processing executed between a server and a storage system is increased because a journal log is written when the file system is updated and updated data is written when flush processing is executed. In a system according to the present invention, a storage system that has received journal logs from a server uses updated data included in the journal logs to execute flush processing.

The invention provides a trash recycling method for a log file system on the basis of repeated data deleting, and relates to computer data storage methods. The trash recycling method includes the steps of initializing, parallel data processing, trash recycling and ending. According to a reference value of a data block obtained by a repeated data deleting technology, data are divided into strong data and weak data, the strong data and the weak data are respectively migrated into different segments when trashes of the log file system are recycled, and divided storage of the strong data and the weak data is realized. Data blocks in a strong data segment are low in failure rate, and the times of trash recycling are less; data blocks in a weak data segment are high in failure rate, and effective data blocks needing migration are less during trash recycling. The trash recycling method for the log file system on the basis of repeated data deleting has the advantages that the times of data block migration during trash recycling in the log file system can be reduced effectively, and performance and reliability of a flash memory system can be improved.

The invention discloses a data processing method and device. The data processing method comprises following steps of consuming task failure data in a message queue by a specific thread, wherein the task failure data is used for indicating failure tasks related to data operations in a database; and writing at least part of the consumed task failure data in a log file system. According to the data processing method and device, the task failure data is transferred from the message queue to the log file system, therefore, the task failure data will not be stored in the message queue for a long time, and the storage pressure of the message queue can be effectively mitigated.

The invention discloses a method for restoring deleted data of a journaling file system (JFS). The method comprises the steps that a journal record is obtained, and the JFS is analyzed; it is determined that subfile entries of the journal record are mounted in a directory entry obtained through analysis; subfile entries of the directory entry obtained through analysis are compared with the subfile entries of the journal record; inode information of the parts, different from the subfile entries of the journal record, of the subfile entries of the directory entry obtained through analysis is obtained; the file content of a deleted file is obtained according to a memory address in the inode information. The memory address corresponding to the deleted data can be obtained according to the journal record embedded in the JFS, and the deleted data is found according to the memory address and restored.

The invention provides a log collection method, a log collection system and a server. The log collection method comprises the following steps: isolating a target collection point according to the identity information of collection points of a server; combining log information generated by the isolated collection point according to a preset configuration file to form an information object set; and converting the information object set to a specified format according to the preset configuration file, and storing the information object set in the specified format in a log file system of the server. According to the technical scheme of the invention, log information shunting is realized, the work efficiency of the server is improved, the flexibility and accuracy of log information collection are increased, the inference of irrelevant log information is reduced, and the analysis efficiency of log information is improved.

The embodiment of the invention discloses a file protection method and device. The method comprises the steps that attribute information of a to-be-protected file stored in a file system is determined; a backup file corresponding to the attribute information is created; whether the attribute information of the file is altered or not is detected; when it is detected that the attribute information of the file is altered, the altered attribute information is read, and the corresponding backup file is updated according to the altered attribute information. Thus, the to-be-protected file is subjected to backup so that file restoration can be realized according to the corresponding backup file when the file is deleted and needs to be restored, and the problem that in the prior art, inode stored in a log file system is covered and updated, and consequently a deleted file cannot be restored is solved.

The invention provides a security log file system, an implementation method thereof and a medium. The system comprises the following components of: a file configuration module which is used for distributing files and folders to directory entries, wherein the directory entries comprise file names, sizes and file content initial addresses, and the directory entries serve as directory file contents to be stored in a data area; a conversion module used for carrying out mapping from a logic address to a physical address, outage recovery, garbage collection and wear leveling, and providing a virtualdisk, so that an upper-layer application directly uses a storage device based on the flash memory; a storage module used for dividing a logic block into a data block and a log block according to a mixed flash memory conversion layer thought, wherein the data block adopts block-level mapping and is used for storing data. and the log block adopts page-level mapping and is used for storing and updating. The security log file system, the implementation method thereof and the medium provided by the invention meet the requirements, are innovated on the existing basis, and have relatively strong operability and expansibility.

System and method for implementing a reliable persistent random access compressed data stream is described. In one embodiment, the system comprises a computer-implemented journaled file system that includes a first file for storing a series of independently compressed blocks of a data stream; a second file for storing a series of indexes corresponding to the compressed blocks, wherein each one of the indexes comprises a byte offset into the first file of the corresponding compressed block; and a third file for storing a chunk of data from the data stream before it is compressed and written to the first file. The system further comprises a writer module for writing uncompressed data to the third file and writing indexes to the second file and a compressor module for compressing a chunk of data from the third file and writing it to the end of the first file.