Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mass file storage method and device in a distributed system

A distributed system and massive file technology, applied in the field of massive file storage methods and devices, can solve the problems of high data storage operation and maintenance costs, low storage device utilization, and the like, so as to improve storage device utilization and reduce storage redundancy. , the effect of reducing the occupancy rate

Active Publication Date: 2019-08-30
BEIJING SOHU NEW MEDIA INFORMATION TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] This multi-copy storage method improves the reliability of persistent data storage by increasing redundancy. Although it has the advantages of easy data recovery and reading pressure sharing, the utilization rate of storage devices is relatively low; moreover, for those who need to store PB-level For companies with massive data, the cost of data storage operation and maintenance is relatively high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mass file storage method and device in a distributed system
  • Mass file storage method and device in a distributed system
  • Mass file storage method and device in a distributed system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In order to make the purpose, technical means and technical effects of the present invention more clear and complete, the specific implementation of the present invention will be described below in conjunction with the accompanying drawings.

[0046] In order to explain more clearly a method for storing massive files in a distributed system provided by the present invention, the application background environment of the method is firstly explained below.

[0047] In recent years, technology companies that provide public cloud storage solutions have emerged, and more and more small and medium-sized companies choose to store data in public clouds to reduce operation and maintenance costs. Public cloud storage needs to ensure that the storage is highly reliable and available. In the event of disk damage, server downtime, or even power failure in the computer room, it is necessary to ensure that the data stored by users will not be lost. At present, mainstream public cloud ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a mass file storage method and device for a distributed type system. The method comprises the steps of encoding 2n data files to be stored to generate m global verifying block files; dividing the 2n data files into k groups, encoding each group of data files to generate corresponding local verifying block files; storing the 2n data files, the m global verifying block files and the k local verifying block files in 2n+m+k severs in the distributed type system according to a mode that only one file is stored in one server. According to the scheme, encoding treatment is conducted on original data, the global verifying block files and the local verifying block files are calculated, then, original data files and the verifying block files simply need to be stored in the distributed type system instead of storing multiple copies of the original data files, and thus the usage rate of storage equipment is obviously increased on the premise of guaranteeing that the storage reliability is not lowered.

Description

technical field [0001] The invention relates to the field of information technology, in particular to a method and device for storing massive files in a distributed system. Background technique [0002] With the rapid development of information technology, the explosive growth of massive data has brought about data storage and security issues. In order to improve the security and availability of data storage, most traditional distributed data storage systems adopt the method of multiple copies, copying a data file into multiple copies and storing them in multiple servers in the distributed system respectively. If any server with a copy of the data file is available, the data file can be accessed to avoid data loss and inaccessibility problems caused by network failure of a single server or disk damage, thereby achieving disaster recovery through multi-copy redundancy. [0003] This multi-copy storage method improves the reliability of persistent data storage by increasing r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F11/14
Inventor 陈伟
Owner BEIJING SOHU NEW MEDIA INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com