Data storage method and apparatus, and storage medium

A data storage and data technology, applied in the direction of electrical digital data processing, input/output process of data processing, instruments, etc., can solve the problems of large system resources, occupation, affecting system performance, etc., and achieve the effect of reasonable resources

Active Publication Date: 2018-07-17
PING AN TECH (SHENZHEN) CO LTD
View PDF5 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Once one of the OSDs fails, in order to ensure the availability of its three copies, the data migration of the entire cluster will be performed. The data migration process takes up a lot of system resources and greatly affects system performance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and apparatus, and storage medium
  • Data storage method and apparatus, and storage medium
  • Data storage method and apparatus, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] Those skilled in the art know that the embodiments of the present invention can be implemented as a method, device, device, system or computer program product. Therefore, the present invention can be embodied as complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0045] The principle and spirit of the present invention will be described below with reference to several specific embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0046] refer to figure 1 As shown, it is an application environment diagram of a preferred embodiment of the electronic device of the present invention. In this embodiment, the electronic device 1 is connected to the distributed storage system 3 through the network 2 and connected to the client 5 through the network 4 . The distributed storage...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data storage method and apparatus, and a computer readable storage medium. The method comprises the following steps of determining a quantity of OSDs used by business groups according to a preset rule every a preset cycle, and allocating a unique sub-cluster identifier for the OSD of the same business group; receiving a request of storing a data file to a distributed storage system by a user; according to identification information of the user, determining the business group which the user belongs to and the sub-cluster identifier of the OSD of the business group; anduniformly dividing the data file into multiple data blocks, and storing multiple copies of each data block in the OSD with the corresponding sub-cluster identifier by utilizing a CRUSH algorithm. By allocating the OSD for each business group, reasonable configuration of resources is realized; and by adding logic division of sub-clusters into a topology structure of a cluster, the influence of OSDfaults on the storage system is controlled to be in a sub-cluster range.

Description

technical field [0001] The present invention relates to the technical field of data storage, in particular to a data storage method, device and computer-readable storage medium. Background technique [0002] A distributed storage system is a system that stores data dispersedly on multiple independent devices. Ceph is a widely used open source distributed storage system. It treats data as objects (Object), through scalable hash The Controlled Replication Under Scalable Hashing (CRUSH) algorithm evenly distributes objects to the storage device cluster, and provides dynamic expansion, balance and recovery. [0003] At present, in the distributed storage system, the three-copy mechanism is mostly used to store data in three different locations to improve the reliability of data storage. The hierarchical structure of cabinets, hosts, and object storage devices (Object Storage Device, OSD) is used to plan fault domains. Once one of the OSDs fails, in order to ensure the availabi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0614G06F3/064G06F3/0667G06F3/067G06F3/0619G06F3/065G06F3/0665G06F3/0683
Inventor 刘源
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap