Implementation method for storing, integrally uploading and segmentally checking based on Ceph object

A technology for object storage and implementation methods, applied in the protection of internal/peripheral computer components, etc., can solve the problems of data security not being effectively guaranteed, losing etag-related functions, and etag time-consuming, etc., to improve data security, ensure Compatibility, the effect of increasing data security

Active Publication Date: 2020-06-12
SHANGHAI DATATOM INFORMATION TECH CO LTD
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In some cases, it is also necessary to modify part of the data. When modifying a large overall uploaded file, the etag (entity tag) is inconsistent with the data itself due to the modification of the data. At the same time, due to the large amount of data, the etag comparison of the file is recalculated. time consuming and can affect business
Therefore, the overall uploaded file after we modify (modified) will lose the etag-related functions, and data security cannot be effectively guaranteed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Implementation method for storing, integrally uploading and segmentally checking based on Ceph object
  • Implementation method for storing, integrally uploading and segmentally checking based on Ceph object

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below in conjunction with accompanying drawing.

[0028] see figure 1 and figure 2 , the implementation method of the present invention based on Ceph object storage whole upload segmentation verification, data interaction is performed between the client and the object storage system through the RESTful API interface. Include the following steps:

[0029] Step 1. The client sends an overall upload request to the object storage system. Except for the header object, the background of the object storage system divides rados objects according to the size of the stripes. The object storage system stores user files into each divided rados according to the processing logic object, calculate the md5 value of the data of each rados object, and store it in the extended attribute RGW_ATTR_MD5 of each rados object, and calculate the etag value of the user file according to the md5 value of each rados object in the extended attribute...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an implementation method for storing, integrally uploading and segmentally checking based on a Ceph object. The method comprises the steps that a client sends an overall uploading request, the object storage system stores the user file into each divided rados object; calculating the md5 value of the data of each rados object, storing the md5 value into the extended attribute RGW _ ATTR _ MD5 of each rados object, and calculating the etag value of the user file according to the md5 value of each rados object; and the client sends a modality request, the object storage system finds the rados objects needing to be modified according to the request parameters of the modality request, recalculates the md5 value, and calculates the etag value of the user file according tothe md5 value of each rados object. After partial data of a certain file is modify, the whole file tag can be quickly and efficiently updated, so that related functions of the file tag continue to take effect, the safety of the data is ensured, and the service efficiency is improved.

Description

technical field [0001] The present invention relates to the field of object storage systems, in particular to a method for realizing whole upload segmentation verification of object storage based on Ceph (a unified and distributed file system designed for excellent performance, reliability and scalability). Background technique [0002] Object storage combines NAS (network attached storage) and SAN (advantages of storage area network), and has the advantages of high-speed direct access of SAN and data sharing of NAS, and provides high reliability, cross-platform and secure data sharing. storage architecture. Compared with traditional file system storage, object storage abandons the complex semantics and directory design of the file system, and stores data in a flat Key-Value (key-value pair) manner, which greatly simplifies the complexity of metadata management and hardly There are technical limitations on storage capacity. With the development of new technologies such as ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F21/78
CPCG06F21/78
Inventor 张波谢赟韩欣孙卓峰
Owner SHANGHAI DATATOM INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap