A method and device for optimizing storage of big data

A big data storage and data technology, which is applied in the field of big data storage optimization methods and devices, can solve the problems of inability to deal with high scalability and massive demand of big data, and achieve the effect of convenient operation

Active Publication Date: 2017-11-24
上海威固信息技术股份有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Traditional data analysis and processing technologies cannot handle the high scalability and massive demands of big data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for optimizing storage of big data
  • A method and device for optimizing storage of big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the present invention. Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with aspects of the invention as recited in the appended claims.

[0031] see figure 1 , a kind of big data storage optimization method that the present invention proposes, comprises:

[0032] Step S100, preprocessing the data to be stored; packaging the data to be stored into object data, addi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention proposes a method and device for optimizing large data storage, the method comprising: step S100, preprocessing the data to be stored; encapsulating the data to be stored into object data, and object data is added to the object data attribute information, the attribute information includes the data type of the object data; step S200, receiving the object data, and determining the data type of the object data according to the attribute information of the object data; step S300, storing the object data in different storage locations according to the data type of the object data in the storage unit. The present invention uses different storage units to respectively store data of different data types, so that the storage advantages of different storage units can be brought into play.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a large data storage optimization method and device. Background technique [0002] With the rapid development of applications such as the mobile Internet and the Internet of Things, the amount of global data has exploded. The rapid growth of data volume indicates that we have entered the era of big data. [0003] Data can be divided into structured data, semi-structured data and unstructured data by type. Structured data refers to a data type that can be expressed in a two-dimensional structure and can be stored in a relational database; semi-structured data refers to A data type with a certain structure but not clear semantics, such as emails, HTML web pages, etc. Some of their fields are definite, and some of them are not. Unstructured data refers to a data type that cannot be represented by a two-dimensional structure. Various data types, mainly including office documents, texts,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 马泳宇
Owner 上海威固信息技术股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap