Data management method and device

A technology of data management and big data processing, which is applied in the field of database to achieve the effect of cost saving, maintenance cost reduction and loss reduction

Pending Publication Date: 2020-12-01
GUANGZHOU HUANWANG TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] One of the purposes of the present invention is to propose a data management method and device to solve the technical problem of reasonably classifying cloud platform data for easy maintenance in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data management method and device
  • Data management method and device
  • Data management method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be described in detail below. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other implementations obtained by persons of ordinary skill in the art without making creative efforts fall within the protection scope of the present invention.

[0048] see figure 1 , a kind of data management method of the present invention, it comprises:

[0049] S1: Determine the characteristic information of the data, and the characteristic information is two types;

[0050] S2: use the feature information as a directory item of the data in the cloud, the directory item is a two-level directory, and each level of directory corresponds to a feature information; and, use the feature information as the data in the big...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data management method and device, relates to the technical field of databases, and mainly solves the technical problems of reasonable classification and convenient maintenance of data of a cloud platform. The method comprises the steps of determining feature information of data, wherein the feature information is divided into two types; taking the feature information as adirectory entry of the data in the cloud, the directory entry being a two-level directory, and each level of directory corresponding to one kind of feature information; taking the feature informationas position information of the data in a big data processing platform; and according to the directory entry and the position information, associatively storing the data in the cloud and the big dataprocessing platform. Therefore, the data can be quickly retrieved from the cloud, the cost of the server is saved, and the loss is reduced; different data are cleaned and classified, new data can be quickly accessed, long-term maintenance can be performed, data backup can be clearly performed, most requirements can be met, and the maintenance cost is greatly reduced.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a data management method and device based on cloud platform data directories and hive database technical fields. Background technique [0002] At present, the Hadoop data platform is the most popular big data processing platform in the industry. It processes hundreds or even thousands of data processing tasks every day to provide corresponding data support for business departments. Based on these tasks, complex data processing needs to be solved. How to stratify and store sources (possibly dozens or hundreds of ways); how to stratify and store basic data cleaned according to different data sources; fixed dimension data, project data, backup data, data fused with basic data, How to layer and store basic data, report data and other data. [0003] Therefore, hive is often used for processing. Hive is a Hadoop-based data warehouse tool for data extraction, transformation, and load...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215G06F16/28
CPCG06F16/215G06F16/283G06F16/285
Inventor 王鹏
Owner GUANGZHOU HUANWANG TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap