Metadata management method, device and system

A management method and metadata technology, applied in the field of big data processing, can solve the problems of inefficiency, a lot of manual input, data inconsistency, etc., and achieve the effect of improving the efficiency of data management

Inactive Publication Date: 2016-06-01
RUN TECH CO LTD BEIJING
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Repeated description of data in each business component; inconsistent description of data in each business component; each business component requires a lot of manual input when understanding and using new data; data scalability is poor, and a large number of programs need to be modified when adding new data Code can be supported; inefficient management methods such as configuration files and documentation cannot manage data in real time and accurately

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata management method, device and system
  • Metadata management method, device and system
  • Metadata management method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0024] Figure 1A It is a schematic flowchart of the metadata management method provided by Embodiment 1 of the present invention, as shown in Figure 1A As shown, it specifically includes the following steps:

[0025] Step 11a, using the metadata format to describe the business data to form metadata, and save the metadata and corresponding description information;

[0026] Wherein, the description information includes at least one of code set, element information, field set and data set.

[0027] Specifically, in order to efficiently manage the huge and complex business data in big data products, a metadata method is introduced in this embodiment to manage data better and more standardizedly. Generally speaking, metadata is the data that describes "data". Since the data that needs to be managed is very complex, using metadata to describe these data can greatly improve the efficiency of data management and utilization, and make the use of data more accurate and convenient. Da...

Embodiment 2

[0072] figure 2 A schematic structural diagram of a metadata management device provided in Embodiment 2 of the present invention, as shown in figure 2 As shown, it specifically includes: a metadata generation module 21 and a visualization management module 22;

[0073] The metadata generation module 21 is used to describe the business data in a metadata format to form metadata, and store metadata and corresponding description information;

[0074] The visualization management module 22 is configured to provide a visualization interface for managing the metadata, and manage metadata through the visualization interface and the description information.

[0075] The metadata management device described in this embodiment is used to implement the metadata management methods described in the above embodiments, and its technical principles and technical effects are similar and will not be repeated here.

[0076] Exemplarily, on the basis of the foregoing embodiments, the descript...

Embodiment 3

[0085] This embodiment also provides an Ambari-based big data management system, including the metadata management device described in the foregoing embodiments.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a metadata management method, device and system. The method includes the steps of depicting service data according to a metadata format to form metadata, storing metadata and corresponding depiction information, providing a visual interface for managing the metadata, and managing the metadata through the visual interface and the depiction information. By means of the method, device and system, the visual management of big data can be achieved, and data management efficiency is effectively improved.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of big data processing, and in particular, to a metadata management method, device and system. Background technique [0002] With the rapid development of information technology, the types of data (for example, log data, basic data, full-text data, object data, statistical data, etc.) that need to be managed in big data platform products are increasing, and the quantity is also increasing, and It becomes very complicated, making the management of these data more important and difficult. [0003] However, in the face of massive data from reality and the Internet, how to efficiently manage these data and how to make good use of these data is very urgent and important to solve these problems, otherwise a large amount of data information cannot be distributed. Useful, or waste a lot of time to manage these data. At present, big data products are facing severe challenges of various types a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/22G06F16/21
Inventor 童克冬马凤霞
Owner RUN TECH CO LTD BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products