Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data storage method and device

A technology of data storage and storage path, which is applied in the direction of memory system, electrical digital data processing, data processing input/output process, etc. It can solve problems such as abnormal operation of Hive table, failure to find storage path, and failure to obtain the address of the master node, etc.

Active Publication Date: 2020-11-10
CHENGDU SEFON SOFTWARE CO LTD
View PDF11 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When HA is enabled in the cluster, the path of the Hive table in the cluster mapped to the HDFS data file will become "hdfs: / {cluster name} / apps / hive / warehouse / test", that is, the storage path represented by Hive It can only correspond to the cluster. At this time, when operating the Hive table through Hcatalog, the address of the current master node cannot be obtained according to the cluster name. That is to say, when HA is enabled, the correct storage path cannot be found through Hcatalog operation. This will cause an exception when operating the Hive table

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device
  • Data storage method and device
  • Data storage method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. The components of the embodiments of the application generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations.

[0062] Accordingly, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the application. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art w...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data storage method and device, and the method and device can achieve the normal data storage under the condition that a cluster is started and is high in availability. The method is applied to a management end of a cluster system, and adopts the specific scheme that firstly, a cluster identifier of a cluster and an access address of a service node in the cluster are obtained, the service node is a node which currently executes operation in the cluster, and a corresponding relation between the cluster identifier and the access address is stored in a virtual analysis server; when data is stored as needed, a cluster identifier of a to-be-accessed target cluster is acquired from a storage request under the condition that data needs to be stored, an access address corresponding to the target cluster is acquired from a virtual analysis server according to the cluster identifier of the target cluster, and finally the data according is stroed to the access address.

Description

technical field [0001] The present application relates to the technical field of data storage, and in particular, to a data storage method and device. Background technique [0002] In the HDFS (Hadoop Distributed File System, distributed file storage system) cluster, when HA is not enabled in the cluster, the path for storing data files in the Hive table is "hdfs: / / {NameNode hostname}:8020 / apps / hive / warehouse / test", that is to say, the storage path in the Hive table directly corresponds to the address of the active node. When HA is enabled in the cluster, the path of the Hive table in the cluster mapped to the HDFS data file will become "hdfs: / {cluster name} / apps / hive / warehouse / test", that is, the storage path represented by Hive It can only correspond to the cluster. At this time, when operating the Hive table through Hcatalog, the address of the current master node cannot be obtained according to the cluster name. That is to say, when HA is enabled, the correct storage p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F12/1036G06F3/06H04L29/08
CPCG06F3/0662G06F3/067G06F12/1036H04L67/1097
Inventor 张永飞贾金元杨尧王诗强
Owner CHENGDU SEFON SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com