Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Method and device for automatic installation and deployment of hadoop platform

An automatic installation and platform technology, applied in the field of big data, can solve problems such as the incompatibility of installation management platforms and the inability of automatic installation of Hadoop open source version to achieve automatic installation and deployment and mutual compatibility, shorten installation and deployment time, and improve installation. The effect of efficiency

Active Publication Date: 2015-01-28
FUJIAN NEWLAND SOFTWARE ENGINEERING CO LTD
View PDF3 Cites 57 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to provide a method and device for automatically installing and deploying a hadoop platform, so as to solve the problem that the existing Hadoop open source version cannot realize automatic installation, and although the CDH open source version and the HDP open source version can realize automatic installation, their Installation management platforms are incompatible with each other

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for automatic installation and deployment of hadoop platform
  • Method and device for automatic installation and deployment of hadoop platform
  • Method and device for automatic installation and deployment of hadoop platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0109] Step 1: Publish the hadoop version software installation package and customize the version configuration file according to the universal design principle for installation and use on all hosts 11 in the cluster:

[0110] The software installation package is stored on the yum installation server. In view of the difference of the installation package medium: because yum is installed based on the http service, the software packages of different distributions and versions are distributed according to the "Hadoop distribution / version number" when the software package is released. The directory hierarchy can be stored in the http service directory of the yum installation server, and the specific software installation package is stored in the version number directory;

[0111] The version configuration file is stored on the management platform, including the repo file specifying the source address of the yum installation and the configuration default file for each hadoop service...

Embodiment 2

[0132] Please refer to image 3 , the second embodiment of the present invention is:

[0133] A device for automatic installation and deployment of a hadoop platform, comprising a human-computer interaction interface, a cluster management module 4, a service management module, a host 11 management, monitoring management, alarm management, system management, a database processing module, a host 11 communication module, and a client 13 Software, mainframe 11 and database.

[0134] The human-computer interaction interface, that is, the human-computer interaction interface of the big data management platform, is a unified entry for users to perform various operations on the cluster and cluster hosts 11. Based on the B / S architecture, users can log in to the management platform through a browser;

[0135] The cluster management module 4 is used to be responsible for cluster creation, cluster information display, etc.;

[0136] The service management module is mainly used for serv...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and a device for automatic installation and deployment of a hadoop platform. The method comprises the following steps of storing installation packages in different release versions and in different version numbers in a yum installation server according to directory hierarchy; allowing hadoop version configuration files in different release versions and in different version numbers to form configuration list information according to the directory hierarchy, storing the configuration list information on a big data management platform, and storing repo installation source files and a hadoop service directory list under a version number directory layer; running the big data management platform and uploading the configuration list information; creating a cluster and selecting a hadoop release version and a version number; allowing hosts to join the cluster, and distributing the repo installation source files to the hosts; selecting a hadoop service; configuring necessary parameters of the hadoop service; generating installation and start task information by using the big data management platform, and sending the installation starting task information to each host by using the big data management platform; allowing each host to acquire a software installation package of the corresponding hadoop service and automatically install and start each service according to the installation and start task information. The method and the device solve the problem of differentiation and are universally applied to installation of various open source editions.

Description

technical field [0001] The invention relates to the field of big data, in particular to a method and device for automatic installation and deployment of a hadoop platform. Background technique [0002] With the rapid development of information technology, the data generated in the information age is expanding day by day. As an important technical means to solve the field of big data, Hadoop is currently widely used. The Hadoop product was originally open sourced by the Apache Foundation (hereinafter collectively referred to as the Apache open source version). This version is mainly used for verification and learning purposes, and is less used for commercial use. Currently, the main installation and deployment methods are manual installation or batch script installation. Based on the Apache open source version, a series of distributions have been developed. Currently, the two commercial versions, cloudera and hortonworks, are the most mainstream. The open source version of h...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/445
Inventor 白默王雷林克何凌毅朱坚陆向东
Owner FUJIAN NEWLAND SOFTWARE ENGINEERING CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com