Big data platform system and running method therefor

A technology of a big data platform and operation method, applied in cloud computing and big data fields, to achieve the effect of complete transfer, multi-table association operation, and enhanced flexibility

Inactive Publication Date: 2016-01-27
CHINA UNITED NETWORK COMM GRP CO LTD
View PDF6 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention aims at the problem of strong dependence relationship between application and data in the existing big data platform technology, realizes the problem of migration from application to data and multi-table associated operation of data, and provides a big data platform system that can realize the separation of computing type application and data and how it works

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data platform system and running method therefor
  • Big data platform system and running method therefor
  • Big data platform system and running method therefor

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] The present embodiment provides a method for operating a big data platform system, which includes:

[0031] S101. Virtually integrate hard disks of multiple physical machines into one virtual hard disk.

[0032] S102. Divide the virtual hard disk into multiple storage volumes.

[0033] S103. Receive a request and create a virtual machine for running the request, where the storage volume is mounted for the virtual machine according to the requirements of the request.

[0034] In the operation method of the big data platform system in this embodiment, the hard disks of multiple physical machines are first integrated into one virtual hard disk, and then each storage volume of the virtual hard disk is allocated to each virtual machine for use; thus, each physical machine ( The hard disk of the node) has become a part of the shared storage resource, separated from the virtual machine, which is convenient for unified utilization management, and then it also realizes the deco...

Embodiment 2

[0036] Such as Figure 2 to Figure 4 As shown, the present embodiment provides a method for operating a big data platform system, which includes the following steps:

[0037] S201. Virtually integrate hard disks of multiple physical machines into one virtual hard disk.

[0038] That is to say, the big data platform system includes multiple physical machines (physical servers), and each physical machine has its own hard disk, CPU, memory and other hardware resources (node ​​resources). It integrates the hard disks of all physical machines into a large virtual hard disk for overall management.

[0039] For example, the Cinder module of the OpenStack cloud management platform developed by NASA can be used to virtually integrate the hard disks in multiple X86 servers into one virtual hard disk in the form of SDS (software-defined storage), so that all storage resources become shared. The virtual storage volume is incorporated into the container (resource pool) of the Cinder-Volu...

Embodiment 3

[0062] Such as Figure 4 As shown, the present embodiment provides a big data platform system, which includes:

[0063] Multiple physical machines with hard drives;

[0064] The virtual integration unit is used to virtually integrate the hard disks of multiple physical machines into one virtual hard disk;

[0065] A split unit, used to split the virtual hard disk into multiple storage volumes;

[0066] The virtual machine unit is configured to receive a request and create a virtual machine for running the request, where storage volumes are mounted for the virtual machine according to the requirements of the request.

[0067] That is to say, the big data platform system provided by this embodiment has the required units that operate according to the above method.

[0068] In the big data platform system of this embodiment, the hard disks of multiple physical machines are first integrated into one virtual hard disk, and then each storage volume of the virtual hard disk is all...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a big data platform system capable of realizing separation of computation type applications and data, and a running method therefor, and belongs to the technical field of cloud computing and big data. The system can realize decoupling and separation of the applications and the data, and solve the problems of difficulty in migration from applications to data and multi-table associative computing of the data due to a strong dependence relationship between the applications and the data in an existing big data platform technology. The running method for the big data platform system comprises: virtually combining hard disks of a plurality of physical machines into a virtual hard disk; dividing the virtual hard disk into a plurality of storage volumes; and receiving a request and creating a virtual machine (which can be just all of a CPU and a memory of a complete machine, but still is the virtual machine) used for running the request, wherein the storage volumes are mounted for the virtual machine according to the demands of the request.

Description

technical field [0001] The invention belongs to the technical fields of cloud computing and big data, and in particular relates to a big data platform system and an operation method thereof, which can realize the separation of computing-type applications and data. Background technique [0002] With the maturity of cloud computing and big data technology, the traditional computing application model based on local computers is also developing towards clustering and cloud-based trends, becoming the main direction of IT technology development, especially distributed clusters. The big data platform is the main representative carried on the IAAS (device as a service) cloud. [0003] figure 1 As shown, the current big data platform mainly applies for resources from IAAS in the form of physical machines. Coupled node resources; for web applications or functional applications, it is to apply for resources from IAAS in the form of virtual machines, which specifically includes dividi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
Inventor 魏进武霍玉嵩张呈宇李卫张基恒黄存兰胡舜耕
Owner CHINA UNITED NETWORK COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap