Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

MPP architecture based distributed relational database

A database and distributed technology, applied in the database field, can solve problems such as lack of parallel writing capability, inability to meet the needs of massive information collection, insufficient parallel writing capability of a single process, etc.

Inactive Publication Date: 2015-11-11
STATE GRID CORP OF CHINA +1
View PDF3 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, a large number of business systems are developed based on SQL and cannot be smoothly migrated to the Hadoop platform.
Second, the single-process parallel writing capability is insufficient
Neither HDFS nor HBase has a single process capable of parallel writing, which cannot meet the needs of massive information collection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • MPP architecture based distributed relational database
  • MPP architecture based distributed relational database
  • MPP architecture based distributed relational database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The present invention will be described in further detail below in conjunction with the accompanying drawings. It should be understood that the embodiments described here are only used to explain the present invention, but not to limit the present invention.

[0019] PowerDB is a relational database system. It is developed based on the open source database postgreSQL. PostgreSQL is an open source database system that supports concurrent operations and is well compatible with ORACLE. By adopting the MVCC (multi-version concurrency control) mechanism, the ability to write data is improved. Through Divide the data table space into blocks to support stand-alone concurrency. PowerDB relational database maintains the postgreSQL kernel unchanged, develops external tools to meet the needs of business system development and DBA work, and supports SQL2008 standards.

[0020] (1) Design of autonomous and controllable distributed relational database architecture.

[0021] The syst...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provided an MPP architecture based distributed relational database and relates to the fields of databases, big data and distributed computing. The database comprises four modules: a global transaction manager in charge of global transaction processing; a load balancing system in charge of load balancing management of a cluster; a cluster coordination manager used for coordinating work among data nodes; and the data nodes of a relational database based on PowerDB deployment. According to the MPP architecture based distributed relational database provided by the present invention, aimed at the PowerDB relational database, a distributed environmental cluster is established; by adopting an MPP architecture technology and Shared Nothing among the nodes, no influence on cluster work is ensured when a single point has a fault; and the cluster can extend laterally, PB level data storage is implemented, and massive parallel data writing is supported.

Description

technical field [0001] The invention relates to the field of databases, big data, and distributed computing, provides a massive data storage solution based on a relational database for big data processing, and supports two application scenarios of OLTP and OLAP. Background technique [0002] Information technology has developed rapidly in recent years, and the amount of information in enterprises and society has grown geometrically, which poses a huge challenge to the storage and processing of big data. How to build big data clusters and realize the storage of massive data is an important issue in the field of big data. the primary problem faced. [0003] Based on the hadoop open source big data architecture, it is a widely used solution at present. The distributed file system provided by hadoop can solve the problem of PB-level data storage. At the same time, through the products under the hadoop ecosystem, columnar storage and data warehouse can be realized. Level data ma...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/25G06F16/284
Inventor 张宇杨利兵缪燕李海吕志来张学深
Owner STATE GRID CORP OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products