Data storage system and method based on olap/oltp hybrid application

A data storage system and hybrid application technology, which is applied in transmission systems, electronic digital data processing, digital data information retrieval, etc., can solve the problems of database system throughput, performance bottlenecks, and insufficient computing resources, etc., to improve data processing ability, rapid horizontal expansion, and the effect of reducing technical bottlenecks

Active Publication Date: 2021-07-16
深圳纳实大数据技术有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] The Mongos DB database is an open source database based on distributed file storage. It is widely used because of distributed data storage. However, the Mongos DB database in the prior art is too complex, which leads to the following problems: first, insufficient storage resources, It makes it difficult to upgrade the system where the Mongos DB database is located; second, insufficient computing resources cause performance bottlenecks; third, the throughput of the Mongos DB database system cannot keep up; fourth, it cannot be deployed quickly, and the difficulty of later operation and maintenance is very high. Big

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage system and method based on olap/oltp hybrid application
  • Data storage system and method based on olap/oltp hybrid application
  • Data storage system and method based on olap/oltp hybrid application

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The preferred embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0046] Such as figure 1 As shown, this example provides a data storage system based on OLAP / OLTP hybrid applications, including:

[0047] The load balancing server judges the status of the routing server by requesting access, and counts the request to allocate the available routing server to achieve load balancing;

[0048] The routing server communicates with the load balancing server to implement the data writing process and the data query process;

[0049] Configure the server to communicate with the routing server for storing metadata information and indexes of data, and record the storage location of each data;

[0050] The sharding server communicates with the routing server to implement asynchronous backup and separate reading and writing.

[0051] The load balancing server described in this example is a microservice bas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a data storage system and method based on OLAP / OLTP hybrid applications, the data storage system includes: a load balancing server, judging the state of the routing server by requesting access, and statistically requesting and assigning available routing servers to achieve load balancing; The routing server communicates with the load balancing server to implement the data writing process and the data query process; the configuration server communicates with the routing server to store metadata information and indexes of data, and record each data storage location; the fragmentation server communicates with the routing server to implement asynchronous backup and separate reading and writing. The invention realizes the secondary development based on the open source database of the Mongo DB database, and further realizes the distributed data storage system supporting two business types of online transaction processing (OLTP) and online analytical processing (OLAP) at the same time, and can quickly expand horizontally.

Description

technical field [0001] The present invention relates to a data storage system, in particular to a data storage system based on OLAP / OLTP hybrid applications, and to a data storage method applied to the data storage system based on OLAP / OLTP hybrid applications. Background technique [0002] The Mongos DB database is an open source database based on distributed file storage. It is widely used because of distributed data storage. However, the Mongos DB database in the prior art is too complex, which leads to the following problems: first, insufficient storage resources, It makes it difficult to upgrade the system where the Mongos DB database is located; second, insufficient computing resources cause performance bottlenecks; third, the throughput of the Mongos DB database system cannot keep up; fourth, it cannot be deployed quickly, and the difficulty of later operation and maintenance is very high. Big. Contents of the invention [0003] The technical problem to be solved b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08G06F16/182G06F9/50
CPCH04L67/10H04L67/1031H04L67/1095H04L67/1097H04L67/30G06F9/5083H04L67/1001H04L67/54H04L67/63
Inventor 吕骏
Owner 深圳纳实大数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products