Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Monitoring big data storage platform network architecture

A technology of big data storage and network architecture, which is applied in the field of monitoring the network architecture of big data storage platforms, can solve problems such as low value density, network capacity and network bandwidth limitations, and single point of failure, so as to reduce demand, increase network capacity and The effect of reducing bandwidth and reducing network energy consumption

Inactive Publication Date: 2016-12-14
王楚
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The third is low value density (Value)
Although this kind of network architecture can successfully complete the storage of big data when the flow is large, its network capacity and network bandwidth (mainly equal bandwidth) are limited by the topology structure, and it is also prone to single-point failure.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Monitoring big data storage platform network architecture
  • Monitoring big data storage platform network architecture
  • Monitoring big data storage platform network architecture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0024] A monitoring big data storage platform network architecture, its external storage adds an optical switching network to the existing structure, the optical switching network and the electrical switching network are used for collaborative communication, making full use of the advantages of high bandwidth and high transmission efficiency of the optical network, increasing network capacity and bandwidth.

[0025] Please refer to figure 1 As shown, a monitoring big data storage platform network architecture, which includes a big data storage unit 10 and a monitoring unit 20, the monitoring unit 20 transmits its monitoring data to the big data storage unit 10 through a data transmission unit 30A, and completes the monitoring data external storage.

[0026] The monitoring unit 20 has a storage device for realizing the internal storage of monitoring data. Specifically, the monitoring unit 20 includes a second top-of-rack switch 21, a second hardware firewall 22, one or more da...

Embodiment 2

[0031] Embodiment 2 is an improvement on the basis of Embodiment 1, which can realize the external storage of data of multiple monitoring units 20 at the same time, please refer to figure 2 As shown, here two monitoring units 20 are taken as an example, the internal storage of each monitoring unit 20 is stored through its own second database cluster 25, and the external storage is completed through the data transmission unit 30A.

Embodiment 3

[0033] The third embodiment increases the redundancy of the Ethernet switch and the WG router on the basis of the first embodiment, please refer to image 3 As shown, there are two Ethernet switches and two WG routers, forming a data transmission unit 30B. Two Ethernet switches 31 are respectively used as main and standby Ethernet switches, and two waveguide grating routers 32 are respectively used as main and standby grating routers. The two Ethernet switches 31 are connected by optical fiber cables 33. When the main Ethernet switch fails In the case of starting the standby Ethernet switch to complete the data transmission. Similarly, the two WG grating routers 32 are connected through a wavelength division multiplexing optical fiber link 34, and in the event of failure of the main WG grating router, the backup WG grating router is activated to complete data transmission. Of course, in order to further prevent network congestion in the process of data transmission, multiple ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a monitoring big data storage platform network architecture, relating to the technical field of big data storage. The monitoring big data storage platform network architecture comprises a big data storage unit and at least one monitoring unit; each monitoring unit transmits the monitoring data to the big data storage unit via a data transfer unit; the big data storage unit comprises a first hardware firewall, a first top-of-rack switch, a first database cluster and at least one first node computer; the monitoring unit comprises a second top-of-rack switch, a second hardware firewall, at least one data collection unit, an electrical switch, at least one second node computer and a second database cluster; and the data transfer unit comprises an Ethernet switch and a waveguide grating router. According to the monitoring big data storage platform network architecture disclosed by the invention, external storage of collected data of the monitoring unit is realized via cooperative communication between the Ethernet switch and the waveguide grating router, the advantages of high bandwidth, high transmission efficiency and the like of an optical network are fully utilized, and the network capacity and bandwidth are increased.

Description

technical field [0001] The invention relates to a large data storage technology, in particular to a monitoring network architecture of a large data storage platform. Background technique [0002] In recent years, big data has swept the world like a wave, profoundly changing the way people live, work and think. The industry usually uses 4 Vs to summarize the characteristics of big data. One is the huge volume of data (Volume). From TB level to PB level. The second is the variety of data types. This type of variety also allows data to be divided into structured and unstructured data. Compared with the text-based structured data that was easy to store in the past, there are more and more unstructured data, including web logs, audio, video, pictures, and geographic location information. higher requirements. The third is low value density (Value). The level of value density is inversely proportional to the size of the total amount of data. Taking video as an example, a 1-...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08H04L1/22
CPCH04L67/1097H04L1/22
Inventor 王楚
Owner 王楚
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products