Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Big data exchange platform network architecture

An exchange platform and network architecture technology, applied in the field of big data exchange platform network architecture, can solve the problems of low value density, single point of failure, limitations, etc., to reduce demand, reduce network energy consumption, increase network capacity and bandwidth. Effect

Inactive Publication Date: 2016-11-23
王楚
View PDF0 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The third is low value density (Value)
The traditional network architecture composed of electrical packet switches can complete the exchange of large data when the flow is large, but its network capacity and network bandwidth (mainly equal bandwidth) are limited by the topology, and it is also prone to single point failure

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data exchange platform network architecture
  • Big data exchange platform network architecture
  • Big data exchange platform network architecture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] A network architecture of a big data switching platform, which adds an optical switching network to the existing structure, coordinates communication between the optical switching network and the electrical switching network, makes full use of the advantages of high bandwidth and high transmission efficiency of the optical network, and increases the network capacity and bandwidth.

[0026] Please refer to figure 1 As shown, a network architecture of a big data exchange platform mainly includes two Hadoop clusters for big data exchange and an electrical packet switch 50 and a waveguide grating router 60 for realizing big data exchange, forwarding and switching functions. The waveguide grating router 60 is preferably AWRG (arrayed waveguide grating router, arrayed waveguide grating router), wherein two Hadoop clusters are recorded as Hadoop cluster 10A and Hadoop cluster 20A respectively, and each Hadoop cluster all comprises a plurality of node servers realizing differen...

Embodiment 2

[0030] Embodiment 2 adds two Hadoop clusters on the basis of Embodiment 1, please refer to figure 2 As shown, the two Hadoop clusters that increase are recorded as Hadoop cluster 30A and Hadoop cluster 40A respectively, wherein, Hadoop cluster 30A includes node server 31, node server 32 and top-of-rack switch 33, and Hadoop cluster 40A includes node server 41, node server 42 and top-of-rack switch 43. It can realize data forwarding and exchange between any two Hadoop clusters in four Hadoop clusters at the same time, and its principle is the same as that of Embodiment 1. Of course, more Hadoop clusters can also be added to communicate with each other.

Embodiment 3

[0032] Embodiment 2 adds a security protection mechanism to the data forwarding and exchange of each Hadoop cluster on the basis of Embodiment 1. Please refer to image 3 As shown, Hadoop cluster 10B has increased hardware firewall 14 on the basis of Hadoop cluster 10A, and Hadoop cluster 20A has increased hardware firewall 24 on the basis of Hadoop cluster 20A, and top-of-rack switch 13 and top-of-rack switch 23 pass electrical packet switch 50 or During the communication process of the waveguide grating router 60 , the security of data transmission is realized through its own hardware firewall 14 and hardware firewall 24 . Both hardware firewall 14 and hardware firewall 24 can choose Cisco ASA5585-X firewall to fully meet security requirements and high performance required for large data transmission. If more Hadoop clusters are added, each Hadoop cluster can also add a hardware firewall.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a big data exchange platform network architecture, and relate to the technical field of big data exchange. The big data exchange platform network architecture comprises at least two Hadoop clusters and an electric packet-switched exchange and a waveguide grating router which are connected with the Hadoop clusters respectively, each Hadoop cluster comprises top-of-rack switches and at least one node server, and the node servers are connected with the electric packet-switched exchange and the waveguide grating router through the corresponding top-of-rack switches respectively. According to the big data exchange platform network architecture, by means of cooperative communication of the electric packet-switched exchange and the waveguide grating router, the advantages of being high in bandwidth and transmission efficiency and the like for an optical network are fully utilized, the network capacity and bandwidth are increased, and the single point failure problem is avoided.

Description

technical field [0001] The invention relates to big data exchange technology, in particular to a network architecture of a big data exchange platform. Background technique [0002] In recent years, big data has swept the world like a wave, profoundly changing the way people live, work and think. The industry usually uses 4 Vs to summarize the characteristics of big data. One is the huge volume of data (Volume). From TB level to PB level. The second is the variety of data types. This type of variety also allows data to be divided into structured and unstructured data. Compared with the text-based structured data that was easy to store in the past, there are more and more unstructured data, including web logs, audio, video, pictures, and geographic location information. higher requirements. The third is low value density (Value). The level of value density is inversely proportional to the size of the total amount of data. Taking video as an example, a 1-hour video may ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04B10/25H04L12/933H04L29/06H04L29/08H04Q11/00
CPCH04B10/25891H04L49/1507H04L63/02H04L67/10H04Q11/0005H04Q11/0062H04Q2011/0016H04Q2011/0022H04Q2011/0052
Inventor 王楚
Owner 王楚
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com