Large-scale edge cluster management method and system

A management method and large-scale technology, applied in transmission systems, electrical components, etc., can solve problems such as data disorder, inability to consume messages smoothly, and difficulty in ensuring message processing timing, and achieve the effect of smooth expansion and contraction.

Active Publication Date: 2022-06-24
杭州谐云科技有限公司
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, it is difficult to guarantee the timing of message processing during expansion and contraction, resulting in the inability to smoothly consume messages after expansion and contraction, and even lead to data confusion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-scale edge cluster management method and system
  • Large-scale edge cluster management method and system
  • Large-scale edge cluster management method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0115] Step 301 : when the cloud node starts up, a certain number of message processing modules 11 will be pulled up, and the message processing modules 11 will actively register with the message transmission module 12 , and the registration information includes the port number of its own message processing module 11 .

[0116] Step 302: After the message transmission module 12 receives the registration request, it will actively establish a gRPC connection according to the port number, and put the connection into the connection pool for maintenance. Each connection contains a specific number of transmission streams (Streams). The consumer side maintains two pipelines: the main pipeline and the secondary pipeline; maintains a gray and white list. The whitelist represents the list of nodes that are processed by the current pipeline, and the messages of the nodes will be pushed directly into the main pipeline. The graylist represents the list of nodes waiting to be added to the wh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a large-scale edge cluster management method and system, and belongs to the technical field of electric digital data processing, the management method comprises a message consumption method: an edge node is mapped to a first transport stream, and the edge node consumes a first message through a first main pipeline of the first transport stream; mapping the edge node to a second transport stream; a second message of the edge node is transmitted to a second auxiliary pipeline of a second transport stream; and if the first message in the first transport stream is consumed completely, moving the second message to a second main pipeline of the second transport stream for consumption. The messages are consumed through the main pipeline, the messages are cached through the auxiliary pipelines, and after the first message on the first transport stream is consumed, the second message of the second auxiliary pipeline is moved to the second main pipeline to be consumed, so that the messages sent by the edge node have time sequence, and smooth capacity expansion and contraction of the transport stream are ensured.

Description

technical field [0001] The invention relates to the technical field of electrical digital data processing, in particular to a large-scale edge cluster management method and system. Background technique [0002] The edge cluster management solution for edge computing scenarios supports unified resource scheduling and application lifecycle management in edge computing scenarios. The edge cluster includes the cloud and the edge. The edge terminals are usually deployed in various places and distributed in different cities. The edge terminals send the collected data or messages to the cloud, and the cloud centrally manages and consumes the data or messages. [0003] The edge cluster usually adopts the expansion and shrinkage scheme, which reduces the capacity during idle time to save resources; expands the capacity during busy hours to improve the throughput of messages; while the frequency of expansion and contraction of large-scale edge clusters is higher. However, when expan...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L41/0896H04L67/10H04L67/568
CPCH04L41/0896H04L67/10
Inventor 林科高家祺孙振林王翱宇
Owner 杭州谐云科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap