Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Load balancing processing method and equipment

A processing method and load balancing technology, applied in the direction of network traffic/resource management, digital transmission system, electrical components, etc., can solve problems such as increasing message communication network overhead

Active Publication Date: 2015-09-23
CHINA MOBILE COMM GRP CO LTD
View PDF4 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] In view of this, the embodiment of the present invention provides a load balancing processing method and equipment, which are used to solve the time-consuming problem of using the load balancing strategy in Giraph in the BSP model at present, and the problem of using Hadoop in the BSP model The speculative execution strategy has the problem of increasing the network overhead of message communication

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Load balancing processing method and equipment
  • Load balancing processing method and equipment
  • Load balancing processing method and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] Such as figure 1 As shown, it is a schematic flowchart of a load balancing method provided by Embodiment 1 of the present invention. The method can be described as follows.

[0052] Step 101: Obtain the running time information of each task in an iteration period of a worker node.

[0053] In step 101, when the task of the working node starts to run, the running time information of each task in the current iteration cycle, the data volume information of the local task, and the messages for the next iteration cycle generated in this iteration cycle The estimated amount information obtained by pre-estimating the amount (it can also be represented by the time information of the read / write checkpoint).

[0054] It should be noted that the data volume information of the local tasks obtained through statistics and the estimated volume information obtained by pre-estimating the amount of messages generated in this iteration cycle for the next iteration cycle will involve the...

Embodiment 2

[0091] Such as image 3 As shown, it is a schematic structural diagram of a load balancing processing device provided by Embodiment 2 of the present invention. Embodiment 2 of the present invention is an invention under the same inventive concept as Embodiment 1 of the present invention. The device includes: an acquisition module 11 , determination module 12 and migration module 13, wherein:

[0092] An acquisition module 11, configured to acquire the running time information of each task in an iteration cycle of a working node;

[0093] A determining module 12, configured to determine the task to be migrated of the working node within the iteration period according to the acquired running time information of each task and the analysis strategy of the task to be migrated;

[0094] The migration module 13 is configured to migrate the task to be migrated to a working node other than the working node whose task processing capacity is less than a set threshold when it is determin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a load balancing processing method and equipment. The method comprises the following steps of acquiring operation time information of each task in one iteration period of one working node; according to the obtained operation time information of each task and an analysis strategy of a task to be migrated, determining a task to be migrated of the working node in the iteration period; when times of the task to be migrated exceed a setting value, migrating the task to be migrated to a working node whose task processing quantity is less than a setting threshold except for the working node. By using a task mode, a task migration in multiple iterative operations of working points is executed so that task load balancing between the working points is effectively realized; a problem that time consumption exists in a load balancing strategy in Giraph is avoided and simultaneously a problem that message communication network cost is increased in a speculative execution strategy in Hadoop is avoided; task migration efficiency in a BSP model is increased and a load balance property of the system is improved.

Description

technical field [0001] The present invention relates to the technical field of wireless communication, in particular to a load balancing processing method and equipment. Background technique [0002] The BSP (Bulk-Synchronous Parallel) model is a model based on iterative processing of big data, which is different from the Map Reduce model. In the BSP model, data processing is divided into several tasks, and each task goes through the same iterative phase: synchronization phase, calculation phase and message communication phase. [0003] For the multitasks executed in parallel in the BSP model, dynamic load balancing is a key point in parallel computing. However, the BSP model inevitably has unbalanced load in the high-frequency iteration scenario in the parallel environment. [0004] At present, two solutions are proposed for the problem of load imbalance: one is the load balancing strategy in Giraph; the other is the speculative execution strategy in Hadoop. [0005] Amo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L12/803H04W28/08
Inventor 邓超郭磊涛钱岭孙少陵
Owner CHINA MOBILE COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com