Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed computing system and distributed computing method

A technology for distributed computing and computing results, applied in the distributed field, can solve problems such as increasing the execution time of computing tasks, wasting server resources, and not being able to use idle resources in a timely manner, so as to reduce execution time, improve utilization efficiency, and reduce The effect of global blocking

Active Publication Date: 2019-08-02
YI TAI FEI LIU INFORMATION TECH LLC
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] This kind of synchronization logic that requires all the calculation partitions in one calculation phase to be executed before the next calculation phase can be executed is equivalent to adding a global barrier to the execution process of the calculation task, which not only increases the execution time of the entire calculation task , but also make idle resources not be used in time, resulting in a waste of server resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed computing system and distributed computing method
  • Distributed computing system and distributed computing method

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0020] Example 1, a calculation task is: extracting data from the database, performing certain calculations on the extracted data, and then performing certain processing according to the calculation results to obtain the processing results. According to the characteristics and logic of the computing task, the task splitting module 1 can divide the computing task into three computing stages. Calculation phase A is: extracting data from the database; calculation phase B is: performing certain calculations on the extracted data; calculation phase C is: performing certain processing according to the calculation results. Obviously, the calculation data of calculation phase B comes from calculation phase A, and the calculation data of calculation phase C comes from calculation phase B. According to this data transmission relationship, it can be seen that there is an association relationship between the calculation phases A and B, and between the calculation phases B and C.

[0021]...

example 2

[0022] Example 2, if the calculation task is: extract the data in the first table and the second table respectively, make some kind of operation be performed on the extracted data in the first table and the second table at the same time, and obtain the operation result. According to the characteristics and logic of this computing task, the computing task can be divided into three computing stages. At this time, the calculation stage A is: extract the data in the first table; the calculation stage B is: extract the data in the second table; the calculation stage C is: make the data in the first table and the second table extracted simultaneously some kind of operation. Obviously, the calculation data of calculation phase C comes from calculation phases A and B. When establishing the association relationship between calculation phase C and calculation phase A, and the association relationship between calculation phase C and calculation phase B, the data transmission relationshi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention relates to the technical field of distributed computing, and discloses a distributed computing system and a distributed computing method. The distributed computing system comprises a task segmentation module and a resource scheduling module. The task segmentation module is used for segmenting the received computing task into a plurality of computing stages and dividing each computing stage into a plurality of computing partitions. The resource scheduling module is used for allocating resources to the computing partitions in the current computing stage to be started. The calculation stage is used for starting the calculation partition and is used for finishing calculation in any one of the currently started calculation partitions. When the next calculation stage can run at the same time as the currently started calculation stage, resources are distributed to at least one calculation partition of the next calculation stage so as to start the at least one calculation partition. Compared with the prior art, the embodiment of the invention has the advantages that the utilization rate of idle resources is improved, the execution time of the whole calculation task is shortened, and the execution efficiency is improved.

Description

technical field [0001] The embodiments of the present invention relate to the field of distributed technologies, and in particular to a distributed computing system and a distributed computing method. Background technique [0002] Distributed computing systems have been widely used in contemporary society. In the current distributed system, a computing task (Job) will be switched into several computing stages (stage), and the computing stages will be executed in order of dependencies. In a distributed system, a single computing phase is executed by assigning multiple computing partitions (partitions), and each computing partition executes the computing data (data_split) assigned to it. After a single computing partition executes its own computing data, it will wait for other computing partitions to complete their calculations. This process is generally called synchronization. After the synchronization is completed, the next computing stage will be executed until the entire c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4806G06F9/4881G06F9/5022G06F9/5027G06F9/5083G06F2209/503
Inventor 唐剑飞
Owner YI TAI FEI LIU INFORMATION TECH LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com