Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Coding distributed computing system

A distributed computing and coding technology, applied in the field of distributed systems, can solve the problem of numerical instability in the polynomial interpolation decoding process, and achieve the effect of improving the function of backward nodes, lowering the condition number, and improving the accuracy

Pending Publication Date: 2021-12-24
SHENZHEN UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The invention aims to solve the problem of numerical instability in the polynomial interpolation decoding process when multiplying matrices

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Coding distributed computing system
  • Coding distributed computing system
  • Coding distributed computing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] Aiming at the problems in the background technology, the present invention studies the coding scheme with numerical stability under the CDC framework, proposes a new kind of Newton-like polynomial code, in the two-dimensional matrix multiplication, two large matrices are respectively carried out (A) Horizontal and (B) vertical division, through the encoding formula based on the joint design of Newton polynomials, the two matrices are encoded separately and then multiplied, and a brand new coefficient matrix is ​​obtained after interpolation (for example, when the order is 8 , the data of the Vandermonde matrix is ​​x 8 , the data of the Newton-like polynomial matrix is ​​(x-x 0 ) 2 (x-x 1 ) 2 (x-x 2 )(x-x 3 )(x-x 4 )(x-x 5 )), the new coefficient matrix constructed by the present invention still satisfies the (n, k) combination characteristic. After the Newton-like polynomial matrix is ​​interpolated, it is a stepped matrix. It can be seen from the structure tha...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a coding distributed computing system. Newton-like polynomial codes are applied to the coding distributed computing system, in a computer cluster, one computer serves as a main node, other computers serve as working nodes, matrix A and matrix B multiplication is calculated in a distributed manner in the computer cluster, and a matrix A and a matrix B are divided into K blocks by the main node; a coding strategy is executed to respectively code the matrix A and the matrix B, and the matrix A and the matrix B can be decoded after the main node receives the calculation results of the K working nodes with the fastest calculation speed. The invention has the beneficial effects that the condition number is smaller, the problem that Vandermonde matrix decoding numerical values are unstable in matrix multiplication is effectively solved, the decoding accuracy is improved, and the Vandermonde matrix decoding method has the functions of fault tolerance and backward node improvement.

Description

technical field [0001] The invention relates to the technical field of distributed systems, in particular to a coding distributed computing system. Background technique [0002] Distributed computing is at the heart of modern machine learning and data analytics, where millions of very high-dimensional data points are being processed. The problem of straggling nodes naturally exists in a distributed system. Laggard nodes refer to those working nodes that return calculation results much slower than average because of their poor computing power or communication links. Much research in the field of "encoded computing" has looked at incorporating redundancy into distributed computing, based on encoding-inspired strategies to address these challenges. The core idea of ​​a distributed system is to obtain (n,k) combination properties (Combination Property, CP) through encoding, that is, to encode k original independent tasks into n (n≥k), among the n task results, Any k can restor...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/16
CPCG06F17/16
Inventor 童艳荔代明军王兰
Owner SHENZHEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com