Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A data flow compilation optimization method for multi-core clusters

An optimization method and a technology of data flow, applied in the field of computer compilation, can solve the optimization problem of processing core storage allocation and communication optimization, the compilation optimization method does not optimize the architecture characteristics of the multi-core cluster system, and does not make full use of system hardware resources Program execution efficiency and other issues to achieve the effect of improving locality and cache utilization, reducing overhead, and low communication overhead

Active Publication Date: 2017-09-15
HUAZHONG UNIV OF SCI & TECH
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are the following defects: (1) The calculation and communication scheduled to the processing core are separated, and an independent communication time is allocated for it in the pipeline, thus increasing the communication overhead; (2) The processing is not considered The underlying storage allocation optimization problem and communication optimization problem of the core; (3) The compilation optimization method is not optimized for the underlying architecture characteristics of the multi-core cluster system
The existing stream compilation optimization method does not take into account the underlying architecture, and does not make full use of system hardware resources such as storage resources to improve program execution efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data flow compilation optimization method for multi-core clusters
  • A data flow compilation optimization method for multi-core clusters
  • A data flow compilation optimization method for multi-core clusters

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0026] like figure 1 Shown is the structural frame diagram of this embodiment in the flow compilation system. After the data flow program is parsed by the front end of the data flow compiler, an intermediate representation - Synchronous Data Flow (SDF) will be generated, and then the task will be processed in sequence. Division and scheduling, hierarchical pipeline scheduling, cache optimizatio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data flow compiling optimization method for a multi-core cluster system, comprising: determining calculation tasks and processing core mapping task division and scheduling steps; constructing pipelines between cluster nodes and cluster node cores according to the task division and scheduling results The hierarchical pipeline scheduling step of the scheduling table; the caching optimization step based on the cache is performed according to the structural characteristics of the multi-core processor, the communication situation between the cluster nodes and the execution situation of the data flow program on the multi-core processor. The method of the present invention combines the optimization technology related to the data flow program and the system structure, fully exerts the high load balance and the high parallelism of the synchronous and asynchronous mixed pipeline code on the multi-core cluster, and aims at the cache and communication mode on the multi-core cluster, The cache access and communication transmission of the program are optimized, which further improves the execution performance of the program and has a shorter execution time.

Description

technical field [0001] The invention belongs to the technical field of computer compilation, and more specifically, relates to a multi-core cluster-oriented data flow compilation optimization method. Background technique [0002] With the development of semiconductor technology, multi-core processors have been verified as a viable platform for exploiting parallelism. Multi-core cluster parallel system has become an important parallel computing platform design due to its powerful parallel computing capability and good scalability. The multi-core cluster system provides powerful computing and processing capabilities, but also puts more burdens on compilers and programmers to effectively develop coarse-grained parallelism between cores. Dataflow programming provides a viable approach to exploit the parallelism of multicore architectures. In this model, each node represents a computing task, and each edge represents the data flow between computing tasks. Each computing task i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/45G06F9/50
Inventor 于俊清张维维唐九飞何云峰管涛
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products