MapReduce-based K-means clustering algorithm FPGA acceleration system

Abstract

The invention provides a MapReduce-based K-means clustering algorithm FPGA acceleration system. The acceleration system mainly comprises a Map task data receiving and transmitting subsystem, a Map task acceleration subsystem, a Reduce task data receiving and transmitting subsystem and a Reduce task acceleration subsystem, wherein the Map task data receiving and transmitting subsystem transmits corresponding data from a PCIe terminal to the Map task acceleration subsystem and transmits a final calculation result of the Map task acceleration subsystem back to the PCIe terminal; and the Reduce task data receiving and transmitting subsystem transmits corresponding data from the PCIe terminal to the Reduce task acceleration subsystem and transmits a final calculation result of the Reduce task acceleration subsystem back to the PCIe terminal. According to the acceleration system, a time consumption calculation process needing to be performed is separated out of an upper layer, a special hardware system is adopted to perform corresponding calculation, and assembly line design and a concurrent processing method are adopted for all modules in the system, so that operation processing speed is greatly increased.

Description

technical field [0001] The invention belongs to a complex algorithm hardware acceleration system, in particular to a MapReduce-based K-means clustering algorithm FPGA acceleration system under a large amount of data. Background technique [0002] With the advent of the era of big data, the application of big data has increasingly demonstrated its advantages, and the fields it occupies are becoming larger and larger; however, the era of big data still faces some problems that need to be solved urgently, such as large data volume and value density. Low processing speed, high timing requirements, etc., so machine learning and data mining technologies are increasingly gaining attention in the computing field. [0003] Cluster analysis is an important content in data mining, and it is playing an increasingly important role in the fields of industry, commerce and scientific research. The K-means algorithm belongs to a basic division method in cluster analysis, and the error sum o...

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a K-means clustering algorithm FPGA acceleration system based on MapReduce under a large amount of data. Expensive bugs for faster computational processing

Images