DIESEL: A novel deep learning-based tool for SpMV computations and solving sparse linear equation systems

Thaha Mohammed, Aiiad Albeshri, Iyad Katib, Rashid Mehmood*

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Sparse linear algebra is central to many areas of engineering, science, and business. The community has done considerable work on proposing new methods for sparse matrix-vector multiplication (SpMV) computations and iterative sparse solvers on graphical processing units (GPUs). Due to vast variations in matrix features, no single method performs well across all sparse matrices. A few tools on automatic prediction of best-performing SpMV kernels have emerged recently and require many more efforts to fully utilize their potential. The utilization of a GPU by the existing SpMV kernels is far from its full capacity. Moreover, the development and performance analysis of SpMV techniques on GPUs have not been studied in sufficient depth. This paper proposes DIESEL, a deep learning-based tool that predicts and executes the best
performing SpMV kernel for a given matrix using a feature set carefully devised by us through rigorous empirical and mathematical instruments. The dataset comprises 1056 matrices from 26 different real-life application domains including computational fluid dynamics, materials, electromagnetics, economics, and more. We propose a range of new metrics and methods for performance analysis, visualization, and comparison of SpMV tools. DIESEL provides better performance with its accuracy 88.2%, workload accuracy 91.96%, and average relative loss 4.4%, compared to 85.9%, 85.31%, and 7.65% by the next best performing artificial intelligence (AI)-based SpMV tool. The extensive results and analyses presented in this paper provide several key insights into the performance of the SpMV tools and how these relate to the matrix datasets and the performance metrics, allowing the community to further improve and compare basic and AI-based SpMV tools in the future.
Original languageEnglish
Number of pages43
JournalJOURNAL OF SUPERCOMPUTING
Early online date30 Nov 2020
DOIs
Publication statusPublished - 30 Nov 2020
MoE publication typeA1 Journal article-refereed

Keywords

  • Sparse linear algebra
  • Sparse linear equation systems
  • Sparse matrix vector product (SpMV)
  • Graphics processing units (GPUs)
  • Deep Learning
  • artificial intelligence (AI)
  • Iterative solvers

Fingerprint Dive into the research topics of 'DIESEL: A novel deep learning-based tool for SpMV computations and solving sparse linear equation systems'. Together they form a unique fingerprint.

Cite this