Concise and interpretable multi-label rule sets

Martino Ciaperoni*, Han Xiao, Aristides Gionis

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

1 Citation (Scopus)
59 Downloads (Pure)

Abstract

Multi-label classification is becoming increasingly ubiquitous, but not much attention has been paid to interpretability. In this paper, we develop a multi-label classifier that can be represented as a concise set of simple “if-then” rules, and thus, it offers better interpretability compared to black-box models. Notably, our method is able to find a small set of relevant patterns that lead to accurate multi-label classification, while existing rule-based classifiers are myopic and wasteful in searching rules, requiring a large number of rules to achieve high accuracy. In particular, we formulate the problem of choosing multi-label rules to maximize a target function, which considers not only discrimination ability with respect to labels, but also diversity. Accounting for diversity helps to avoid redundancy, and thus, to control the number of rules in the solution set. To tackle the said maximization problem, we propose a 2-approximation algorithm, which circumvents the exponential-size search space of rules using a novel technique to sample highly discriminative and diverse rules. In addition to our theoretical analysis, we provide a thorough experimental evaluation and a case study, which indicate that our approach offers a trade-off between predictive performance and interpretability that is unmatched in previous work.

Original languageEnglish
Pages (from-to)5657-5694
Number of pages38
JournalKnowledge and Information Systems
Volume65
Issue number12
Early online date2023
DOIs
Publication statusPublished - Dec 2023
MoE publication typeA1 Journal article-refereed

Keywords

  • Interpretable machine learning
  • Multi-label classification
  • Rule sampling
  • Rule-based classification

Fingerprint

Dive into the research topics of 'Concise and interpretable multi-label rule sets'. Together they form a unique fingerprint.

Cite this