Learning Global Pairwise Interactions with Bayesian Neural Networks

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

7 Citations (Scopus)
44 Downloads (Pure)


Estimating global pairwise interaction effects, i.e., the difference between the joint effect and the sum of marginal effects of two input features, with uncertainty properly quantified, is centrally important in science applications. We propose a non-parametric probabilistic method for detecting interaction effects of unknown form. First, the relationship between the features and the output is modelled using a Bayesian neural network, capable of representing complex interactions and principled uncertainty. Second, interaction effects and their uncertainty are estimated from the trained model. For the second step, we propose an intuitive global interaction measure: Bayesian Group Expected Hessian (GEH), which aggregates information of local interactions as captured by the Hessian. GEH provides a natural trade-off between type I and type II error and, moreover, comes with theoretical guarantees ensuring that the estimated interaction effects and their uncertainty can be improved by training a more accurate BNN. The method empirically outperforms available non-probabilistic alternatives on simulated and real-world data. Finally, we demonstrate its ability to detect interpretable interactions between higher-level features (at deeper layers of the neural network).
Original languageEnglish
Title of host publicationECAI 2020 - 24th European Conference on Artificial Intelligence, including 10th Conference on Prestigious Applications of Artificial Intelligence, PAIS 2020 - Proceedings
EditorsGiuseppe De Giacomo, Alejandro Catala, Bistra Dilkina, Michela Milano, Senen Barro, Alberto Bugarin, Jerome Lang
PublisherIOS Press
Number of pages8
ISBN (Electronic)9781643681009
Publication statusPublished - 24 Aug 2020
MoE publication typeA4 Conference publication
EventEuropean Conference on Artificial Intelligence - Santiago de Compostela, Spain
Duration: 8 Jun 202012 Jun 2020
Conference number: 24

Publication series

Name Frontiers in Artificial Intelligence and Applications
PublisherIOS Press
ISSN (Print)0922-6389
ISSN (Electronic)1879-8314


ConferenceEuropean Conference on Artificial Intelligence
Abbreviated titleECAI
CitySantiago de Compostela
Internet address


Dive into the research topics of 'Learning Global Pairwise Interactions with Bayesian Neural Networks'. Together they form a unique fingerprint.

Cite this