Learning Global Pairwise Interactions with Bayesian Neural Networks

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu

8 Sitaatiot (Scopus)
45 Lataukset (Pure)


Estimating global pairwise interaction effects, i.e., the difference between the joint effect and the sum of marginal effects of two input features, with uncertainty properly quantified, is centrally important in science applications. We propose a non-parametric probabilistic method for detecting interaction effects of unknown form. First, the relationship between the features and the output is modelled using a Bayesian neural network, capable of representing complex interactions and principled uncertainty. Second, interaction effects and their uncertainty are estimated from the trained model. For the second step, we propose an intuitive global interaction measure: Bayesian Group Expected Hessian (GEH), which aggregates information of local interactions as captured by the Hessian. GEH provides a natural trade-off between type I and type II error and, moreover, comes with theoretical guarantees ensuring that the estimated interaction effects and their uncertainty can be improved by training a more accurate BNN. The method empirically outperforms available non-probabilistic alternatives on simulated and real-world data. Finally, we demonstrate its ability to detect interpretable interactions between higher-level features (at deeper layers of the neural network).
OtsikkoECAI 2020 - 24th European Conference on Artificial Intelligence, including 10th Conference on Prestigious Applications of Artificial Intelligence, PAIS 2020 - Proceedings
ToimittajatGiuseppe De Giacomo, Alejandro Catala, Bistra Dilkina, Michela Milano, Senen Barro, Alberto Bugarin, Jerome Lang
KustantajaIOS Press
ISBN (elektroninen)9781643681009
DOI - pysyväislinkit
TilaJulkaistu - 24 elok. 2020
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaEuropean Conference on Artificial Intelligence - Santiago de Compostela, Espanja
Kesto: 8 kesäk. 202012 kesäk. 2020
Konferenssinumero: 24


Nimi Frontiers in Artificial Intelligence and Applications
KustantajaIOS Press
ISSN (painettu)0922-6389
ISSN (elektroninen)1879-8314


ConferenceEuropean Conference on Artificial Intelligence
KaupunkiSantiago de Compostela


Sukella tutkimusaiheisiin 'Learning Global Pairwise Interactions with Bayesian Neural Networks'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä