Exploring Contextual Importance and Utility in Explaining Affect Detection

Nazanin Fouladgar*, Marjan Alirezaie, Kary Främling

*Tämän työn vastaava kirjoittaja

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

2 Sitaatiot (Scopus)


By the ubiquitous usage of machine learning models with their inherent black-box nature, the necessity of explaining the decisions made by these models has become crucial. Although outcome explanation has been recently taken into account as a solution to the transparency issue in many areas, affect computing is one of the domains with the least dedicated effort on the practice of explainable AI, particularly over different machine learning models. The aim of this work is to evaluate the outcome explanations of two black-box models, namely neural network (NN) and linear discriminant analysis (LDA), to understand individuals affective states measured by wearable sensors. Emphasizing on context-aware decision explanations of these models, the two concepts of Contextual Importance (CI) and Contextual Utility (CU) are employed as a model-agnostic outcome explanation approach. We conduct our experiments on the two multimodal affect computing datasets, namely WESAD and MAHNOB-HCI. The results of applying a neural-based model on the first dataset reveal that the electrodermal activity, respiration as well as accelorometer sensors contribute significantly in the detection of “meditation” state for a particular participant. However, the respiration sensor does not intervene in the LDA decision of the same state. On the course of second dataset and the neural network model, the importance and utility of electrocardiogram and respiration sensors are shown as the dominant features in the detection of an individual “surprised” state, while the LDA model does not rely on the respiration sensor to detect this mental state.

OtsikkoAIxIA 2020 – Advances in Artificial Intelligence - XIXth International Conference of the Italian Association for Artificial Intelligence, Revised Selected Papers
ToimittajatMatteo Baldoni, Stefania Bandini
DOI - pysyväislinkit
TilaJulkaistu - 2021
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaInternational Conference of the Italian Association for Artificial Intelligence - Virtual, Online, Italia
Kesto: 24 marrask. 202027 marrask. 2020
Konferenssinumero: 19


NimiLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Vuosikerta12414 LNAI
ISSN (painettu)0302-9743
ISSN (elektroninen)1611-3349


ConferenceInternational Conference of the Italian Association for Artificial Intelligence
KaupunkiVirtual, Online


Sukella tutkimusaiheisiin 'Exploring Contextual Importance and Utility in Explaining Affect Detection'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä