Neural Network Based Facial Expression Analysis of Game Events: A Cautionary Tale

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

2 Sitaatiot (Scopus)

Abstrakti

We present an exploratory study of analyzing and visualizing player facial expressions from video with deep neural networks. We contribute a novel data processing and visualization technique we call Affect Gradients, which provides descriptive statistics of the expressive responses to game events, such as player death or collecting a power-up. As an additional contribution, we show that although there has been tremendous recent progress in deep neural networks and computer vision, interpreting the results as direct read-outs of experiential states is not advised. According to our data, getting killed appears to make players happy, and much more so than killing enemies, although one might expect the exact opposite. A visual inspection of the data reveals that our classifier works as intended, and our results illustrate the limitations of making inferences based on facial images and discrete emotion labels. For example, players may laugh off the death, in which case the closest label for the facial expression is "happy", but the true emotional state is complex and ambiguous. On the other hand, players may frown in concentration while killing enemies or escaping a tight spot, which can easily be interpreted as an "angry" expression.
AlkuperäiskieliEnglanti
OtsikkoProceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play
KustantajaACM
Sivut59-71
Sivumäärä13
ISBN (elektroninen)978-1-4503-5624-4
DOI - pysyväislinkit
TilaJulkaistu - 2018
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaACM SIGCHI Annual Symposium on Computer-Human Interaction in Play
- Melbourne, Austraalia
Kesto: 28 lokakuuta 201831 lokakuuta 2018
Konferenssinumero: 5
https://chiplay.acm.org/2018/

Conference

ConferenceACM SIGCHI Annual Symposium on Computer-Human Interaction in Play
LyhennettäCHI PLAY
MaaAustraalia
KaupunkiMelbourne
Ajanjakso28/10/201831/10/2018
www-osoite

Sormenjälki Sukella tutkimusaiheisiin 'Neural Network Based Facial Expression Analysis of Game Events: A Cautionary Tale'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä