Real-time emotion recognition for sales

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

3 Sitaatiot (Scopus)
76 Lataukset (Pure)

Abstrakti

Positive emotion is a pre-condition to any sales contract. Likewise, the ability to perceive the emotions of a customer impacts sales performance.To support emotional perception in buyer-seller interactions, we propose an audio-visual emotion recognition system that can recognize eight emotions: neutral, calm, sad, happy, angry, fearful, surprised, and disgusted. We reduced noise in audio samples and we applied transfer learning for image feature extraction based on a pre-trained deep neural network VGG16. For emotion recognition, we successfully obtained an audio emotion-recognition accuracy of 62.51% and 68% and video emotion-recognition accuracy of 97.13% and 97.77% on the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) and Surrey Audio-Visual Expressed Emotion (SAVEE) datasets respectively. For the combination of the two models, our proposed merging mechanism without re-training achieved an accuracy of close to 100% on both datasets. Finally, we demonstrated our system for a customer satisfaction use case in a real customer-to-salesperson interaction using audio and video models, achieving an average accuracy of 78%.

AlkuperäiskieliEnglanti
OtsikkoProceedings of 16th International Conference on Mobility, Sensing and Networking (MSN 2020)
KustantajaIEEE
Sivut584-591
Sivumäärä8
ISBN (elektroninen)9781728199160
DOI - pysyväislinkit
TilaJulkaistu - huhtikuuta 2021
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaInternational Conference on Mobility, Sensing and Networking - Tokyo, Japani
Kesto: 17 joulukuuta 202019 joulukuuta 2020
Konferenssinumero: 16

Conference

ConferenceInternational Conference on Mobility, Sensing and Networking
LyhennettäMSN
Maa/AlueJapani
KaupunkiTokyo
Ajanjakso17/12/202019/12/2020

Sormenjälki

Sukella tutkimusaiheisiin 'Real-time emotion recognition for sales'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä