Combining Textual and Visual Modeling for Predicting Media Memorability

Alison Reboud, Ismail Harrando, Jorma Laaksonen, Danny Francis, Raphaël Troncy, Hector Laria Mantecon

Research output: Chapter in Book/Report/Conference proceedingChapterScientific

2 Downloads (Pure)

Abstract

This paper describes a multimodal approach proposed by the MeMAD team for the MediaEval 2019 “Predicting Media memorability” task. Our best approach is a weighted average method combining predictions made separately from visual and textual representations of videos. In particular, we augmented the provided textual descriptions with automatically generated deep captions. For long term
memorability, we obtained better scores using the short term predictions rather than the long term ones. Our best model achieves Spearman scores of 0.522 and 0.277 respectively for the short and long term predictions tasks.
Original languageEnglish
Title of host publicationWorking Notes Proceedings of the MediaEval 2019 Workshop, Sophia Antipolis, France, 27-30 October 2019
PublisherCEUR
Publication statusPublished - 27 Oct 2019
MoE publication typeB2 Part of a book or another research book
EventMultimedia Benchmark Workshop - Sophia Antipolis, France
Duration: 27 Oct 201930 Oct 2019

Publication series

NameCEUR Workshop Proceedings
PublisherCEUR
Volume2670
ISSN (Electronic)1613-0073

Conference

ConferenceMultimedia Benchmark Workshop
Abbreviated titleMediaEval
CountryFrance
CitySophia Antipolis
Period27/10/201930/10/2019

Cite this