Saliency Revisited: Analysis of Mouse Movements versus Fixations

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

9 Sitaatiot (Scopus)

Abstrakti

This paper revisits visual saliency prediction by evaluating the recent advancements in this field such as crowd-sourced mouse tracking-based databases and contextual annotations. We pursue a critical and quantitative approach towards some of the new challenges including the quality of mouse tracking versus eye tracking for model training and evaluation. We extend quantitative evaluation of models in order to incorporate contextual information by proposing an evaluation methodology that allows accounting for contextual factors such as text, faces, and object attributes. The proposed contextual evaluation scheme facilitates detailed analysis of models and helps identify their pros and cons. Through several experiments, we find that (1) mouse tracking data has lower inter-participant visual congruency and higher dispersion, compared to the eye tracking data, (2) mouse tracking data does not totally agree with eye tracking in general and in terms of different contextual regions in specific, and (3) mouse tracking data leads to acceptable results in training current existing models, and (4) mouse tracking data is less reliable for model selection and evaluation. The contextual evaluation also reveals that, among the studied models, there is no single model that performs best on all the tested annotations.
AlkuperäiskieliEnglanti
Otsikko2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
KustantajaIEEE
Sivut6354-6362
ISBN (elektroninen)978-1-5386-0457-1
DOI - pysyväislinkit
TilaJulkaistu - 2017
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaIEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION - Honolulu, Yhdysvallat
Kesto: 21 heinäkuuta 201626 heinäkuuta 2016
Konferenssinumero: 30

Julkaisusarja

NimiIEEE Conference on Computer Vision and Pattern Recognition
KustantajaIEEE
ISSN (elektroninen)1063-6919

Conference

ConferenceIEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION
LyhennettäCVPR
MaaYhdysvallat
KaupunkiHonolulu
Ajanjakso21/07/201626/07/2016

Sormenjälki Sukella tutkimusaiheisiin 'Saliency Revisited: Analysis of Mouse Movements versus Fixations'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

  • Projektit

    • 1 Päättynyt

    Suomalainen laskennallisen päättelyn huippuyksikkö

    Xu, Y., Rezazadegan Tavakoli, H., Pesonen, H., Puranen, S., Rintanen, J., Kaski, S., Anwer, R., Parviainen, P., Soare, M., Weinzierl, A. & Vuollekoski, H.

    01/01/201528/02/2018

    Projekti: Academy of Finland: Other research funding

    Laitteet

    Science-IT

    Mikko Hakala (Manager)

    Perustieteiden korkeakoulu

    Laitteistot/tilat: Facility

  • Siteeraa tätä

    Rezazadegan Tavakoli, H., Ahmed, F., Borji, A., & Laaksonen, J. (2017). Saliency Revisited: Analysis of Mouse Movements versus Fixations. teoksessa 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Sivut 6354-6362). (IEEE Conference on Computer Vision and Pattern Recognition). IEEE. https://doi.org/10.1109/CVPR.2017.673