Towards Gaze-Based Video Annotation

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

3 Sitaatiot (Scopus)

Abstrakti

This paper presents our efforts towards a framework for video annotation using gaze. In computer vision, video annotation (VA) is an essential step in providing a ground truth for the evaluation of object detection and tracking techniques. VA is a demanding element in the development of video processing algorithms, where each object of interest should be manually labelled. Although the community has handled VA for a long time, the size of new data sets and the complexity of the new tasks pushes us to revisit it. A barrier towards automated video annotation is the recognition of the object of interest and tracking it over image sequences. To tackle this problem, we employ the concept of visual attention for enhancing video annotation. In an image, human attention naturally grasps interesting areas that provide valuable information for extracting the objects of interest, which can be exploited to annotate videos. Under task-based gaze recording, we utilize an observer's gaze to filter seed object detector responses in a video sequence. The filtered boxes are then passed to an appearance-based tracking algorithm. We evaluate the gaze usefulness by comparing the algorithm with gaze and without it. We show that eye gaze is an influential cue for enhancing the automated video annotation, improving the annotation significantly.
AlkuperäiskieliEnglanti
Otsikko2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA)
KustantajaIEEE
Sivumäärä5
ISBN (elektroninen) 978-1-4673-8910-5
DOI - pysyväislinkit
TilaJulkaistu - 2017
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaInternational Conference on Image Processing Theory, Tools and Applications - Oulu, Suomi
Kesto: 12 joulukuuta 201615 joulukuuta 2016
Konferenssinumero: 6
http://www.ipta-conference.com/ipta16/

Julkaisusarja

NimiInternational Conference on Image Processing Theory Tools and Applications
ISSN (painettu)2154-512X

Conference

ConferenceInternational Conference on Image Processing Theory, Tools and Applications
LyhennettäIPTA
MaaSuomi
KaupunkiOulu
Ajanjakso12/12/201615/12/2016
www-osoite

Sormenjälki Sukella tutkimusaiheisiin 'Towards Gaze-Based Video Annotation'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

  • Projektit

    • 1 Päättynyt

    Suomalainen laskennallisen päättelyn huippuyksikkö

    Xu, Y., Rezazadegan Tavakoli, H., Pesonen, H., Puranen, S., Rintanen, J., Kaski, S., Anwer, R., Parviainen, P., Soare, M., Weinzierl, A. & Vuollekoski, H.

    01/01/201528/02/2018

    Projekti: Academy of Finland: Other research funding

    Laitteet

    Science-IT

    Mikko Hakala (Manager)

    Perustieteiden korkeakoulu

    Laitteistot/tilat: Facility

  • Siteeraa tätä

    Soliman, M., Rezazadegan Tavakoli, H., & Laaksonen, J. (2017). Towards Gaze-Based Video Annotation. teoksessa 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA) (International Conference on Image Processing Theory Tools and Applications). IEEE. https://doi.org/10.1109/IPTA.2016.7821028