Integrating neurophysiologic relevance feedback in intent modeling for information retrieval

Giulio Jacucci, Oswald Barral, Pedram Daee, Markus Wenzel, Baris Serim, Tuukka Ruotsalo, Patrik Pluchino, Jonathan Freeman, Luciano Gamberini, Samuel Kaski, Benjamin Blankertz

Research output: Contribution to journalArticleScientificpeer-review

21 Citations (Scopus)
256 Downloads (Pure)

Abstract

The use of implicit relevance feedback from neurophysiology could deliver effortless information retrieval. However, both computing neurophysiologic responses and retrieving documents are characterized by uncertainty because of noisy signals and incomplete or inconsistent representations of the data. We present the first-of-its-kind, fully integrated information retrieval system that makes use of online implicit relevance feedback generated from brain activity as measured through electroencephalography (EEG), and eye movements. The findings of the evaluation experiment (N = 16) show that we are able to compute online neurophysiology-based relevance feedback with performance significantly better than chance in complex data domains and realistic search tasks. We contribute by demonstrating how to integrate in interactive intent modeling this inherently noisy implicit relevance feedback combined with scarce explicit feedback. Although experimental measures of task performance did not allow us to demonstrate how the classification outcomes translated into search task performance, the experiment proved that our approach is able to generate relevance feedback from brain signals and eye movements in a realistic scenario, thus providing promising implications for future work in neuroadaptive information retrieval (IR).

Original languageEnglish
Number of pages14
JournalJOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY
DOIs
Publication statusPublished - 12 Mar 2019
MoE publication typeA1 Journal article-refereed

Keywords

  • information retrieval
  • brain-computer interfaces
  • neuro-physiology
  • interactive intent modeling
  • relevance feedback

Fingerprint

Dive into the research topics of 'Integrating neurophysiologic relevance feedback in intent modeling for information retrieval'. Together they form a unique fingerprint.

Cite this