Interactive modeling of concept drift and errors in relevance feedback

Antti Kangasrääsiö, Yi Chen, Dorota Głowacka, Samuel Kaski

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

4 Citations (Scopus)


In exploratory search tasks, users usually start with considerable uncertainty about their search goals, and so the search intent of the user may be volatile as the user is constantly learning and reformulating her search hypothesis during the search. This may lead to a noticeable concept drift in the relevance feedback given by the user. We formulate a Bayesian regression model for predicting the accuracy of each individual user feedback and thus find outliers in the feedback data set. To accompany this model, we introduce a timeline interface that visualizes the feedback history to the user and gives her suggestions on which past feedback is likely in need of adjustment. This interface also allows the user to adjust the feedback accuracy inferences made by the model. Simulation experiments demonstrate that the performance of the new user model outperforms a simpler baseline and that the performance approaches that of an oracle, given a small amount of additional user interaction. A user study shows that the proposed modeling technique, combined with the timeline interface, made it easier for the users to notice and correct mistakes in their feedback, resulted in better and more diverse recommendations, allowed users to easier find items they liked, and was more understandable.

Original languageEnglish
Title of host publicationUMAP 2016 - Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization
Number of pages9
ISBN (Electronic)9781450343701
Publication statusPublished - 13 Jul 2016
MoE publication typeA4 Article in a conference publication
EventConference on User Modeling, Adaptation and Personalization - Halifax, Canada
Duration: 13 Jul 201617 Jul 2016
Conference number: 24


ConferenceConference on User Modeling, Adaptation and Personalization
Abbreviated titleUMAP


  • Concept drift
  • Exploratory search
  • Interactive user modeling
  • Probabilistic user models
  • User interfaces

Fingerprint Dive into the research topics of 'Interactive modeling of concept drift and errors in relevance feedback'. Together they form a unique fingerprint.

Cite this