Post-hoc modification of linear models: combining machine learning with domain information to make solid inferences from noisy data

Research output: Contribution to journalArticleScientificpeer-review

Researchers

Research units

Abstract

Linear machine learning models “learn” a data transformation by being exposed to examples of input with the desired output, forming the basis for a variety of powerful techniques for analyzing neuroimaging data. However, their ability to learn the desired transformation is limited by the quality and size of the example dataset, which in neuroimaging studies is often notoriously noisy and small. In these cases, it is desirable to fine-tune the learned linear model using domain information beyond the example dataset. To this end, we present a framework that decomposes the weight matrix of a fitted linear model into three subcomponents: the data covariance, the identified signal of interest, and a normalizer. Inspecting these subcomponents in isolation provides an intuitive way to inspect the inner workings of the model and assess its strengths and weaknesses. Furthermore, the three subcomponents may be altered, which provides a straightforward way to inject prior information and impose additional constraints. We refer to this process as “post-hoc modification” of a model and demonstrate how it can be used to achieve precise control over which aspects of the model are fitted to the data through machine learning and which are determined through domain information. As an example use case, we decode the associative strength between words from electroencephalography (EEG) reading data. Our results show how the decoding accuracy of two example linear models (ridge regression and logistic regression) can be boosted by incorporating information about the spatio-temporal nature of the data, domain information about the N400 evoked potential and data from other participants.

Details

Original languageEnglish
Article number116221
Pages (from-to)1-14
JournalNeuroImage
Volume204
Publication statusPublished - 26 Sep 2019
MoE publication typeA1 Journal article-refereed

    Research areas

  • multivariate analysis, linear model, prior knowledge, event-related potentials, N400, EEG

Download statistics

No data available

ID: 34657509