Artificial Neural Networks with Random Weights for Incomplete Datasets

Research output: Contribution to journalArticleScientificpeer-review

Researchers

Research units

  • Universidade Federal do Ceará
  • Instituto de Aeronáutica e Espaço

Abstract

In this paper, we propose a method to design Neural Networks with Random Weights in the presence of incomplete data. We present a method, under the general assumption that the data is missing-at-random, to estimate the weights of the output layer as a function of the uncertainty of the missing data estimates. The proposed method uses the Unscented Transform to approximate the expected values and the variances of the training examples after the hidden layer. We model the input data as a Gaussian Mixture Model with parameters estimated via a maximum likelihood approach. The validity of the proposed method is empirically assessed under a range of conditions on simulated and real problems. We conduct numerical experiments to compare the performance of the proposed method to the performance of popular, parametric and non-parametric, imputation methods. By the results observed in the experiments, we conclude that our proposed method consistently outperforms its counterparts.

Details

Original languageEnglish
Number of pages28
JournalNeural Processing Letters
Publication statusPublished - 1 Jan 2019
MoE publication typeA1 Journal article-refereed

    Research areas

  • Missing data, Neural networks, Unscented transform

ID: 32624276