A connection between extreme learning machine and neural network kernel

Eli Parviainen*, Jaakko Riihimäki

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

8 Citations (Scopus)

Abstract

We study a connection between extreme learning machine (ELM) and neural network kernel (NNK). NNK is derived from a neural network with an infinite number of hidden units. We interpret ELM as an approximation to this infinite network. We show that ELM and NNK can, to certain extent, replace each other. ELM can be used to form a kernel, and NNK can be decomposed into feature vectors to be used in the hidden layer of ELM. The connection reveals possible importance of weight variance as a parameter of ELM. Based on our experiments, we recommend that model selection on ELM should consider not only the number of hidden units, as is the current practice, but also the variance of weights. We also study the interaction of variance and the number of hidden units, and discuss some properties of ELM, that may have been too strongly interpreted previously.

Original languageEnglish
Title of host publicationKnowledge Discovery, Knowledge Engineering and Knowledge Management - Second International Joint Conference, IC3K 2010, Revised Selected Papers
PublisherSpringer Verlag
Pages122-135
Number of pages14
Volume272 CCIS
ISBN (Print)9783642297632
DOIs
Publication statusPublished - 2013
MoE publication typeA4 Article in a conference publication
EventInternational Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Valencia, Spain
Duration: 25 Oct 201028 Oct 2010
Conference number: 2

Publication series

NameCommunications in Computer and Information Science
Volume272 CCIS
ISSN (Print)1865-0929

Conference

ConferenceInternational Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management
Abbreviated titleIC3K
CountrySpain
CityValencia
Period25/10/201028/10/2010

Keywords

  • ELM
  • Extreme learning machine
  • Neural network kernel

Fingerprint Dive into the research topics of 'A connection between extreme learning machine and neural network kernel'. Together they form a unique fingerprint.

Cite this