Unsupervised Learning on Neural Network Outputs: with Application in Zero-shot Learning

Yao Lu

Unsupervised Learning on Neural Network Outputs: with Application in Zero-shot Learning

Yao Lu

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussa › Conference article in proceedings › Scientific › vertaisarvioitu

Abstrakti

The outputs of a trained neural network contain much richer information than just a one-hot classifier. For example, a neural network might give an image of a dog the probability of one in a million of being a cat but it is still much larger than the probability of being a car. To reveal the hidden structure in them, we apply two unsupervised learning algorithms, PCA and ICA, to the outputs of a deep Convolutional Neural Network trained on the ImageNet of 1000 classes. The PCA/ICA embedding of the object classes reveals their visual similarity and the PCA/ICA components can be interpreted as common visual features shared by similar object classes. For an application, we proposed a new zero-shot learning method, in which the visual features learned by PCA/ICA are employed. Our zeroshot learning method achieves the state-of-the-art results on the ImageNet of over 20000 classes.

Alkuperäiskieli	Englanti
Otsikko	Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence
Alaotsikko	New York, New York, USA, 9–15 July 2016
Toimittajat	Subbarao Kambhampati
Kustantaja	AAAI Press
Sivut	3432-3428
ISBN (elektroninen)	978-1-57735-770-4
Tila	Julkaistu - 9 heinäk. 2016
OKM-julkaisutyyppi	A4 Artikkeli konferenssijulkaisussa
Tapahtuma	International Joint Conference on Artificial Intelligence - New York Hilton Midtown, New York, Yhdysvallat Kesto: 9 heinäk. 2016 → 15 heinäk. 2016 Konferenssinumero: 25 http://ijcai-16.org/index.php/welcome/view/home

Julkaisusarja

Nimi	International Joint Conferences on Artificial Intelligence
Kustantaja	IAAA press
ISSN (elektroninen)	1045-0823

Conference

Conference	International Joint Conference on Artificial Intelligence
Lyhennettä	IJCAI
Maa/Alue	Yhdysvallat
Kaupunki	New York
Ajanjakso	09/07/2016 → 15/07/2016
www-osoite	http://ijcai-16.org/index.php/welcome/view/home

Siteeraa tätä

@inproceedings{29e9168e356b408b93e9438705a8cd52,

title = "Unsupervised Learning on Neural Network Outputs: with Application in Zero-shot Learning",

abstract = "The outputs of a trained neural network contain much richer information than just a one-hot classifier. For example, a neural network might give an image of a dog the probability of one in a million of being a cat but it is still much larger than the probability of being a car. To reveal the hidden structure in them, we apply two unsupervised learning algorithms, PCA and ICA, to the outputs of a deep Convolutional Neural Network trained on the ImageNet of 1000 classes. The PCA/ICA embedding of the object classes reveals their visual similarity and the PCA/ICA components can be interpreted as common visual features shared by similar object classes. For an application, we proposed a new zero-shot learning method, in which the visual features learned by PCA/ICA are employed. Our zeroshot learning method achieves the state-of-the-art results on the ImageNet of over 20000 classes.",

author = "Yao Lu",

year = "2016",

month = jul,

day = "9",

language = "English",

series = "International Joint Conferences on Artificial Intelligence",

publisher = "AAAI Press",

pages = "3432--3428",

editor = "Subbarao Kambhampati",

booktitle = "Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence",

address = "United States",

note = "International Joint Conference on Artificial Intelligence, IJCAI ; Conference date: 09-07-2016 Through 15-07-2016",

url = "http://ijcai-16.org/index.php/welcome/view/home",

}

Lu, Y 2016, Unsupervised Learning on Neural Network Outputs: with Application in Zero-shot Learning. julkaisussa S Kambhampati (Toimittaja), Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence: New York, New York, USA, 9–15 July 2016. International Joint Conferences on Artificial Intelligence, AAAI Press, Sivut 3432-3428, International Joint Conference on Artificial Intelligence, New York, New York, Yhdysvallat, 09/07/2016.

Unsupervised Learning on Neural Network Outputs: with Application in Zero-shot Learning. / Lu, Yao.
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence: New York, New York, USA, 9–15 July 2016. toim. / Subbarao Kambhampati. AAAI Press, 2016. s. 3432-3428 (International Joint Conferences on Artificial Intelligence).

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussa › Conference article in proceedings › Scientific › vertaisarvioitu

TY - GEN

T1 - Unsupervised Learning on Neural Network Outputs: with Application in Zero-shot Learning

AU - Lu, Yao

N1 - Conference code: 25

PY - 2016/7/9

Y1 - 2016/7/9

N2 - The outputs of a trained neural network contain much richer information than just a one-hot classifier. For example, a neural network might give an image of a dog the probability of one in a million of being a cat but it is still much larger than the probability of being a car. To reveal the hidden structure in them, we apply two unsupervised learning algorithms, PCA and ICA, to the outputs of a deep Convolutional Neural Network trained on the ImageNet of 1000 classes. The PCA/ICA embedding of the object classes reveals their visual similarity and the PCA/ICA components can be interpreted as common visual features shared by similar object classes. For an application, we proposed a new zero-shot learning method, in which the visual features learned by PCA/ICA are employed. Our zeroshot learning method achieves the state-of-the-art results on the ImageNet of over 20000 classes.

AB - The outputs of a trained neural network contain much richer information than just a one-hot classifier. For example, a neural network might give an image of a dog the probability of one in a million of being a cat but it is still much larger than the probability of being a car. To reveal the hidden structure in them, we apply two unsupervised learning algorithms, PCA and ICA, to the outputs of a deep Convolutional Neural Network trained on the ImageNet of 1000 classes. The PCA/ICA embedding of the object classes reveals their visual similarity and the PCA/ICA components can be interpreted as common visual features shared by similar object classes. For an application, we proposed a new zero-shot learning method, in which the visual features learned by PCA/ICA are employed. Our zeroshot learning method achieves the state-of-the-art results on the ImageNet of over 20000 classes.

M3 - Conference article in proceedings

T3 - International Joint Conferences on Artificial Intelligence

SP - 3432

EP - 3428

BT - Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence

A2 - Kambhampati, Subbarao

PB - AAAI Press

T2 - International Joint Conference on Artificial Intelligence

Y2 - 9 July 2016 through 15 July 2016

ER -

Unsupervised Learning on Neural Network Outputs: with Application in Zero-shot Learning

Abstrakti

Julkaisusarja

Conference

Sormenjälki

Siteeraa tätä