TEX-Nets: Binary patterns encoded convolutional neural networks for texture recognition

Rao Muhammad Anwer, Fahad Shahbaz Khan, Joost van de Weijer, Jorma Laaksonen

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

6 Citations (Scopus)

Abstract

Recognizing materials and textures in realistic imaging conditions is a challenging computer vision problem. For many years, local features based orderless representations were a dominant approach for texture recognition. Recently deep local features, extracted from the intermediate layers of a Convolutional Neural Network (CNN), are used as filter banks. These dense local descriptors from a deep model, when encoded with Fisher Vectors, have shown to provide excellent results for texture recognition. The CNN models, employed in such approaches, take RGB patches as input and train on a large amount of labeled images. We show that CNN models, which we call TEX-Nets, trained using mapped coded images with explicit texture information provide complementary information to the standard deep models trained on RGB patches. We further investigate two deep architectures, namely early and late fusion, to combine the texture and color information. Experiments on benchmark texture datasets clearly demonstrate that TEX-Nets provide complementary information to standard RGB deep network. Our approach provides a large gain of 4:8%, 3:5%, 2:6% and 4:1% respectively in accuracy on the DTD, KTH-TIPS-2a, KTH-TIPS-2b and Texture-10 datasets, compared to the standard RGB network of the same architecture. Further, our final combination leads to consistent improvements over the state-of-the-art on all four datasets.

Original languageEnglish
Title of host publicationICMR 2017 - Proceedings of the 2017 ACM International Conference on Multimedia Retrieval
PublisherACM
Pages125-132
Number of pages8
ISBN (Electronic)9781450347013
DOIs
Publication statusPublished - 6 Jun 2017
MoE publication typeA4 Article in a conference publication
EventACM International Conference on Multimedia Retrieval - Bucharest, Romania
Duration: 6 Jun 20179 Jun 2017
Conference number: 17

Conference

ConferenceACM International Conference on Multimedia Retrieval
Abbreviated titleICMR
CountryRomania
CityBucharest
Period06/06/201709/06/2017

Keywords

  • Convolutional Neural Networks
  • Local binary patterns
  • Texture recognition

Fingerprint Dive into the research topics of 'TEX-Nets: Binary patterns encoded convolutional neural networks for texture recognition'. Together they form a unique fingerprint.

  • Equipment

    Science-IT

    Mikko Hakala (Manager)

    School of Science

    Facility/equipment: Facility

  • Cite this

    Anwer, R. M., Khan, F. S., van de Weijer, J., & Laaksonen, J. (2017). TEX-Nets: Binary patterns encoded convolutional neural networks for texture recognition. In ICMR 2017 - Proceedings of the 2017 ACM International Conference on Multimedia Retrieval (pp. 125-132). ACM. https://doi.org/10.1145/3078971.3079001