Combining holistic and part-based deep representations for computational painting categorization

Rao Muhammad Anwer, Fahad Shahbaz Khan, Joost Van De Weijer, Jorma Laaksonen

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

20 Citations (Scopus)


Automatic analysis of visual art, such as paintings, is a challenging inter-disciplinary research problem. Conventional approaches only rely on global scene characteristics by encoding holistic information for computational painting categorization. We argue that such approaches are sub-optimal and that discriminative common visual structures provide complementary information for painting classification. We present an approach that encodes both the global scene layout and discriminative latent common structures for computational painting categorization. The region of interests are automatically extracted, without any manual part labeling, by training class-specific deformable part-based models. Both holistic and region-of-interests are then described using multi-scale dense convolutional features. These features are pooled separately using Fisher vector encoding and concatenated afterwards in a single image representation. Experiments are performed on a challenging dataset with 91 different painters and 13 diverse painting styles. Our approach outperforms the standard method, which only employs the global scene characteristics. Furthermore, our method achieves state-of-the-art results outperforming a recent multi-scale deep features based approach [11] by 6.4% and 3.8% respectively on artist and style classification.

Original languageEnglish
Title of host publicationICMR 2016 - Proceedings of the 2016 ACM International Conference on Multimedia Retrieval
Number of pages4
ISBN (Electronic)9781450343596
Publication statusPublished - 6 Jun 2016
MoE publication typeA4 Article in a conference publication
EventACM International Conference on Multimedia Retrieval - New York, United States
Duration: 6 Jun 20169 Jun 2016
Conference number: 6


ConferenceACM International Conference on Multimedia Retrieval
Abbreviated titleICMR
Country/TerritoryUnited States
CityNew York


Dive into the research topics of 'Combining holistic and part-based deep representations for computational painting categorization'. Together they form a unique fingerprint.

Cite this