Progress and Limitations of Deep Networks to Recognize Objects in Unusual Poses

Amro Abbas, Stéphane Deny

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu


Deep networks should be robust to rare events if they are to be successfully deployed in high-stakes real-world applications. Here we study the capability of deep networks to recognize objects in unusual poses. We create a synthetic dataset of images of objects in unusual orientations, and evaluate the robustness of a collection of 38 recent and competitive deep networks for image classification. We show that classifying these images is still a challenge for all networks tested, with an average accuracy drop of 29.5% compared to when the objects are presented upright. This brittleness is largely unaffected by various design choices, such as training losses, architectures, dataset modalities, and data-augmentation schemes. However, networks trained on very large datasets substantially outperform others, with the best network tested—Noisy Student trained on JFT-300M—showing a relatively small accuracy drop of only 14.5% on unusual poses. Nevertheless, a visual inspection of the failures of Noisy Student reveals a remaining gap in robustness with humans. Furthermore, combining multiple object transformations—3D-rotations and scaling—further degrades the performance of all networks. Our results provide another measurement of the robustness of deep networks to consider when using them in the real world. Code and datasets are available at
OtsikkoAAAI-23 Technical Tracks 1
ToimittajatBrian Williams, Yiling Chen, Jennifer Neville
KustantajaAAAI Press
ISBN (elektroninen)978-1-57735-880-0
DOI - pysyväislinkit
TilaJulkaistu - 26 kesäk. 2023
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaAAAI Conference on Artificial Intelligence - Walter E. Washington Convention Center, Washington, Yhdysvallat
Kesto: 7 helmik. 202314 helmik. 2023
Konferenssinumero: 37


NimiProceedings of the AAAI Conference on Artificial Intelligence
ISSN (elektroninen)2374-3468


ConferenceAAAI Conference on Artificial Intelligence


Sukella tutkimusaiheisiin 'Progress and Limitations of Deep Networks to Recognize Objects in Unusual Poses'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä