Latency and throughput characterization of convolutional neural networks for mobile computer vision

Jussi Hanhirova, Teemu Kämäräinen, Sipi Seppälä, Matti Siekkinen, Vesa Hirvisalo, Antti Ylä-Jääski

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

40 Sitaatiot (Scopus)

Abstrakti

We study performance characteristics of convolutional neural networks (CNN) for mobile computer vision systems. CNNs have proven to be a powerful and efficient approach to implement such systems. However, the system performance depends largely on the utilization of hardware accelerators, which are able to speed up the execution of the underlying mathematical operations tremendously through massive parallelism. Our contribution is performance characterization of multiple CNN-based models for object recognition and detection with several different hardware platforms and software frameworks, using both local (on-device) and remote (network-side server) computation. The measurements are conducted using real workloads and real processing platforms. On the platform side, we concentrate especially on TensorFlow and TensorRT. Our measurements include embedded processors found on mobile devices and high-performance processors that can be used on the network side of mobile systems. We show that there exists significant latency-throughput trade-offs but the behavior is very complex. We demonstrate and discuss several factors that affect the performance and yield this complex behavior.

AlkuperäiskieliEnglanti
OtsikkoProceedings of the 9th ACM Multimedia Systems Conference, MMSys 2018
KustantajaACM
Sivut204-215
Sivumäärä12
ISBN (elektroninen)9781450351928
DOI - pysyväislinkit
TilaJulkaistu - 12 kesäk. 2018
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaACM Multimedia Systems Conference - Amsterdam, Alankomaat
Kesto: 12 kesäk. 201815 kesäk. 2018
Konferenssinumero: 9

Conference

ConferenceACM Multimedia Systems Conference
LyhennettäMMSys
Maa/AlueAlankomaat
KaupunkiAmsterdam
Ajanjakso12/06/201815/06/2018

Sormenjälki

Sukella tutkimusaiheisiin 'Latency and throughput characterization of convolutional neural networks for mobile computer vision'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä