Distributed Assignment with Load Balancing for DNN Inference at the Edge

Yuzhe Xu, Thaha Mohammed, Mario Di Francesco, Carlo Fischione

Tutkimustuotos: LehtiartikkeliArticleScientificvertaisarvioitu

4 Sitaatiot (Scopus)
244 Lataukset (Pure)

Abstrakti

Inference carried out on pre-trained deep neural networks (DNNs) is particularly effective as it does not require re-training and entails no loss in accuracy. Unfortunately, resource-constrained devices such as those in the Internet of Things may need to offload the related computation to more powerful servers, particularly, at the network edge. However, edge servers have limited resources compared to those in the cloud; therefore, inference offloading generally requires dividing the original DNN into different pieces that are then assigned to multiple edge servers. Related approaches in the state of the art either make strong assumptions on the system model or fail to provide strict performance guarantees. This article specifically addresses these limitations by applying distributed assignment to deep neural network inference at the edge. In particular, it devises a detailed model of DNN-based inference, suitable for realistic scenarios involving edge computing. Optimal inference offloading with load balancing is also defined as a multiple assignment problem that maximizes proportional fairness. Moreover, a distributed algorithm for DNN inference offloading is introduced to solve such a problem in polynomial time with strong optimality guarantees. Finally, extensive simulations employing different datasets and DNN architectures establish that the proposed solution significantly improves upon the state of the art in terms of inference time (1.14 to 2.62 times faster), load balance (with a Jain’s fairness index of 0.9), and convergence (one order of magnitude less iterations).
AlkuperäiskieliEnglanti
Artikkeli9882293
Sivut1053-1065
Sivumäärä13
JulkaisuIEEE Internet of Things Journal
Vuosikerta10
Numero2
Varhainen verkossa julkaisun päivämäärä9 syysk. 2022
DOI - pysyväislinkit
TilaJulkaistu - 15 tammik. 2023
OKM-julkaisutyyppiA1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä

Sormenjälki

Sukella tutkimusaiheisiin 'Distributed Assignment with Load Balancing for DNN Inference at the Edge'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä