Edge capacity planning for real time compute-intensive applications

Marius Noreikis, Yu Xiao, Yuming Jiang

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Abstract

Cloud computing is a major breakthrough in enabling multi-user scalable web services, process offloading and infrastructure cost savings. However, public clouds impose high network latency which became a bottleneck for real time applications such as mobile augmented reality applications. A widely accepted solution is to move latency sensitive services from the centralized cloud to the edge of the Internet, close to service users. An important prerequisite for deploying applications at the edge is determining initial required edge capacity. However, little has been done to provide reliable estimates of required computing capacity under Quality-of-Service (QoS) constraints. Differently from previous works that focus only on applications' CPU usage, in this paper, we propose a novel, queuing theory based edge capacity planning solution that takes into account both CPU and GPU usages of real-time compute-intensive applications. Our solution satisfies the QoS requirements in terms of response delays while minimizing the number of required edge computing nodes, assuming that the nodes are with fixed CPU/GPU capacity. We demonstrate the applicability and accuracy of our solution through extensive evaluation, including a case study using real-life applications. The results show that our solution maximizes the resource utilization through intelligent combinations of service requests, and can accurately estimate the minimal amount of CPU and GPU capacity required for satisfying the QoS requirements.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE International Conference on Fog Computing, ICFC 2019
PublisherIEEE
Pages175-184
Number of pages10
ISBN (Electronic)9781728132365
DOIs
Publication statusPublished - 1 Jun 2019
MoE publication typeA4 Article in a conference publication
EventIEEE International Conference on Fog Computing - Prague, Czech Republic
Duration: 24 Jun 201926 Jun 2019
Conference number: 1

Conference

ConferenceIEEE International Conference on Fog Computing
Abbreviated titleICFC
CountryCzech Republic
CityPrague
Period24/06/201926/06/2019

Keywords

  • Augmented reality
  • Capacity planning
  • Edge computing
  • GPU
  • Queueing theory

Fingerprint Dive into the research topics of 'Edge capacity planning for real time compute-intensive applications'. Together they form a unique fingerprint.

Cite this