A Survey on Reinforcement Learning-Aided Caching in Heterogeneous Mobile Edge Networks

Nikolaos Nomikos, Spyros Zoupanos, Themistoklis Charalambous*, Ioannis Krikidis

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

11 Downloads (Pure)

Abstract

Mobile networks experience a tremendous increase in data volume and user density due to the massive number of coexisting users and devices. An efficient technique to alleviate this issue is to bring the data closer to the users by exploiting cache-aided edge nodes, such as fixed and mobile access points, and even user devices. Meanwhile, the fusion of machine learning and wireless networks offers new opportunities for network optimization when traditional optimization approaches fail or incur high complexity. Among the various machine learning categories, reinforcement learning provides autonomous operation without relying on large sets of historical data for training. In this survey, reinforcement learning-aided mobile edge caching solutions are presented and classified, based on the networking architecture and optimization target. As sixth generation (6G) networks will be characterized by high heterogeneity, fixed cellular, fog, cooperative, vehicular, and aerial networks are studied. The discussion of these works reveals that there exist reinforcement learning-aided caching schemes with varying complexity that can surpass the performance of conventional policy-based approaches. Finally, several open issues are presented, stimulating further interest in this important research field.

Original languageEnglish
Pages (from-to)4380-4413
Number of pages34
JournalIEEE Access
Volume10
DOIs
Publication statusPublished - Jan 2022
MoE publication typeA1 Journal article-refereed

Keywords

  • 6G
  • 6G mobile communication
  • edge caching
  • heterogeneous networks
  • machine learning
  • mobile edge networks
  • Optimization
  • reinforcement learning
  • Task analysis
  • Taxonomy
  • Terminology
  • Wireless communication
  • Wireless networks

Fingerprint

Dive into the research topics of 'A Survey on Reinforcement Learning-Aided Caching in Heterogeneous Mobile Edge Networks'. Together they form a unique fingerprint.

Cite this