Towards Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches

Yu Bai, Hui Zhao, Xin Zhang, Zheng Chang, Riku Jantti, Kun Yang

Research output: Contribution to journalArticleScientificpeer-review

9 Citations (Scopus)
32 Downloads (Pure)

Abstract

Unmanned aerial vehicle (UAV)-based wireless networks have received increasing research interest in recent years and are gradually being utilized in various aspects of our society. The growing complexity of UAV applications such as disaster management, plant protection, and environment monitoring, has resulted in escalating and stringent requirements for UAV networks that a single UAV cannot fulfill. To address this, multi-UAV wireless networks (MUWNs) have emerged, offering enhanced resource-carrying capacity and enabling collaborative mission completion by multiple UAVs. However, the effective operation of MUWNs necessitates a higher level of autonomy and intelligence, particularly in decision-making and multi-objective optimization under diverse environmental conditions. Reinforcement Learning (RL), an intelligent and goal-oriented decision-making approach, has emerged as a promising solution for addressing the intricate tasks associated with MUWNs. As one may notice, the literature still lacks a comprehensive survey of recent advancements in RL-based MUWNs. Thus, this paper aims to bridge this gap by providing a comprehensive review of RL-based approaches in the context of autonomous MUWNs. We present an informative overview of RL and demonstrate its application within the framework of MUWNs. Specifically, we summarize various applications of RL in MUWNs, including data access, sensing and collection, resource allocation for wireless connectivity, UAV-assisted mobile edge computing, localization, trajectory planning, and network security. Furthermore, we identify and discuss several open challenges based on the insights gained from our review.

Original languageEnglish
Pages (from-to)3038-3067
Number of pages30
JournalIEEE Communications Surveys and Tutorials
Volume25
Issue number4
Early online date2023
DOIs
Publication statusPublished - 2023
MoE publication typeA1 Journal article-refereed

Keywords

  • Autonomous aerial vehicles
  • Heuristic algorithms
  • Multi-UAV wireless network
  • Optimization
  • reinforcement learning
  • Resource management
  • Surveys
  • Tutorials
  • UAV-assisted communication network
  • UAV-assisted mobile computing
  • Unmanned aerial vehicle (UAV)
  • Wireless networks

Fingerprint

Dive into the research topics of 'Towards Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches'. Together they form a unique fingerprint.

Cite this