VR-based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use Case

Tarik Taleb, Nassim Sehad, Zinelaabidine Nadir, JaeSeung Song

Research output: Contribution to journalArticleScientificpeer-review

10 Citations (Scopus)
32 Downloads (Pure)

Abstract

The management of remote services, such as remote surgery, remote sensing, or remote driving, has become increasingly important, especially with the emerging 5G and Beyond 5G technologies. However, the strict network requirements of these remote services represent one of the major challenges that hinders their fast and large-scale deployment in critical infrastructures. This paper addresses certain issues inherent in remote and immersive control of virtual reality (VR)-based unmanned aerial vehicles (UAVs), whereby a user remotely controls UAVs, equipped with 360∘ cameras, using their Head-Mounted Devices (HMD) and their respective controllers. Remote and immersive control services, using 360∘ video streams, require much lower latency and higher throughput for true immersion and high service reliability. To assess and analyze these requirements, this paper introduces a real-life test-bed system that leverages different technologies (e.g., VR, 360∘ video streaming over 4G/5G, and edge computing). In the performance evaluation, different latency types are considered. They are namely: i) Glass-to-Glass latency between the 360∘ camera of a remote UAV and the HMD display, ii) user/pilot’s reaction latency, and iii) the command/execution latency. The obtained results indicate that the responsiveness (dubbed Glass-to-Reaction-to-Execution -GRE -latency) of a pilot, using our system, to a sudden event is within an acceptable range, i.e., around 900ms.
Original languageEnglish
Pages (from-to)5349-5363
Number of pages15
JournalIEEE Internet of Things Journal
Volume10
Issue number6
Early online date15 Nov 2022
DOIs
Publication statusPublished - 15 Mar 2023
MoE publication typeA1 Journal article-refereed

Keywords

  • Virtual Reality
  • Immersive Services
  • Unmanned Aerial Vehicle
  • Edge Computing
  • 5G and Beyond
  • Mobile Networking

Fingerprint

Dive into the research topics of 'VR-based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use Case'. Together they form a unique fingerprint.

Cite this