Reinforcement learning for scalable and reliable power allocation in SDN-based backscatter heterogeneous network

Furqan Jameel*, Wali Ullah Khan, Muhammad Ali Jamshed, Haris Pervaiz, Qammer Abbasi, Riku Jantti

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

25 Citations (Scopus)
106 Downloads (Pure)

Abstract

Backscatter heterogeneous networks are expected to usher a new era of massive connectivity of low-powered devices. With the integration of software-defined networking (SDN), such networks hold the promise to be a key enabling technology for massive Internet-of-things (IoT) due to myriad applications in industrial automation, healthcare, and logistics management. However, there are many aspects of SDN-based backscatter heterogeneous networks that need further development before practical realization. One of the challenging aspects is the high level of interference due to the reuse of spectral resources for backscatter communications. To partly address this issue, this article provides a reinforcement learning-based solution for effective interference management when backscatter tags coexist with other legacy devices in a heterogeneous network. Specifically, using reinforcement learning, the agents are trained to minimize the interference for macro-cell (legacy users) and small-cell (backscatter tags). Novel reward functions for both macro- and small-cells have been designed that help in controlling the transmission power levels of users. The results show that the proposed framework not only improves the performance of macro-cell users but also fulfills the quality of service requirements of backscatter tags by optimizing the long-term rewards.

Original languageEnglish
Title of host publicationIEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2020
PublisherIEEE
Pages1069-1074
Number of pages6
ISBN (Electronic)9781728186955
DOIs
Publication statusPublished - Jul 2020
MoE publication typeA4 Conference publication
EventIEEE Conference on Computer Communications - Online, Toronto, Canada
Duration: 6 Jul 20209 Jul 2020
Conference number: 38

Conference

ConferenceIEEE Conference on Computer Communications
Abbreviated titleINFOCOM
Country/TerritoryCanada
CityToronto
Period06/07/202009/07/2020

Keywords

  • Backscatter communications
  • Interference management
  • Internet-of-things (IoT)
  • Reinforcement learning

Fingerprint

Dive into the research topics of 'Reinforcement learning for scalable and reliable power allocation in SDN-based backscatter heterogeneous network'. Together they form a unique fingerprint.
  • 5G-FORCE-Jäntti

    Jäntti, R. (Principal investigator), Badihi Olyaei, B. (Project Member), Saba, N. (Project Member), Sheikh, M. (Project Member) & Menta, E. (Project Member)

    01/01/201931/03/2021

    Project: Business Finland: Other research funding

Cite this