Reinforcement learning for scalable and reliable power allocation in SDN-based backscatter heterogeneous network

Furqan Jameel*, Wali Ullah Khan, Muhammad Ali Jamshed, Haris Pervaiz, Qammer Abbasi, Riku Jantti

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

3 Citations (Scopus)
9 Downloads (Pure)


Backscatter heterogeneous networks are expected to usher a new era of massive connectivity of low-powered devices. With the integration of software-defined networking (SDN), such networks hold the promise to be a key enabling technology for massive Internet-of-things (IoT) due to myriad applications in industrial automation, healthcare, and logistics management. However, there are many aspects of SDN-based backscatter heterogeneous networks that need further development before practical realization. One of the challenging aspects is the high level of interference due to the reuse of spectral resources for backscatter communications. To partly address this issue, this article provides a reinforcement learning-based solution for effective interference management when backscatter tags coexist with other legacy devices in a heterogeneous network. Specifically, using reinforcement learning, the agents are trained to minimize the interference for macro-cell (legacy users) and small-cell (backscatter tags). Novel reward functions for both macro- and small-cells have been designed that help in controlling the transmission power levels of users. The results show that the proposed framework not only improves the performance of macro-cell users but also fulfills the quality of service requirements of backscatter tags by optimizing the long-term rewards.

Original languageEnglish
Title of host publicationIEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2020
Number of pages6
ISBN (Electronic)9781728186955
Publication statusPublished - Jul 2020
MoE publication typeA4 Article in a conference publication
EventIEEE Conference on Computer Communications - Online, Toronto, Canada
Duration: 6 Jul 20209 Jul 2020
Conference number: 38


ConferenceIEEE Conference on Computer Communications
Abbreviated titleINFOCOM


  • Backscatter communications
  • Interference management
  • Internet-of-things (IoT)
  • Reinforcement learning


Dive into the research topics of 'Reinforcement learning for scalable and reliable power allocation in SDN-based backscatter heterogeneous network'. Together they form a unique fingerprint.

Cite this