Low Latency Ambient Backscatter Communications with Deep Q-Learning for beyond 5G Applications

Low latency is a critical requirement of beyond 5G services. Previously, the aspect of latency has been extensively analyzed in conventional and modern wireless networks. With the rapidly growing research interest in wireless-powered ambient backscatter communications, it has become ever more important to meet the delay constraints, while maximizing the achievable data rate. Therefore, to address the issue of latency in backscatter networks, this paper provides a deep Q-learning based framework for delay constrained ambient backscatter networks. To do so, a Q-learning model for ambient backscatter scenario has been developed. In addition, an algorithm has been proposed that employ deep neural networks to solve the complex Q-network. The simulation results show that the proposed approach not only improves the network performance but also meets the delay constraints for a dense backscatter network.