Cache Policy Design via Reinforcement Learning for Cellular Networks in Non-Stationary Environment

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu

20 Lataukset (Pure)

Abstrakti

We consider wireless caching both at the network edge and at User Equipment (UE) to alleviate traffic congestion, aiming to find a joint cache placement and delivery policy by maximizing the Quality of Service (QoS) while minimizing backhaul load and User Equipment (UE) power consumption. We assume unknown and time-variant file popularities which are affected by the UE cache content, leading to a non-stationary Partial Observable Markov Decision Process (POMDP). We address this problem in a deep reinforcement learning framework, employing Feed Forward Neural Network (FFNN) and Long Short Term Memory (LSTM) networks in conjunction with Advantageous Actor Critic (A2C) algorithm. LSTM exploits the correlation of the file popularity distribution across time slots to learn information of the dynamics of the environment and A2C algorithm is used due to its ability of handling continuous and high dimensional spaces. We leverage LSTM and A2C tools based on its virtue to find an optimal solution for the POMDP environment. Simulation results show that using LSTM-based A2C outperforms a FFNN-based A2C in terms of sample efficiency and optimality. An LSTM-based A2C gives a superior performance under the non-stationary POMDP paradigm.
AlkuperäiskieliEnglanti
Otsikko2023 IEEE International Conference on Communications Workshops
AlaotsikkoSustainable Communications for Renaissance, ICC Workshops 2023
KustantajaIEEE
Sivut764-769
Sivumäärä6
ISBN (elektroninen)979-8-3503-3307-7
ISBN (painettu)979-8-3503-3308-4
DOI - pysyväislinkit
TilaJulkaistu - 23 lokak. 2023
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaIEEE International Conference on Communications Workshops - Rome, Italia
Kesto: 28 toukok. 20231 kesäk. 2023

Julkaisusarja

Nimi IEEE International Conference on Communications workshops
KustantajaIEEE
ISSN (elektroninen)2694-2941

Workshop

WorkshopIEEE International Conference on Communications Workshops
LyhennettäICC Workshops
Maa/AlueItalia
KaupunkiRome
Ajanjakso28/05/202301/06/2023

Sormenjälki

Sukella tutkimusaiheisiin 'Cache Policy Design via Reinforcement Learning for Cellular Networks in Non-Stationary Environment'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä