Projects per year
Abstract
In order to meet the growing demands for multimedia service access and release the pressure of the core network, edge caching and device-to-device (D2D) communication have been regarded as two promising techniques in next generation mobile networks and beyond. However, most existing related studies lack consideration of effective cooperation and adaptability to the dynamic network environments. In this article, based on the flexible trilateral cooperation among user equipment, edge base stations and a cloud server, we propose a D2D-assisted heterogeneous collaborative edge caching framework by jointly optimizing the node selection and cache replacement in mobile networks. We formulate the joint optimization problem as a Markov decision process, and use a deep Q-learning network to solve the long-term mixed integer linear programming problem. We further design an attention-weighted federated deep reinforcement learning (AWFDRL) model that uses federated learning to improve the training efficiency of the Q-learning network by considering the limited computing and storage capacity, and incorporates an attention mechanism to optimize the aggregation weights to avoid the imbalance of local model quality. We prove the convergence of the corresponding algorithm, and present simulation results to show the effectiveness of the proposed AWFDRL framework in reducing average delay of content access, improving hit rate and offloading traffic.
Original language | English |
---|---|
Article number | 9252973 |
Pages (from-to) | 154-169 |
Number of pages | 16 |
Journal | IEEE Journal on Selected Areas in Communications |
Volume | 39 |
Issue number | 1 |
Early online date | 2020 |
DOIs | |
Publication status | Published - Jan 2021 |
MoE publication type | A1 Journal article-refereed |
Keywords
- attention-weighted federated learning
- deep reinforcement learning
- device to device
- Edge caching
Fingerprint
Dive into the research topics of 'Attention-Weighted Federated Deep Reinforcement Learning for Device-to-Device Assisted Heterogeneous Collaborative Edge Caching'. Together they form a unique fingerprint.Projects
- 1 Finished
-
CSN: Customized Software Networking across Multiple Administrative Domains
Taleb, T., Addad, R., Afolabi, I., Amor, A., Yu, H., Kianpisheh, S., Mariouak, M., Hellaoui, H., Sehad, N., Boudi, A., El Marai, O., Shokrnezhad, M., Bagaa, M., Maity, I., Naas, S., Bekkouche, O., Benzaid, C., Kerfah, I., Mada, B. & Yang, B.
01/09/2017 → 31/08/2021
Project: Academy of Finland: Other research funding