TY - JOUR
T1 - Model-Based Online Learning For Active ISAC Waveform Optimization
AU - Pulkkinen, Petteri
AU - Koivunen, Visa
N1 - Publisher Copyright:
Authors
PY - 2024/4/8
Y1 - 2024/4/8
N2 - This paper proposes a Model-Based Online Learning (MBOL) framework for waveform optimization in integrated sensing and communications (ISAC) systems. In particular, the MBOL framework is proposed to enhance the ISAC performance under dynamic environmental conditions. Unlike Model-Free Online Learning (MFOL) methods, our approach leverages a rich structural knowledge of sensing, communications, and radio environments, offering better explainability and sample efficiency. This paper establishes a theoretical analysis of the proposed class of MBOL methods, showing essential performance conditions and convergence rates. This theoretical analysis is critical for understanding the potential of MBOL in active waveform optimization tasks. We demonstrate the proposed MBOL framework in multicarrier ISAC systems, focusing on the sub-carrier selection and power allocation problem. Via numerical experiments, we show that the proposed MBOL method outperforms the MFOL method in terms of sample efficiency. The results underline the potential of MBOL for improving the active waveform optimization performance in ISAC systems, particularly when sample efficiency and explainability are critical.
AB - This paper proposes a Model-Based Online Learning (MBOL) framework for waveform optimization in integrated sensing and communications (ISAC) systems. In particular, the MBOL framework is proposed to enhance the ISAC performance under dynamic environmental conditions. Unlike Model-Free Online Learning (MFOL) methods, our approach leverages a rich structural knowledge of sensing, communications, and radio environments, offering better explainability and sample efficiency. This paper establishes a theoretical analysis of the proposed class of MBOL methods, showing essential performance conditions and convergence rates. This theoretical analysis is critical for understanding the potential of MBOL in active waveform optimization tasks. We demonstrate the proposed MBOL framework in multicarrier ISAC systems, focusing on the sub-carrier selection and power allocation problem. Via numerical experiments, we show that the proposed MBOL method outperforms the MFOL method in terms of sample efficiency. The results underline the potential of MBOL for improving the active waveform optimization performance in ISAC systems, particularly when sample efficiency and explainability are critical.
KW - Interference
KW - joint radar-communications systems
KW - Markov decision processes
KW - model-based learning
KW - online convex optimization
KW - Radar
KW - reinforcement learning
KW - resource allocation
KW - Resource management
KW - Sensors
KW - Signal processing algorithms
KW - Task analysis
KW - waveform optimization
UR - http://www.scopus.com/inward/record.url?scp=85190169769&partnerID=8YFLogxK
U2 - 10.1109/JSTSP.2024.3386057
DO - 10.1109/JSTSP.2024.3386057
M3 - Article
AN - SCOPUS:85190169769
SN - 1932-4553
SP - 1
EP - 15
JO - IEEE Journal on Selected Topics in Signal Processing
JF - IEEE Journal on Selected Topics in Signal Processing
ER -