A multi-armed bandit framework for online optimization in green integrated terrestrial and non-terrestrial networks

Alam, Henri; De Domenico, Antonio; Si Salem, Tareq; Kaltenberger, Florian
SPAWC 2025, 26th IEEE International Workshop on Signal Processing and Artificial Intelligence for Wireless Communications, 7-10 July 2025, Surrey, UK

Integrated terrestrial and non-terrestrial network (TN-NTN) architectures offer a promising solution for expanding coverage and improving capacity for the network. While nonterrestrial networks (NTNs) are primarily exploited for these specific reasons, their role in alleviating terrestrial network (TN) load and enabling energy-efficient operation has received comparatively less attention. In light of growing concerns associated with the densification of terrestrial deployments, this work aims to explore the potential of NTNs in supporting a more sustainable network. In this paper, we propose a novel online optimisation framework for integrated TN-NTN architectures, built on a multi-armed bandit (MAB) formulation and leveraging the Bandit-feedback Constrained Online Mirror Descent (BCOMD) algorithm. Our approach adaptively optimises key system parameters— including bandwidth allocation, user equipment (UE) association, and macro base station (MBS) shutdown—to balance network capacity and energy efficiency in real time. Extensive system-level simulations over a 24-hour period show that our framework significantly reduces the proportion of unsatisfied UEs during peak hours and achieves up to 19 % throughput gains and 5 % energy savings in low-traffic periods, outperforming
standard network settings following 3GPP recommendations.

Type:
Conference
City:
Surrey
Date:
2025-07-07
Department:
Communication systems
Eurecom Ref:
8266
Copyright:
© 2025 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

PERMALINK : https://www.eurecom.fr/publication/8266