Learning to rest: A Q-learning approach to flying base station trajectory design with landing spots

This talk considers the problem of trajectory optimization for an autonomous UAV-mounted base station that provides communication services to ground users with the aid of landing spots (LSs). Recently, the concept of LSs was introduced to alleviate the problem of short mission durations arising from the limited on-board battery budget of the UAV, which severely limits network performance. In this work, using Q-learning, a model-free reinforcement learning (RL) technique, a neural network (NN) was trained to make movement decisions for the UAV that maximize the data collected from the ground users while minimizing power consumption by exploiting the landing spots. The system is thus able to intelligently integrate landing spots into the trajectory to extend flying time without any explicit information about the environment.