User-centric federated learning

Mestoukirdi, Mohamad; Zecchin, Matteo; Gesbert, David; Li, Qianrui; Gresset, Nicolas
WCDI 2021, GLOBECOM Workshop on Wireless Communication for Distributed Intelligence, 7-11 December 2021, Madrid, Spain

Data heterogeneity across participating devices poses one of the main challenges in federated learning as it has been shown to greatly hamper its convergence time and generalization capabilities. In this work, we address this limitation by enabling personalization using multiple user-centric aggregation rules at the parameter server. Our approach potentially produces a personalized model for each user at the cost of some extra
downlink communication overhead. To strike a trade-off between personalization and communication efficiency, we propose a broadcast protocol that limits the number of personalized streams while retaining the essential advantages of our learning scheme.
Through simulation results, our approach is shown to enjoy higher personalization capabilities, faster convergence, and better communication efficiency compared to other competing baseline solutions.

Type:
Conférence
City:
Madrid
Date:
2021-12-06
Department:
Systèmes de Communication
Eurecom Ref:
6686
Copyright:
© 2021 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

PERMALINK : https://www.eurecom.fr/publication/6686