Optimal number of edge devices in distributed learning over wireless channels

Song, Jaeyoung; Kountouris, Marios
SPAWC 2020, IEEE 21st International Workshop on Signal Processing Advances in Wireless Communications, Special Session on Distributed Learning and Control for Future Wireless Networks, 26-29 May 2020, Atlanta, GA, USA (Virtual Conference)

We consider a distributed learning system, where a parameter server (PS) assigns data and computational tasks to edge devices to build a global model. Distributing data to multiple workers involves communication between PS and edge devices and entails a fundamental tradeoff between computation and communication. In this paper, we aim at characterizing
the optimal number of edge devices required for guaranteeing convergence and for achieving a certain accuracy within a finite time horizon.

DOI
Type:
Conference
City:
Atlanta
Date:
2020-05-26
Department:
Communication systems
Eurecom Ref:
6256
Copyright:
© 2020 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

PERMALINK : https://www.eurecom.fr/publication/6256