FedHeN: Federated Learning in Heterogeneous Networks

07/07/2022

∙

by   Durmus Alp Emre Acar, et al.

∙

0

∙

share

We propose a novel training recipe for federated learning with heterogeneous networks where each device can have different architectures. We introduce training with a side objective to the devices of higher complexities to jointly train different architectures in a federated setting. We empirically show that our approach improves the performance of different architectures and leads to high communication savings compared to the state-of-the-art methods.