Publications

Semi-synchronous federated learning for energy-efficient training and accelerated convergence in cross-silo settings

Abstract

There are situations where data relevant to machine learning problems are distributed across multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. Machine learning approaches that require data to be copied to a single location are hampered by the challenges of data sharing. Federated Learning (FL) is a promising approach to learn a joint model over all the available data across silos. In many cases, the sites participating in a federation have different data distributions and computational capabilities. In these heterogeneous environments existing approaches exhibit poor performance: synchronous FL protocols are communication efficient, but have slow learning convergence and high energy cost; conversely, asynchronous FL protocols have faster convergence with lower energy cost, but higher communication. In this work, we introduce a novel energy-efficient Semi …

Date
June 21, 2022
Authors
Dimitris Stripelis, Paul M Thompson, José Luis Ambite
Journal
ACM Transactions on Intelligent Systems and Technology (TIST)
Volume
13
Issue
5
Pages
1-29
Publisher
ACM