Publications
Semi-synchronous federated learning for energy-efficient training and accelerated convergence in cross-silo settings
Abstract
There are situations where data relevant to machine learning problems are distributed across multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. Machine learning approaches that require data to be copied to a single location are hampered by the challenges of data sharing. Federated Learning (FL) is a promising approach to learn a joint model over all the available data across silos. In many cases, the sites participating in a federation have different data distributions and computational capabilities. In these heterogeneous environments existing approaches exhibit poor performance: synchronous FL protocols are communication efficient, but have slow learning convergence and high energy cost; conversely, asynchronous FL protocols have faster convergence with lower energy cost, but higher communication. In this work, we introduce a novel energy-efficient Semi …
- Date
- June 21, 2022
- Authors
- Dimitris Stripelis, Paul M Thompson, José Luis Ambite
- Journal
- ACM Transactions on Intelligent Systems and Technology (TIST)
- Volume
- 13
- Issue
- 5
- Pages
- 1-29
- Publisher
- ACM