research
∙
06/01/2023
DSGD-CECA: Decentralized SGD with Communication-Optimal Exact Consensus Algorithm
Decentralized Stochastic Gradient Descent (SGD) is an emerging neural ne...
share
research
∙
01/28/2023
Supergeo Design: Generalized Matching for Geographic Experiments
We propose a generalization of the standard matched pairs design in whic...
research
∙
11/08/2021
BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning
Decentralized algorithm is a form of computation that achieves a global ...
research
∙
10/26/2021
Exponential Graph is Provably Efficient for Decentralized Deep Training
Decentralized SGD is an emerging training method for deep learning known...
research
∙
03/26/2019
On the Performance of Exact Diffusion over Adaptive Networks
Various bias-correction methods such as EXTRA, DIGing, and exact diffusi...
research
∙
10/21/2018
Dynamic Average Diffusion with randomized Coordinate Updates
This work derives and analyzes an online learning strategy for tracking ...
research
∙
05/29/2018
Learning Under Distributed Features
This work studies the problem of learning under both large data and larg...
research
∙
03/21/2018
Stochastic Learning under Random Reshuffling
In empirical risk optimization, it has been observed that stochastic gra...
research
∙
01/16/2018
Belief Control Strategies for Interactions over Weak Graphs
In diffusion social learning over weakly-connected graphs, it has been s...
research
∙
08/04/2017
Efficient Variance-Reduced Learning for Fully Decentralized On-Device Intelligence
This work develops a fully decentralized variance-reduced learning algor...
research
∙
08/04/2017
Convergence of Variance-Reduced Stochastic Learning under Random Reshuffling
Several useful variance-reduced stochastic gradient algorithms, such as ...
research
∙
04/20/2017
Performance Limits of Stochastic Sub-Gradient Learning, Part II: Multi-Agent Case
The analysis in Part I revealed interesting properties for subgradient l...
research
∙
03/14/2016
On the Influence of Momentum Acceleration on Online Learning
The article examines in some detail the convergence rate and mean-square...
research
∙
02/24/2016
Online Dual Coordinate Ascent Learning
The stochastic dual coordinate-ascent (S-DCA) technique is a useful alte...
research
∙
11/24/2015