research
∙
05/28/2022
ByteComp: Revisiting Gradient Compression in Distributed Training
Gradient compression (GC) is a promising approach to addressing the comm...
share
research
∙
07/15/2021
MXDAG: A Hybrid Abstraction for Cluster Applications
Distributed applications, such as database queries and distributed train...
research
∙
04/19/2021
Shufflecast: An Optical, Data-rate Agnostic and Low-Power Multicast Architecture for Next-Generation Compute Clusters
An optical circuit-switched network core has the potential to overcome t...
research
∙
03/28/2021
MergeComp: A Compression Scheduler for Scalable Communication-Efficient Distributed Training
Large-scale distributed training is increasingly becoming communication ...
research
∙
09/28/2020