research
∙
09/19/2023
Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
With the fast growth of parameter size, it becomes increasingly challeng...
share
research
∙
02/16/2023
Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform
We present Rhino, a system for accelerating tensor programs with automat...
research
∙
09/26/2022
Optimizing DNN Compilation for Distributed Training with Joint OP and Tensor Fusion
This paper proposes DisCo, an automatic deep learning compilation module...
research
∙
03/09/2021
DISC: A Dynamic Shape Compiler for Machine Learning Workloads
Many recent machine learning models show dynamic shape characteristics. ...
research
∙
09/23/2020
FusionStitching: Boosting Memory Intensive Computations for Deep Learning Workloads
We show in this work that memory intensive computations can result in se...
research
∙
07/08/2020
Auto-MAP: A DQN Framework for Exploring Distributed Execution Plans for DNN Workloads
The last decade has witnessed growth in the computational requirements f...
research
∙
07/02/2020