research
∙
05/15/2023
C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models
New NLP benchmarks are urgently needed to align with the rapid developme...
share
research
∙
05/03/2023
Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models
Sharding a large machine learning model across multiple devices to balan...
research
∙
10/18/2020
Fast Distributed Training of Deep Neural Networks: Dynamic Communication Thresholding for Model and Data Parallelism
Data Parallelism (DP) and Model Parallelism (MP) are two common paradigm...
research
∙
04/16/2020