research
∙
08/31/2023
SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills
Large Language Model (LLM) inference consists of two distinct phases - p...
share
research
∙
07/10/2022
NGAME: Negative Mining-aware Mini-batching for Extreme Classification
Extreme Classification (XC) seeks to tag data points with the most relev...
research
∙
11/07/2021
Varuna: Scalable, Low-cost Training of Massive Deep Learning Models
Systems for training massive deep learning models (billions of parameter...
research
∙
05/30/2021
LRTuner: A Learning Rate Tuner for Deep Neural Networks
One very important hyperparameter for training deep neural networks is t...
research
∙
03/09/2020
Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule
While the generalization properties of neural networks are not yet well ...
research
∙
10/01/2018