research
∙
05/28/2022
Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers
Sparsely activated transformers, such as Mixture of Experts (MoE), have ...
share
research
∙
05/19/2022
Transformer with Memory Replay
Transformers achieve state-of-the-art performance for natural language p...
research
∙
10/24/2020
Adam with Bandit Sampling for Deep Learning
Adam is a widely used optimization method for training deep learning mod...
research
∙
12/07/2019
Joins on Samples: A Theoretical Guide for Practitioners
Despite decades of research on approximate query processing (AQP), our u...
research
∙
12/26/2018
QuickSel: Quick Selectivity Learning with Mixture Models
Estimating the selectivity of a query is a key step in almost any cost-b...
research
∙
12/26/2018
BlinkML: Efficient Maximum Likelihood Estimation with Probabilistic Guarantees
The rising volume of datasets has made training machine learning (ML) mo...
research
∙
12/15/2018
A Bandit Approach to Maximum Inner Product Search
There has been substantial research on sub-linear time approximate algor...
research
∙
11/14/2018
Revisiting Projection-Free Optimization for Strongly Convex Constraint Sets
We revisit the Frank-Wolfe (FW) optimization under strongly convex const...
research
∙
04/03/2018