research
∙
06/28/2022
TPU-KNN: K Nearest Neighbor Search at Peak FLOP/s
This paper presents a novel nearest neighbor search algorithm achieving ...
share
research
∙
02/02/2022
Unified Scaling Laws for Routed Language Models
The performance of a language model has been shown to be effectively mod...
research
∙
05/10/2021
GSPMD: General and Scalable Parallelization for ML Computation Graphs
We present GSPMD, an automatic, compiler-based parallelization system fo...
research
∙
03/23/2021
Scaling Local Self-Attention For Parameter Efficient Visual Backbones
Self-attention has the promise of improving computer vision systems due ...
research
∙
11/07/2020
Exploring the limits of Concurrency in ML Training on Google TPUs
Recent results in language understanding using neural networks have requ...
research
∙
04/28/2020
Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Training
In data-parallel synchronous training of deep neural networks, different...
research
∙
02/09/2020
Large-Scale Discrete Fourier Transform on TPUs
In this work, we present two parallel algorithms for the large-scale dis...
research
∙
09/21/2019
Scale MLPerf-0.6 models on Google TPU-v3 Pods
The recent submission of Google TPU-v3 Pods to the industry wide MLPerf ...
research
∙
11/05/2018