research
∙
02/17/2022
Designing Effective Sparse Expert Models
Scale has opened new frontiers in natural language processing – but at a...
share
research
∙
09/03/2021
Revisiting 3D ResNets for Video Recognition
A recent work from Bello shows that training and scaling strategies may ...
research
∙
03/13/2021
Revisiting ResNets: Improved Training and Scaling Strategies
Novel computer vision architectures monopolize the spotlight, but the im...
research
∙
02/17/2021
LambdaNetworks: Modeling Long-Range Interactions Without Attention
We present lambda layers – an alternative framework to self-attention – ...
research
∙
10/06/2020
Global Self-Attention Networks for Image Recognition
Recently, a series of works in computer vision have shown promising resu...
research
∙
06/13/2019
Stand-Alone Self-Attention in Vision Models
Convolutions are a fundamental building block of modern computer vision ...
research
∙
04/22/2019
Attention Augmented Convolutional Networks
Convolutional networks have been the paradigm of choice in many computer...
research
∙
10/04/2018
Seq2Slate: Re-ranking and Slate Optimization with RNNs
Ranking is a central task in machine learning and information retrieval....
research
∙
08/08/2018
Backprop Evolution
The back-propagation algorithm is the cornerstone of deep learning. Desp...
research
∙
09/21/2017
Neural Optimizer Search with Reinforcement Learning
We present an approach to automate the process of discovering optimizati...
research
∙
11/29/2016