research
∙
03/23/2021
Scaling Local Self-Attention For Parameter Efficient Visual Backbones
Self-attention has the promise of improving computer vision systems due ...
share
research
∙
07/13/2020
Revisiting Fundamentals of Experience Replay
Experience replay is central to off-policy algorithms in deep reinforcem...
research
∙
02/07/2020
Revisiting Spatial Invariance with Low-Rank Local Connectivity
Convolutional neural networks are among the most successful architecture...
research
∙
06/13/2019
Stand-Alone Self-Attention in Vision Models
Convolutions are a fundamental building block of modern computer vision ...
research
∙
08/08/2018
Backprop Evolution
The back-propagation algorithm is the cornerstone of deep learning. Desp...
research
∙
10/16/2017
Searching for Activation Functions
The choice of activation functions in deep networks has a significant ef...
research
∙
04/20/2017
Fast Generation for Convolutional Autoregressive Models
Convolutional autoregressive models have recently demonstrated state-of-...
research
∙
11/08/2016
Unsupervised Pretraining for Sequence to Sequence Learning
Sequence to sequence models are successful tools for supervised sequence...
research
∙
02/26/2016