research
∙
02/03/2023
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
We propose a new class of linear Transformers called FourierLearner-Tran...
share
research
∙
02/02/2023
Efficient Graph Field Integrators Meet Point Clouds
We present two new classes of algorithms for efficient field integration...
research
∙
02/01/2023
FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features
The problem of efficient approximation of a linear operator induced by t...
research
∙
11/22/2022
Generalized Private Selection and Testing with High Confidence
Composition theorems are general and powerful tools that facilitate priv...
research
∙
11/11/2022
Õptimal Differentially Private Learning of Thresholds and Quasi-Concave Optimization
The problem of learning threshold functions is a fundamental one in mach...
research
∙
07/03/2022
Tricking the Hashing Trick: A Tight Lower Bound on the Robustness of CountSketch to Adaptive Inputs
CountSketch and Feature Hashing (the "hashing trick") are popular random...
research
∙
05/30/2022
Chefs' Random Tables: Non-Trigonometric Random Features
We introduce chefs' random tables (CRTs), a new class of non-trigonometr...
research
∙
02/28/2022
On the Robustness of CountSketch to Adaptive Inputs
CountSketch is a popular dimensionality reduction technique that maps ve...
research
∙
01/19/2021
ES-ENAS: Combining Evolution Strategies with Neural Architecture Search at No Extra Cost for Reinforcement Learning
We introduce ES-ENAS, a simple neural architecture search (NAS) algorith...
research
∙
10/25/2020
Differentially Private Weighted Sampling
Common datasets have the form of elements with keys (e.g., transactions ...
research
∙
09/30/2020
Rethinking Attention with Performers
We introduce Performers, Transformer architectures which can estimate re...
research
∙
06/05/2020
Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers
Transformer models have achieved state-of-the-art results across a diver...
research
∙
03/30/2020
Stochastic Flows and Geometric Optimization on the Orthogonal Group
We present a new class of stochastic, geometrically-driven optimization ...
research
∙
07/10/2019
Reinforcement Learning with Chromatic Networks
We present a new algorithm for finding compact neural networks encoding ...
research
∙
05/29/2019
Matrix-Free Preconditioning in Online Learning
We provide an online convex optimization algorithm with regret that inte...
research
∙
03/09/2019
Orthogonal Estimation of Wasserstein Distances
Wasserstein distances are increasingly used in a wide variety of applica...
research
∙
04/05/2017
Linear Additive Markov Processes
We introduce LAMP: the Linear Additive Markov Process. Transitions in LA...
research
∙
05/29/2016