research
∙
07/25/2023
On the Learning Dynamics of Attention Networks
Attention models are typically learned by optimizing one of three standa...
share
research
∙
12/30/2022
On the Interpretability of Attention Networks
Attention mechanisms form a core component of several successful deep le...
research
∙
10/18/2022
Consistent Multiclass Algorithms for Complex Metrics and Constraints
We present consistent algorithms for multiclass learning with complex pe...
research
∙
11/25/2021
Predicting the success of Gradient Descent for a particular Dataset-Architecture-Initialization (DAI)
Despite their massive success, training successful deep neural networks ...
research
∙
12/16/2020
Using noise resilience for ranking generalization of deep neural networks
Recent papers have shown that sufficiently overparameterized neural netw...
research
∙
10/24/2020
Inductive Bias of Gradient Descent for Exponentially Weight Normalized Smooth Homogeneous Neural Nets
We analyze the inductive bias of gradient descent for weight normalized ...
research
∙
09/16/2020
Convex Calibrated Surrogates for the Multi-Label F-Measure
The F-measure is a widely used performance measure for multi-label class...
research
∙
10/29/2018
On Controllable Sparse Alternatives to Softmax
Converting an n-dimensional vector to a probability distribution over n ...
research
∙
03/08/2016
Mixture Proportion Estimation via Kernel Embedding of Distributions
Mixture proportion estimation (MPE) is the problem of estimating the wei...
research
∙
05/15/2015
Consistent Algorithms for Multiclass Classification with a Reject Option
We consider the problem of n-class classification (n≥ 2), where the clas...
research
∙
01/01/2015