research
∙
05/25/2019
Kernel Truncated Randomized Ridge Regression: Optimal Rates and Low Noise Acceleration
In this paper, we consider the nonparametric least square regression in ...
share
research
∙
05/24/2019
Momentum-Based Variance Reduction in Non-Convex SGD
Variance reduction has emerged in recent years as a strong competitor to...
research
∙
02/05/2019
Parameter-free Online Convex Optimization with Sub-Exponential Noise
We consider the problem of unconstrained online convex optimization (OCO...
research
∙
01/25/2019
Surrogate Losses for Online Learning of Stepsizes in Stochastic Non-Convex Optimization
Stochastic Gradient Descent (SGD) has played a central role in machine l...
research
∙
05/21/2018
On the Convergence of Stochastic Gradient Descent with Adaptive Stepsizes
Stochastic gradient descent is the method of choice for large scale opti...
research
∙
02/17/2018
Black-Box Reductions for Parameter-free Online Learning in Banach Spaces
We introduce several new black-box reductions that significantly improve...
research
∙
11/06/2017
Online Learning for Changing Environments using Coin Betting
A key challenge in online learning is that classical algorithms can be s...
research
∙
05/22/2017
Training Deep Networks without Learning Rates Through Coin Betting
Deep learning methods achieve state-of-the-art performance in many appli...
research
∙
02/25/2017
Efficient Online Bandit Multiclass Learning with Õ(√(T)) Regret
We present an efficient second-order algorithm with Õ(1/η√(T)) regret fo...
research
∙
10/14/2016
Improved Strongly Adaptive Online Learning using Coin Betting
This paper describes a new parameter-free online learning algorithm for ...
research
∙
02/10/2016
High Dimensional Inference with Random Maximum A-Posteriori Perturbations
This paper presents a new approach, called perturb-max, for high-dimensi...
research
∙
11/06/2015
Optimal Non-Asymptotic Lower Bound on the Minimax Regret of Learning with Expert Advice
We prove non-asymptotic lower bounds on the expectation of the maximum o...
research
∙
08/20/2015
The ABACOC Algorithm: a Novel Approach for Nonparametric Classification of Data Streams
Stream mining poses unique challenges to machine learning: predictive mo...
research
∙
08/06/2014