Arvind Mahankali | DeepAI

DeepAI

AI Chat AI Image Generator AI Video AI Music Voice Chat Ghibli AI

Featured Co-authors

Tengyu Ma
97 publications
Tatsunori B. Hashimoto
19 publications
Kefan Dong
13 publications
Jeff Z. HaoChen
12 publications
Margalit Glasgow
6 publications

research

∙ 07/07/2023

One Step of Gradient Descent is Provably the Optimal In-Context Learner with One Layer of Linear Self-Attention

Recent works have empirically analyzed in-context learning and shown tha...

0 Arvind Mahankali, et al. ∙

research

∙ 06/28/2023

Beyond NTK with Vanilla Gradient Descent: A Mean-Field Analysis of Neural Networks with Polynomial Width, Samples, and Time

Despite recent theoretical progress on the non-convex optimization of tw...

0 Arvind Mahankali, et al. ∙