research
∙
08/31/2023
Transformers as Support Vector Machines
Since its inception in "Attention Is All You Need", transformer architec...
share
research
∙
06/23/2023
Max-Margin Token Selection in Attention Mechanism
Attention mechanism is a central component of the transformer architectu...
research
∙
05/30/2023
Dissecting Chain-of-Thought: A Study on Compositional In-Context Learning of MLPs
Chain-of-thought (CoT) is a method that enables language models to handl...
research
∙
03/08/2023
Provable Pathways: Learning Multiple Tasks over Multiple Paths
Constructing useful representations across a large number of tasks is a ...
research
∙
02/02/2023
Stochastic Contextual Bandits with Long Horizon Rewards
The growing interest in complex decision-making and language modeling pr...
research
∙
01/17/2023
Transformers as Algorithms: Generalization and Implicit Model Selection in In-context Learning
In-context learning (ICL) is a type of prompting where a transformer mod...
research
∙
05/19/2022
Confident Clustering via PCA Compression Ratio and Its Application to Single-cell RNA-seq Analysis
Unsupervised clustering algorithms for vectors has been widely used in t...
research
∙
03/03/2022
Provable and Efficient Continual Representation Learning
In continual learning (CL), the goal is to design models that can learn ...
research
∙
12/16/2020