research
∙
08/20/2023
LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
The advent of large language models (LLMs) and their adoption by the leg...
share
research
∙
07/26/2023
Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Models
The quality of training data impacts the performance of pre-trained larg...
research
∙
07/20/2023
Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
Recent work has shown that language models' (LMs) prompt-based learning ...
research
∙
07/14/2023
Fast Algorithms for a New Relaxation of Optimal Transport
We introduce a new class of objectives for optimal transport computation...
research
∙
06/24/2023
H_2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
Large Language Models (LLMs), despite their recent impressive accomplish...
research
∙
06/14/2023
Towards trustworthy seizure onset detection using workflow notes
A major barrier to deploying healthcare AI models is their trustworthine...
research
∙
06/13/2023
TART: A plug-and-play Transformer module for task-agnostic reasoning
Large language models (LLMs) exhibit in-context learning abilities which...
research
∙
04/19/2023
Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes
A long standing goal of the data management community is to develop gene...
research
∙
03/16/2023
Effectively Modeling Time Series with Simple Discrete State Spaces
Time series modeling is a well-established problem, which often requires...
research
∙
03/13/2023
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
The high computational and memory requirements of large language model (...
research
∙
03/01/2023
Collage Diffusion
Text-conditional diffusion models generate high-quality, diverse images....
research
∙
02/21/2023
Hyena Hierarchy: Towards Larger Convolutional Language Models
Recent advances in deep learning have relied heavily on the use of large...
research
∙
02/13/2023
Simple Hardware-Efficient Long Convolutions for Sequence Modeling
State space models (SSMs) have high performance on long sequence modelin...
research
∙
12/28/2022
Hungry Hungry Hippos: Towards Language Modeling with State Space Models
State space models (SSMs) have demonstrated state-of-the-art sequence mo...
research
∙
11/26/2022
Transform Once: Efficient Operator Learning in Frequency Domain
Spectral analysis provides one of the most effective paradigms for infor...
research
∙
11/16/2022
Holistic Evaluation of Language Models
Language models (LMs) are becoming the foundation for almost all major l...
research
∙
10/12/2022
S4ND: Modeling Images and Videos as Multidimensional Signals Using State Spaces
Visual data such as images and videos are typically modeled as discretiz...
research
∙
10/05/2022
Ask Me Anything: A simple strategy for prompting language models
Large language models (LLMs) transfer well to new tasks out-of-the-box s...
research
∙
09/18/2022
HAPI: A Large-scale Longitudinal Dataset of Commercial ML API Predictions
Commercial ML APIs offered by providers such as Google, Amazon and Micro...
research
∙
09/13/2022
LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning
Can foundation models be guided to execute tasks involving legal reasoni...
research
∙
07/14/2022
Contrastive Adapters for Foundation Model Group Robustness
While large pretrained foundation models (FMs) have shown remarkable zer...
research
∙
06/24/2022
How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections
Linear time-invariant state space models (SSM) are a classical model fro...
research
∙
06/23/2022
On the Parameterization and Initialization of Diagonal State Space Models
State space models (SSM) have recently been shown to be very effective a...
research
∙
06/17/2022
The Importance of Background Information for Out of Distribution Generalization
Domain generalization in medical image classification is an important pr...
research
∙
06/02/2022
Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees
Communication compression is a crucial technique for modern distributed ...
research
∙
06/02/2022
Decentralized Training of Foundation Models in Heterogeneous Environments
Training foundation models, such as GPT-3 and PaLM, can be extremely exp...
research
∙
05/31/2022
Comparing interpretation methods in mental state decoding analyses with deep learning models
Deep learning (DL) methods find increasing application in mental state d...
research
∙
05/27/2022
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Transformers are slow and memory-hungry on long sequences, since the tim...
research
∙
05/27/2022
Can Foundation Models Help Us Achieve Perfect Secrecy?
A key promise of machine learning is the ability to assist users with pe...
research
∙
05/20/2022
Can Foundation Models Wrangle Your Data?
Foundation Models (FMs) are models trained on large corpora of data that...
research
∙
04/18/2022
TABi: Type-Aware Bi-Encoders for Open-Domain Entity Retrieval
Entity retrieval–retrieving information about entity mentions in a query...
research
∙
04/15/2022
Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning
An ideal learned representation should display transferability and robus...
research
∙
03/24/2022
Domino: Discovering Systematic Errors with Cross-Modal Embeddings
Machine learning models that achieve high overall accuracy often make sy...
research
∙
03/24/2022
Shoring Up the Foundations: Fusing Model Embeddings and Weak Supervision
Foundation models offer an exciting new paradigm for constructing models...
research
∙
03/14/2022
Reasoning over Public and Private Data in Retrieval-Based Systems
Users and organizations are generating ever-increasing amounts of privat...
research
∙
03/14/2022
SKM-TEA: A Dataset for Accelerated MRI Reconstruction with Dense Image Labels for Quantitative Clinical Evaluation
Magnetic resonance imaging (MRI) is a cornerstone of modern medical imag...
research
∙
03/03/2022
Correct-N-Contrast: A Contrastive Approach for Improving Robustness to Spurious Correlations
Spurious correlations pose a major challenge for robust machine learning...
research
∙
02/20/2022
It's Raw! Audio Generation with State-Space Models
Developing architectures suitable for modeling raw audio is a challengin...
research
∙
12/31/2021
BARACK: Partially Supervised Group Robustness With Guarantees
While neural networks have shown remarkable success on classification ta...
research
∙
11/30/2021
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models
Overparameterized neural networks generalize well but are expensive to t...
research
∙
10/31/2021
Efficiently Modeling Long Sequences with Structured State Spaces
A central goal of sequence modeling is designing a single principled mod...
research
∙
10/28/2021
Scatterbrain: Unifying Sparse and Low-rank Attention Approximation
Recent advances in efficient Transformers have exploited either the spar...
research
∙
10/26/2021
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layers
Recurrent neural networks (RNNs), temporal convolutions, and neural diff...
research
∙
10/16/2021
Metadata Shaping: Natural Language Annotations for the Tail
Language models (LMs) have made remarkable progress, but still struggle ...
research
∙
10/15/2021
Cross-Domain Data Integration for Named Entity Disambiguation in Biomedical Text
Named entity disambiguation (NED), which involves mapping textual mentio...
research
∙
08/16/2021
Challenges for cognitive decoding using deep learning methods
In cognitive decoding, researchers aim to characterize a brain region's ...
research
∙
07/16/2021
Declarative Machine Learning Systems
In the last years machine learning (ML) has moved from a academic endeav...
research
∙
07/01/2021
Mandoline: Model Evaluation under Distribution Shift
Machine learning models are often deployed in different settings than th...
research
∙
06/07/2021
HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projections
This paper studies Principal Component Analysis (PCA) for data lying in ...
research
∙
06/02/2021