research
∙
06/21/2023
OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents
Large multimodal models trained on natural documents, which interleave i...
share
research
∙
10/27/2022
What Language Model to Train if You Have One Million GPU Hours?
The crystallization of modeling methods around the Transformer architect...
research
∙
08/16/2022
Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models
State-of-the-art neural language models can now be used to solve ad-hoc ...
research
∙
02/02/2022
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts
PromptSource is a system for creating, sharing, and using natural langua...
research
∙
10/15/2021
Multitask Prompted Training Enables Zero-Shot Task Generalization
Large language models have recently been shown to attain reasonable zero...
research
∙
09/10/2021
Block Pruning For Faster Transformers
Pre-training has improved model accuracy for both classification and gen...
research
∙
09/09/2021
Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning
Recent prompt-based approaches allow pretrained language models to achie...
research
∙
09/07/2021
Datasets: A Community Library for Natural Language Processing
The scale, variety, and quantity of publicly-available NLP datasets has ...
research
∙
04/08/2021
Low-Complexity Probing via Finding Subnetworks
The dominant approach in probing neural networks for linguistic properti...
research
∙
12/02/2020
Learning from others' mistakes: Avoiding dataset biases without modeling them
State-of-the-art natural language processing (NLP) models often learn to...
research
∙
11/28/2020
EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inference
Transformer-based language models such as BERT provide significant accur...
research
∙
05/15/2020
Movement Pruning: Adaptive Sparsity by Fine-Tuning
Magnitude pruning is a widely used strategy for reducing model size in p...
research
∙
10/09/2019
HuggingFace's Transformers: State-of-the-art Natural Language Processing
Recent advances in modern Natural Language Processing (NLP) research hav...
research
∙
10/09/2019
Transformers: State-of-the-art Natural Language Processing
Recent advances in modern Natural Language Processing (NLP) research hav...
research
∙
10/02/2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
As Transfer Learning from large-scale pre-trained models becomes more pr...
research
∙
01/23/2019
TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents
We introduce a new approach to generative data-driven dialogue systems (...
research
∙
11/14/2018