research
∙
08/22/2023
SeamlessM4T-Massively Multilingual Multimodal Machine Translation
What does it take to create the Babel Fish, a tool that can help individ...
share
research
∙
10/27/2022
What Language Model to Train if You Have One Million GPU Hours?
The crystallization of modeling methods around the Transformer architect...
research
∙
06/01/2022
On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting
The availability of large pre-trained models is changing the landscape o...
research
∙
01/25/2022
Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources
In recent years, large-scale data collection efforts have prioritized th...
research
∙
12/10/2021
Sampling from Discrete Energy-Based Models with Quality/Efficiency Trade-offs
Energy-Based Models (EBMs) allow for extremely flexible specifications o...
research
∙
12/01/2021
Controlling Conditional Language Models with Distributional Policy Gradients
Machine learning is shifting towards general-purpose pretrained generati...
research
∙
11/04/2021
Unsupervised and Distributional Detection of Machine-Generated Text
The power of natural language generation models has provoked a flurry of...
research
∙
06/09/2021
Energy-Based Models for Code Generation under Compilability Constraints
Neural language models can be successfully trained on source code, leadi...
research
∙
02/24/2021
References in Wikipedia: The Editors' Perspective
References are an essential part of Wikipedia. Each statement in Wikiped...
research
∙
12/21/2020
A Distributional Approach to Controlled Text Generation
We propose a Distributional Approach to address Controlled Text Generati...
research
∙
10/05/2020
Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages
Research in NLP lacks geographic diversity, and the question of how NLP ...
research
∙
04/30/2020
Self-Supervised and Controlled Multi-Document Opinion Summarization
We address the problem of unsupervised abstractive summarization of coll...
research
∙
03/19/2018
Learning to Generate Wikipedia Summaries for Underserved Languages from Wikidata
While Wikipedia exists in 287 languages, its content is unevenly distrib...
research
∙
02/19/2018
Zero-Shot Question Generation from Knowledge Graphs for Unseen Predicates and Entity Types
We present a neural model for question generation from knowledge base tr...
research
∙
01/22/2018
Unsupervised Open Relation Extraction
We explore methods to extract relations between named entities from free...
research
∙
11/01/2017