research
∙
02/15/2023
Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation
Large language models (LLMs) demonstrate remarkable machine translation ...
share
research
∙
02/04/2023
Representation Deficiency in Masked Language Modeling
Masked Language Modeling (MLM) has been one of the most prominent approa...
research
∙
01/25/2023
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
Large multilingual language models typically rely on a single vocabulary...
research
∙
12/05/2022
In-context Examples Selection for Machine Translation
Large-scale generative models show an impressive ability to perform a wi...
research
∙
04/25/2022
Natural Language to Code Translation with Execution
Generative models of code, pretrained on large corpora of programs, have...
research
∙
04/12/2022
A Review on Language Models as Knowledge Bases
Recently, there has been a surge of interest in the NLP community on the...
research
∙
12/10/2021
Discourse-Aware Prompt Design for Text Generation
Current efficient fine-tuning methods (e.g., adapters, prefix-tuning, et...
research
∙
11/12/2021
BitextEdit: Automatic Bitext Editing for Improved Low-Resource Machine Translation
Mined bitexts can contain imperfect translations that yield unreliable t...
research
∙
09/09/2021
Distributionally Robust Multilingual Machine Translation
Multilingual neural machine translation (MNMT) learns to translate multi...
research
∙
06/12/2021
Prompting Contrastive Explanations for Commonsense Reasoning Tasks
Many commonsense reasoning NLP tasks involve choosing between one or mor...
research
∙
05/14/2021
EASE: Extractive-Abstractive Summarization with Explanations
Current abstractive summarization systems outperform their extractive co...
research
∙
04/11/2021
Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog
Semantic parsing using sequence-to-sequence models allows parsing of dee...
research
∙
11/05/2020
Detecting Hallucinated Content in Conditional Neural Sequence Generation
Neural sequence models can generate highly fluent sentences but recent s...
research
∙
10/24/2020
Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentation
Models pretrained with self-supervised objectives on large text corpora ...
research
∙
08/03/2020
DeLighT: Very Deep and Light-weight Transformer
We introduce a very deep and light-weight transformer, DeLighT, that del...
research
∙
06/26/2020
Pre-training via Paraphrasing
We introduce MARGE, a pre-trained sequence-to-sequence model learned wit...
research
∙
04/30/2020
Recipes for Adapting Pre-trained Monolingual and Multilingual Models to Machine Translation
There has been recent success in pre-training on monolingual data and fi...
research
∙
04/03/2020
Aligned Cross Entropy for Non-Autoregressive Machine Translation
Non-autoregressive machine translation models significantly speed up dec...
research
∙
01/23/2020
Semi-Autoregressive Training Improves Mask-Predict Decoding
The recently proposed mask-predict decoding algorithm has narrowed the p...
research
∙
01/22/2020
Multilingual Denoising Pre-training for Neural Machine Translation
This paper demonstrates that multilingual denoising pre-training produce...
research
∙
01/15/2020
Parallel Machine Translation with Disentangled Context Transformer
State-of-the-art neural machine translation models generate a translatio...
research
∙
10/29/2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
We present BART, a denoising autoencoder for pretraining sequence-to-seq...
research
∙
06/11/2019
Translating Translationese: A Two-Step Approach to Unsupervised Machine Translation
Given a rough, word-by-word gloss of a source language sentence, target ...
research
∙
04/19/2019
Constant-Time Machine Translation with Conditional Masked Language Models
Most machine translation systems generate text autoregressively, by sequ...
research
∙
02/05/2019
Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation
We consider the problem of making machine translation more robust to cha...
research
∙
02/07/2017