research
∙
08/17/2023
Reinforced Self-Training (ReST) for Language Modeling
Reinforcement learning from human feedback (RLHF) can improve the qualit...
share
research
∙
05/22/2023
SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluation
Reliable automatic evaluation of summarization systems is challenging du...
research
∙
11/02/2022
Dialect-robust Evaluation of Generated Text
Evaluation metrics that are not robust to dialect variation make it impo...
research
∙
05/09/2022
Building Machine Translation Systems for the Next Thousand Languages
In this paper we share findings from our effort to build practical machi...
research
∙
01/09/2022
Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning
Achieving universal translation between all human language pairs is the ...
research
∙
12/16/2021
DOCmT5: Document-Level Pretraining of Multilingual Language Models
In this paper, we introduce DOCmT5, a multilingual sequence-to-sequence ...
research
∙
06/03/2021
nmT5 – Is parallel data still relevant for pre-training massively multilingual language models?
Recently, mT5 - a massively multilingual version of T5 - leveraged a uni...
research
∙
04/15/2021
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation
Machine learning has brought striking advances in multilingual natural l...
research
∙
01/21/2021
Distilling Large Language Models into Tiny and Effective Students using pQRNN
Large pre-trained multilingual models like mBERT, XLM-R achieve state of...
research
∙
10/22/2020
mT5: A massively multilingual pre-trained text-to-text transformer
The recent "Text-to-Text Transfer Transformer" (T5) leveraged a unified ...
research
∙
10/15/2020
Explicit Alignment Objectives for Multilingual Bidirectional Encoders
Pre-trained cross-lingual encoders such as mBERT (Devlin et al., 2019) a...
research
∙
09/23/2020
Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages
Unsupervised translation has reached impressive performance on resource-...
research
∙
05/11/2020
Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation
Over the last few years two promising research directions in low-resourc...
research
∙
03/24/2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization
Much recent progress in applications of machine learning models to NLP h...
research
∙
09/01/2019
Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation
The recently proposed massively multilingual neural machine translation ...
research
∙
06/28/2019
Supervised Contextual Embeddings for Transfer Learning in Natural Language Processing Tasks
Pre-trained word embeddings are the primary method for transfer learning...
research
∙
11/19/2018
VoCoG: An Intelligent, Non-Intrusive Assistant for Voice-based Collaborative Group-Viewing
There have been significant innovations in media technologies in the rec...
research
∙
11/13/2018
Unsupervised Transfer Learning for Spoken Language Understanding in Intelligent Agents
User interaction with voice-powered agents generates large amounts of un...
research
∙
08/16/2018
Deep Bayesian Active Learning for Natural Language Processing: Results of a Large-Scale Empirical Study
Several recent papers investigate Active Learning (AL) for mitigating th...
research
∙
12/25/2017