research
∙
09/21/2023
The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"
We expose a surprising failure of generalization in auto-regressive larg...
share
research
∙
09/01/2023
Taken out of context: On measuring situational awareness in LLMs
We aim to better understand the emergence of `situational awareness' in ...
research
∙
05/23/2022
When does Parameter-Efficient Transfer Learning Work for Machine Translation?
Parameter-efficient fine-tuning methods (PEFTs) offer the promise of ada...
research
∙
10/18/2021
Multilingual Domain Adaptation for NMT: Decoupling Language and Domain Information with Adapters
Adapter layers are lightweight, learnable units inserted between transfo...
research
∙
09/28/2020
Deep Transformers with Latent Depth
The Transformer model has achieved state-of-the-art performance in many ...
research
∙
07/08/2020
Diverse Ensembles Improve Calibration
Modern deep neural networks can produce badly calibrated predictions, es...
research
∙
04/30/2020
Recipes for Adapting Pre-trained Monolingual and Multilingual Models to Machine Translation
There has been recent success in pre-training on monolingual data and fi...
research
∙
02/07/2019