research
∙
08/14/2023
OctoPack: Instruction Tuning Code Large Language Models
Finetuning large language models (LLMs) on instructions leads to vast pe...
share
research
∙
05/24/2023
Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts
The explosive growth of language models and their applications have led ...
research
∙
05/22/2023
A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, Toxicity
Pretraining is the preliminary and fundamental step in developing capabl...
research
∙
03/07/2023
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
As language models grow ever larger, the need for large-scale high-quali...
research
∙
01/31/2023
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
We study the design decisions of publicly available instruction tuning m...
research
∙
08/20/2022
Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks
Quantization, knowledge distillation, and magnitude pruning are among th...
research
∙
02/01/2022
Active Learning Over Multiple Domains in Natural Language Tasks
Studies of active learning traditionally assume the target and source da...
research
∙
09/10/2021
Entity-Based Knowledge Conflicts in Question Answering
Knowledge-dependent tasks typically use two sources of knowledge: parame...
research
∙
06/12/2021
Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP
Retrieval is a core component for open-domain NLP tasks. In open-domain ...
research
∙
02/17/2021
Leveraging Query Resolution and Reading Comprehension for Conversational Passage Retrieval
This paper describes the participation of UvA.ILPS group at the TREC CAs...
research
∙
01/19/2021
A Comparison of Question Rewriting Methods for Conversational Passage Retrieval
Conversational passage retrieval relies on question rewriting to modify ...
research
∙
12/28/2020
Pivot Through English: Reliably Answering Multilingual Questions without Document Retrieval
Existing methods for open-retrieval question answering in lower resource...
research
∙
10/13/2020
A Wrong Answer or a Wrong Question? An Intricate Relationship between Question Reformulation and Answer Selection in Conversational Question Answering
The dependency between an adequate question formulation and correct answ...
research
∙
10/10/2020
Open-Domain Question Answering Goes Conversational via Question Rewriting
We introduce a new dataset for Question Rewriting in Conversational Cont...
research
∙
10/05/2020
How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers?
Task-agnostic forms of data augmentation have proven widely effective in...
research
∙
09/17/2020
On the Transferability of Minimal Prediction Preserving Inputs in Question Answering
Recent work (Feng et al., 2018) establishes the presence of short, unint...
research
∙
07/30/2020
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering
Progress in cross-lingual modeling depends on challenging, realistic, an...
research
∙
04/30/2020
Question Rewriting for Conversational Question Answering
Conversational question answering (QA) requires answers conditioned on t...
research
∙
12/04/2019
An Exploration of Data Augmentation and Sampling Techniques for Domain-Agnostic Question Answering
To produce a domain-agnostic question answering model for the Machine Re...
research
∙
11/16/2016