research
∙
08/11/2023
Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modeling
Generative language models (LMs) have become omnipresent across data sci...
share
research
∙
08/02/2023
Flows: Building Blocks of Reasoning and Collaborating AI
Recent advances in artificial intelligence (AI) have produced highly cap...
research
∙
05/23/2023
Flexible Grammar-Based Constrained Decoding for Language Models
LLMs have shown impressive few-shot performance across many tasks. Howev...
research
∙
04/04/2023
REFINER: Reasoning Feedback on Intermediate Representations
Language models (LMs) have recently shown remarkable performance on reas...
research
∙
03/07/2023
Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extraction
Large language models (LLMs) show great potential for synthetic data gen...
research
∙
10/13/2022
Language Model Decoding as Likelihood-Utility Alignment
A critical component of a successful language generation pipeline is the...
research
∙
09/18/2022
Distribution inference risks: Identifying and mitigating sources of leakage
A large body of work shows that machine learning (ML) models can leak se...
research
∙
08/31/2022
The Glass Ceiling of Automatic Evaluation in Natural Language Generation
Automatic evaluation metrics capable of replacing human judgments are cr...
research
∙
05/20/2022
Descartes: Generating Short Descriptions of Wikipedia Articles
We introduce and tackle the problem of automatically generating short de...
research
∙
01/17/2022
On the Context-Free Ambiguity of Emoji: A Data-Driven Study of 1,289 Emojis
Emojis come with prepacked semantics making them great candidates to cre...
research
∙
12/15/2021
GenIE: Generative Information Extraction
Structured and grounded representation of text is typically formalized b...
research
∙
10/20/2021
Better than Average: Paired Evaluation of NLP Systems
Evaluation in NLP is usually done by comparing the scores of competing s...
research
∙
10/16/2021
Invariant Language Modeling
Modern pretrained language models are critical components of NLP pipelin...
research
∙
05/19/2021
Laughing Heads: Can Transformers Detect What Makes a Sentence Funny?
The automatic detection of humor poses a grand challenge for natural lan...
research
∙
10/13/2020
KLearn: Background Knowledge Inference from Summarization Data
The goal of text summarization is to compress documents to the relevant ...
research
∙
05/18/2020
Sudden Attention Shifts on Wikipedia Following COVID-19 Mobility Restrictions
We study how the coronavirus disease 2019 (COVID-19) pandemic, alongside...
research
∙
05/05/2020
A Ladder of Causal Distances
Causal discovery, the task of automatically constructing a causal model ...
research
∙
09/05/2019
MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance
A robust evaluation metric has a profound impact on the development of t...
research
∙
03/04/2018
Concatenated p-mean Word Embeddings as Universal Cross-Lingual Sentence Representations
Average word embeddings are a common baseline for more sophisticated sen...
research
∙
02/27/2018
Live Blog Corpus for Summarization
Live blogs are an increasingly popular news format to cover breaking new...
research
∙
01/26/2018