research
∙
06/12/2023
Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergence
Better understanding of Large Language Models' (LLMs) legal analysis abi...
share
research
∙
03/31/2023
Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinations
As large language models (LLMs) gain popularity among speakers of divers...
research
∙
01/19/2023
Batch Prompting: Efficient Inference with Large Language Model APIs
Performing inference on hundreds of thousands of samples with large lang...
research
∙
01/11/2023
NarrowBERT: Accelerating Masked Language Model Pretraining and Inference
Large-scale language model pretraining is a very successful form of self...
research
∙
12/19/2022
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting
The BLOOM model is a large open-source multilingual language model capab...
research
∙
11/07/2022
How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers
The attention mechanism is considered the backbone of the widely-used Tr...
research
∙
10/06/2021
ABC: Attention with Bounded-memory Control
Transformer architectures have achieved state-of-the-art results on a va...
research
∙
07/26/2021
One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval
We present CORA, a Cross-lingual Open-Retrieval Answer Generation model ...
research
∙
03/24/2021
Finetuning Pretrained Transformers into RNNs
Transformers have outperformed recurrent neural networks (RNNs) in natur...
research
∙
01/17/2021
GENIE: A Leaderboard for Human-in-the-Loop Evaluation of Text Generation
Leaderboards have eased model development for many NLP datasets by stand...
research
∙
10/22/2020
XOR QA: Cross-lingual Open-Retrieval Question Answering
Multilingual question answering tasks typically assume answers exist in ...
research
∙
06/18/2020
Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation
State-of-the-art neural machine translation models generate outputs auto...
research
∙
01/15/2020
Parallel Machine Translation with Disentangled Context Transformer
State-of-the-art neural machine translation models generate a translatio...
research
∙
09/19/2019
Low-Resource Parsing with Crosslingual Contextualized Representations
Despite advances in dependency parsing, languages with small treebanks s...
research
∙
09/04/2019
ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networks
Scientific article summarization is challenging: large, annotated corpor...
research
∙
09/04/2019
ScisummNet: A Large Annotated Dataset and Content-Impact Models for Scientific Paper Summarization with Citation Networks
Scientific article summarization is challenging: large, annotated corpor...
research
∙
06/17/2019
Low-resource Deep Entity Resolution with Transfer and Active Learning
Entity resolution (ER) is the task of identifying different representati...
research
∙
03/12/2019
Syntax-aware Neural Semantic Role Labeling with Supertags
We introduce a new syntax-aware model for dependency-based semantic role...
research
∙
02/26/2019
Polyglot Contextual Representations Improve Crosslingual Transfer
We introduce a method to produce multilingual contextual word representa...
research
∙
04/18/2018
End-to-end Graph-based TAG Parsing with Neural Networks
We present a graph-based Tree Adjoining Grammar (TAG) parser that uses B...
research
∙
11/14/2017