research
∙
05/28/2023
An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translation
Sign language translation systems are complex and require many component...
share
research
∙
05/24/2023
ChatGPT and Simple Linguistic Inferences: Blind Spots and Blinds
This paper sheds light on the limitations of ChatGPT's understanding cap...
research
∙
05/04/2023
Conformal Nucleus Sampling
Language models generate text based on successively sampling the next wo...
research
∙
03/07/2023
At Your Fingertips: Extracting Piano Fingering Instructions from Videos
Piano fingering – knowing which finger to use to play each note in a mus...
research
∙
10/19/2022
DALLE-2 is Seeing Double: Flaws in Word-to-Concept Mapping in Text2Image Models
We study the way DALLE-2 maps symbols (words) in the prompt to their ref...
research
∙
09/09/2022
F-COREF: Fast, Accurate and Easy to Use Coreference Resolution
We introduce fastcoref, a python package for fast, accurate, and easy-to...
research
∙
07/28/2022
Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions
Large amounts of training data are one of the major reasons for the high...
research
∙
01/27/2022
Diagnosing AI Explanation Methods with Folk Concepts of Behavior
When explaining AI behavior to humans, how is the communicated informati...
research
∙
06/30/2021
On the Power of Saturated Transformers: A View from Circuit Complexity
Transformers have become a standard architecture for many NLP problems. ...
research
∙
06/18/2021
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
We show that with small-to-medium training data, fine-tuning only the bi...
research
∙
06/13/2021
Thinking Like Transformers
What is the computational model behind a Transformer? Where recurrent ne...
research
∙
05/14/2021
Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction
When language models process syntactically complex sentences, do they us...
research
∙
10/19/2020
Parameter Norm Growth During Training of Transformers
The capacity of neural networks like the widely adopted transformer is k...
research
∙
05/07/2020
Nakdan: Professional Hebrew Diacritizer
We present a system for automatic diacritization of Hebrew text. The sys...
research
∙
04/18/2020
A Formal Hierarchy of RNN Architectures
We develop a formal hierarchy of the expressive capacity of RNN architec...
research
∙
04/16/2020
Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection
The ability to control for the kinds of information encoded in neural re...
research
∙
02/16/2019
A Little Is Enough: Circumventing Defenses For Distributed Learning
Distributed learning is central for large-scale training of deep-learnin...
research
∙
01/16/2019
Assessing BERT's Syntactic Abilities
I assess the extent to which the recently introduced BERT model captures...
research
∙
01/15/2017
DyNet: The Dynamic Neural Network Toolkit
We describe DyNet, a toolkit for implementing neural network models base...
research
∙
02/15/2014
