research
∙
02/09/2022
pNLP-Mixer: an Efficient all-MLP Architecture for Language
Large pre-trained language models drastically changed the natural langua...
share
research
∙
11/06/2021
EEGEyeNet: a Simultaneous Electroencephalography and Eye-tracking Dataset and Benchmark for Eye Movement Prediction
We present a new dataset and benchmark with the goal of advancing resear...
research
∙
09/27/2021
On Isotropy Calibration of Transformers
Different studies of the embedding space of transformer models suggest t...
research
∙
09/20/2021
A Plug-and-Play Method for Controlled Text Generation
Large pre-trained language models have repeatedly shown their ability to...
research
∙
09/15/2021
BERT is Robust! A Case Against Synonym-Based Adversarial Examples in Text Classification
Deep Neural Networks have taken Natural Language Processing by storm. Wh...
research
∙
04/14/2021
Towards BERT-based Automatic ICD Coding: Limitations and Opportunities
Automatic ICD coding is the task of assigning codes from the Internation...
research
∙
01/12/2021
Of Non-Linearity and Commutativity in BERT
In this work we provide new insights into the transformer architecture, ...
research
∙
12/31/2020
Directed Beam Search: Plug-and-Play Lexically Constrained Language Generation
Large pre-trained language models are capable of generating realistic te...
research
∙
09/10/2020
Brain2Word: Decoding Brain Activity for Language Generation
Brain decoding, understood as the process of mapping brain activities to...
research
∙
08/25/2020
Medley2K: A Dataset of Medley Transitions
The automatic generation of medleys, i.e., musical pieces formed by diff...
research
∙
04/10/2020
Telling BERT's full story: from Local Attention to Global Aggregation
We take a deep look into the behavior of self-attention heads in the tra...
research
∙
08/12/2019
On the Validity of Self-Attention as Explanation in Transformer Models
Explainability of deep learning systems is a vital requirement for many ...
research
∙
07/22/2019