research
∙
03/30/2022
Transformer Language Models without Positional Encodings Still Learn Positional Information
Transformers typically require some form of positional encoding, such as...
share
research
∙
04/15/2021
How to Train BERT with an Academic Budget
While large language models à la BERT are used ubiquitously in NLP, pret...
research
∙
10/14/2019
Training Compact Models for Low Resource Entity Tagging using Pre-trained Language Models
Training models on low-resource named entity recognition tasks has been ...
research
∙
10/14/2019
Q8BERT: Quantized 8Bit BERT
Recently, pre-trained Transformer based language models such as BERT and...
research
∙
08/27/2018
Term Set Expansion based NLP Architect by Intel AI Lab
We present SetExpander, a corpus-based system for expanding a seed set o...
research
∙
07/26/2018