Encoded representations from a pretrained deep learning model (e.g., BER...
We propose a self-supervised learning method for long text documents bas...
The recent advances in representation learning inspire us to take on the...
Contextualized word embeddings can lead to state-of-the-art performances...
A Lite BERT (ALBERT) has been introduced to scale up deep bidirectional
...
In zero-shot cross-lingual transfer, a supervised NLP task trained on a
...
Contextualized representations from a pre-trained language model are cen...
This paper introduces SelfMatch, a semi-supervised learning method that
...