research
∙
05/23/2022
Parameter-Efficient Sparsity for Large Language Models Fine-Tuning
With the dramatically increased number of parameters in language models,...
share
research
∙
05/11/2022
Towards Unified Prompt Tuning for Few-shot Text Classification
Prompt-based fine-tuning has boosted the performance of Pre-trained Lang...
research
∙
04/17/2022
On Effectively Learning of Knowledge in Continual Pre-training
Pre-trained language models (PLMs) like BERT have made significant progr...
research
∙
04/06/2022
Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency
Structured pruning has been extensively studied on monolingual pre-train...
research
∙
04/01/2022
Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning
Pre-trained Language Models (PLMs) have achieved remarkable performance ...
research
∙
12/14/2021
From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression
Pre-trained Language Models (PLMs) have achieved great success in variou...
research
∙
09/13/2021
Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning
Recent pretrained language models extend from millions to billions of pa...
research
∙
03/14/2021
SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels
Vision-language pre-training (VLP) on large-scale image-text pairs has r...
research
∙
10/30/2020
VECO: Variable Encoder-decoder Pre-training for Cross-lingual Understanding and Generation
Recent studies about learning multilingual representations have achieved...
research
∙
10/13/2020
CAPT: Contrastive Pre-Training for LearningDenoised Sequence Representations
Pre-trained self-supervised models such as BERT have achieved striking s...
research
∙
09/27/2020
Inductively Representing Out-of-Knowledge-Graph Entities by Optimal Estimation Under Translational Assumptions
Conventional Knowledge Graph Completion (KGC) assumes that all test enti...
research
∙
10/24/2019
Pun-GAN: Generative Adversarial Network for Pun Generation
In this paper, we focus on the task of generating a pun sentence given a...
research
∙
06/05/2019
A Hierarchical Reinforced Sequence Operation Method for Unsupervised Text Style Transfer
Unsupervised text style transfer aims to alter text styles while preserv...
research
∙
05/24/2019
A Dual Reinforcement Learning Framework for Unsupervised Text Style Transfer
Unsupervised text style transfer aims to transfer the underlying style o...
research
∙
11/01/2018
Learning Unsupervised Word Mapping by Maximizing Mean Discrepancy
Cross-lingual word embeddings aim to capture common linguistic regularit...
research
∙
05/21/2018