research
∙
06/28/2023
SkillNet-X: A Multilingual Multitask Model with Sparsely Activated Skills
Traditional multitask learning methods basically can only exploit common...
share
research
∙
04/26/2023
Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory System
Large-scale Language Models (LLMs) are constrained by their inability to...
research
∙
03/23/2023
Retrieval-Augmented Classification with Decoupled Representation
Pretrained language models (PLMs) have shown marvelous improvements acro...
research
∙
03/20/2023
Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models
Pretrained language models (PLMs) have shown marvelous improvements acro...
research
∙
01/29/2023
Enhancing Dialogue Summarization with Topic-Aware Global- and Local- Level Centrality
Dialogue summarization aims to condense a given dialogue into a simple a...
research
∙
12/16/2022
FewFedWeight: Few-shot Federated Learning Framework across Multiple NLP Tasks
Massively multi-task learning with large language models has recently ma...
research
∙
12/16/2022
Swing Distillation: A Privacy-Preserving Knowledge Distillation Framework
Knowledge distillation (KD) has been widely used for model compression a...
research
∙
11/07/2022
Contrastive Learning with Prompt-derived Virtual Semantic Prototypes for Unsupervised Sentence Embedding
Contrastive learning has become a new paradigm for unsupervised sentence...
research
∙
08/24/2022
Modeling Paragraph-Level Vision-Language Semantic Alignment for Multi-Modal Summarization
Most current multi-modal summarization methods follow a cascaded manner,...
research
∙
08/17/2022
An Efficient Coarse-to-Fine Facet-Aware Unsupervised Summarization Framework based on Semantic Blocks
Unsupervised summarization methods have achieved remarkable results by i...
research
∙
07/11/2022
UM4: Unified Multilingual Multiple Teacher-Student Model for Zero-Resource Neural Machine Translation
Most translation tasks among languages belong to the zero-resource trans...
research
∙
04/09/2022
Modeling Multi-Granularity Hierarchical Features for Relation Extraction
Relation extraction is a key task in Natural Language Processing (NLP), ...
research
∙
03/22/2022
Task-guided Disentangled Tuning for Pretrained Language Models
Pretrained language models (PLMs) trained on large-scale unlabeled corpu...
research
∙
03/22/2022
Learning Confidence for Transformer-based Neural Machine Translation
Confidence estimation aims to quantify the confidence of the model predi...
research
∙
03/07/2022
One Model, Multiple Tasks: Pathways for Natural Language Understanding
This paper presents a Pathways approach to handle many tasks at once. Ou...
research
∙
02/24/2022
Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words
The standard BERT adopts subword-based tokenization, which may break a w...
research
∙
09/15/2021
Unsupervised Keyphrase Extraction by Jointly Modeling Local and Global Context
Embedding based methods are widely used for unsupervised keyphrase extra...
research
∙
11/06/2020
Improving Machine Reading Comprehension with Single-choice Decision and Transfer Learning
Multi-choice Machine Reading Comprehension (MMRC) aims to select the cor...
research
∙
09/05/2019
Accelerating Transformer Decoding via a Hybrid of Self-attention and Recurrent Neural Network
Due to the highly parallelizable architecture, Transformer is faster to ...
research
∙
09/05/2019
Source Dependency-Aware Transformer with Supervised Self-Attention
Recently, Transformer has achieved the state-of-the-art performance on m...
research
∙
11/01/2018
Learning Unsupervised Word Mapping by Maximizing Mean Discrepancy
Cross-lingual word embeddings aim to capture common linguistic regularit...
research
∙
08/13/2018
Regularizing Neural Machine Translation by Target-bidirectional Agreement
Although Neural Machine Translation (NMT) has achieved remarkable progre...
research
∙
03/15/2018