research
∙
09/06/2023
Everyone Deserves A Reward: Learning Customized Human Preferences
Reward models (RMs) are crucial in aligning large language models (LLMs)...
share
research
∙
08/25/2023
Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers
Although dominant in natural language processing, transformer-based mode...
research
∙
06/28/2023
SkillNet-X: A Multilingual Multitask Model with Sparsely Activated Skills
Traditional multitask learning methods basically can only exploit common...
research
∙
12/20/2022
When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning Methods
With increasing privacy concerns on data, recent studies have made signi...
research
∙
08/20/2022
Pretrained Language Encoders are Natural Tagging Frameworks for Aspect Sentiment Triplet Extraction
Aspect Sentiment Triplet Extraction (ASTE) aims to extract the spans of ...
research
∙
08/03/2022
Effidit: Your AI Writing Assistant
In this technical report, we introduce Effidit (Efficient and Intelligen...
research
∙
05/12/2022
One Model, Multiple Modalities: A Sparsely Activated Approach for Text, Sound, Image, Video and Code
People perceive the world with multiple senses (e.g., through hearing so...
research
∙
04/26/2022
Pretraining Chinese BERT for Detecting Word Insertion and Deletion Errors
Chinese BERT models achieve remarkable progress in dealing with grammati...
research
∙
03/12/2022
MarkBERT: Marking Word Boundaries Improves Chinese BERT
We present a Chinese BERT model dubbed MarkBERT that uses word informati...
research
∙
03/07/2022
One Model, Multiple Tasks: Pathways for Natural Language Understanding
This paper presents a Pathways approach to handle many tasks at once. Ou...
research
∙
03/01/2022
"Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction
Whole word masking (WWM), which masks all subwords corresponding to a wo...
research
∙
03/01/2022
Exploring and Adapting Chinese GPT to Pinyin Input Method
While GPT has become the de-facto method for text generation tasks, its ...
research
∙
06/10/2020