research
∙
06/28/2023
SkillNet-X: A Multilingual Multitask Model with Sparsely Activated Skills
Traditional multitask learning methods basically can only exploit common...
share
research
∙
05/26/2023
Improved Visual Story Generation with Adaptive Context Modeling
Diffusion models developed on top of powerful text-to-image generation m...
research
∙
05/12/2022
One Model, Multiple Modalities: A Sparsely Activated Approach for Text, Sound, Image, Video and Code
People perceive the world with multiple senses (e.g., through hearing so...
research
∙
04/26/2022
Pretraining Chinese BERT for Detecting Word Insertion and Deletion Errors
Chinese BERT models achieve remarkable progress in dealing with grammati...
research
∙
03/12/2022
MarkBERT: Marking Word Boundaries Improves Chinese BERT
We present a Chinese BERT model dubbed MarkBERT that uses word informati...
research
∙
03/01/2022
"Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction
Whole word masking (WWM), which masks all subwords corresponding to a wo...
research
∙
03/01/2022
Exploring and Adapting Chinese GPT to Pinyin Input Method
While GPT has become the de-facto method for text generation tasks, its ...
research
∙
02/24/2022
Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words
The standard BERT adopts subword-based tokenization, which may break a w...
research
∙
09/17/2020
GraphCodeBERT: Pre-training Code Representations with Data Flow
Pre-trained models for programming language have achieved dramatic empir...
research
∙
04/28/2020
LogicalFactChecker: Leveraging Logical Operations for Fact Checking with Graph Module Network
Verifying the correctness of a textual statement requires not only seman...
research
∙
02/19/2020