research
∙
12/19/2022
MultiCoder: Multi-Programming-Lingual Pre-Training for Low-Resource Code Completion
Code completion is a valuable topic in both academia and industry. Recen...
share
research
∙
12/12/2022
Momentum Contrastive Pre-training for Question Answering
Existing pre-training methods for extractive Question Answering (QA) gen...
research
∙
12/04/2022
Constructing Highly Inductive Contexts for Dialogue Safety through Controllable Reverse Generation
Large pretrained language models can easily produce toxic or biased cont...
research
∙
06/15/2022
Sparse Structure Search for Parameter-Efficient Tuning
Adapting large pre-trained models (PTMs) through fine-tuning imposes pro...
research
∙
05/04/2022
CODE-MVP: Learning to Represent Source Code from Multiple Views with Contrastive Pre-Training
Recent years have witnessed increasing interest in code representation l...
research
∙
02/14/2022
Source Code Summarization with Structural Relative Position Guided Transformer
Source code summarization aims at generating concise and clear natural l...
research
∙
08/10/2021
SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation
Code representation learning, which aims to encode the semantics of sour...
research
∙
05/26/2021
Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger
Backdoor attacks are a kind of insidious security threat against machine...
research
∙
01/18/2021
Red Alarm for Pre-trained Models: Universal Vulnerabilities by Neuron-Level Backdoor Attacks
Due to the success of pre-trained models (PTMs), people usually fine-tun...
research
∙
12/31/2020
Unified Mandarin TTS Front-end Based on Distilled BERT Model
The front-end module in a typical Mandarin text-to-speech system (TTS) i...
research
∙
08/31/2019
NEZHA: Neural Contextualized Representation for Chinese Language Understanding
The pre-trained language models have achieved great successes in various...
research
∙
06/29/2019