research
∙
09/18/2023
Multi-turn Dialogue Comprehension from a Topic-aware Perspective
Dialogue related Machine Reading Comprehension requires language models ...
share
research
∙
09/08/2023
CSPRD: A Financial Policy Retrieval Dataset for Chinese Stock Market
In recent years, great advances in pre-trained language models (PLMs) ha...
research
∙
08/17/2023
Chinese Spelling Correction as Rephrasing Language Model
This paper studies Chinese Spelling Correction (CSC), which aims to dete...
research
∙
08/15/2023
Enhancing Visually-Rich Document Understanding via Layout Structure Modeling
In recent years, the use of multi-modal pre-trained Transformers has led...
research
∙
07/02/2023
Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers
Optimizer is an essential component for the success of deep learning, wh...
research
∙
07/01/2023
BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained Transformer
BatGPT is a large-scale language model designed and trained jointly by W...
research
∙
06/21/2023
Modeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension
Machine reading comprehension (MRC) poses new challenges over logical re...
research
∙
06/19/2023
FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction
Universal Information Extraction (UIE) has been introduced as a unified ...
research
∙
06/15/2023
CMMLU: Measuring massive multitask language understanding in Chinese
As the capabilities of large language models (LLMs) continue to advance,...
research
∙
05/28/2023
Rethinking Masked Language Modeling for Chinese Spelling Correction
In this paper, we study Chinese Spelling Correction (CSC) as a joint dec...
research
∙
05/26/2023
Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Large Language Models
With the widespread use of large language models (LLMs) in NLP tasks, re...
research
∙
05/24/2023
Pre-training Multi-party Dialogue Models with Latent Discourse Inference
Multi-party dialogues are more difficult for models to understand than o...
research
∙
05/24/2023
RefGPT: Reference -> Truthful Customized Dialogues Generation by GPTs and for GPTs
General chat models, like ChatGPT, have attained impressive capability t...
research
∙
05/23/2023
Query Rewriting for Retrieval-Augmented Large Language Models
Large Language Models (LLMs) play a powerful Reader of the Retrieve-then...
research
∙
05/22/2023
Extrapolating Multilingual Understanding Models as Multilingual Generators
Multilingual understanding models (or encoder-based), pre-trained via ma...
research
∙
05/21/2023
EM Pre-training for Multi-party Dialogue Response Generation
Dialogue response generation requires an agent to generate a response ac...
research
∙
05/11/2023
PROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization
Based on the remarkable achievements of pre-trained language models in a...
research
∙
05/10/2023
Decker: Double Check with Heterogeneous Knowledge for Commonsense Fact Verification
Commonsense fact verification, as a challenging branch of commonsense qu...
research
∙
05/09/2023
Attack Named Entity Recognition by Entity Boundary Interference
Named Entity Recognition (NER) is a cornerstone NLP task while its robus...
research
∙
05/08/2023
Toward Adversarial Training on Contextualized Language Representation
Beyond the success story of adversarial training (AT) in the recent text...
research
∙
02/02/2023
Multimodal Chain-of-Thought Reasoning in Language Models
Large language models (LLMs) have shown impressive performance on comple...
research
∙
01/10/2023
Channel-aware Decoupling Network for Multi-turn Dialogue Comprehension
Training machines to understand natural language and interact with human...
research
∙
12/16/2022
Self-Prompting Large Language Models for Open-Domain QA
Open-Domain Question Answering (ODQA) requires models to answer factoid ...
research
∙
12/01/2022
Language Model Pre-training on True Negatives
Discriminative pre-trained language models (PLMs) learn to predict origi...
research
∙
10/19/2022
Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning
Multiple pre-training objectives fill the vacancy of the understanding c...
research
∙
10/16/2022
Sentence Representation Learning with Generative Objective rather than Contrastive Objective
Though offering amazing contextualized token-level representations, curr...
research
∙
10/13/2022
Towards End-to-End Open Conversational Machine Reading
In open-retrieval conversational machine reading (OR-CMR) task, machines...
research
∙
09/12/2022
Semantic-Preserving Adversarial Code Comprehension
Based on the tremendous success of pre-trained language models (PrLMs) f...
research
∙
08/23/2022
Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning
Commonsense reasoning is an appealing topic in natural language processi...
research
∙
08/23/2022
Learning Better Masking for Better Language Model Pre-training
Masked Language Modeling (MLM) has been widely used as the denoising obj...
research
∙
06/25/2022
Adversarial Self-Attention for Language Understanding
An ultimate language system aims at the high generalization and robustne...
research
∙
04/20/2022
Generative or Contrastive? Phrase Reconstruction for Better Sentence Representation Learning
Though offering amazing contextualized token-level representations, curr...
research
∙
04/18/2022
Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Modeling
Multi-turn dialogue modeling as a challenging branch of natural language...
research
∙
04/17/2022
Nested Named Entity Recognition as Holistic Structure Parsing
As a fundamental natural language processing task and one of core knowle...
research
∙
03/26/2022
Lite Unified Modeling for Discriminative Reading Comprehension
As a broad and major category in machine reading comprehension (MRC), th...
research
∙
03/19/2022
Distinguishing Non-natural from Natural Adversarial Samples for More Robust Pre-trained Language Model
Recently, the problem of robustness of pre-trained language models (PrLM...
research
∙
01/04/2022
Semantics-Preserved Distortion for Personal Privacy Protection
Privacy protection is an important and concerning topic in Federated Lea...
research
∙
12/26/2021
ArT: All-round Thinker for Unsupervised Commonsense Question-Answering
Without labeled question-answer pairs for necessary training, unsupervis...
research
∙
11/18/2021
Seeking Common but Distinguishing Difference, A Joint Aspect-based Sentiment Analysis Model
Aspect-based sentiment analysis (ABSA) task consists of three typical su...
research
∙
10/29/2021
Unsupervised Full Constituency Parsing with Neighboring Distribution Divergence
Unsupervised constituency parsing has been explored much but is still fa...
research
∙
10/15/2021
Structural Modeling for Dialogue Disentanglement
Tangled multi-party dialogue context leads to challenges for dialogue re...
research
∙
10/15/2021
Tracing Origins: Coref-aware Machine Reading Comprehension
Machine reading comprehension is a heavily-studied research and test fie...
research
∙
10/14/2021
Representation Decoupling for Open-Domain Passage Retrieval
Training dense passage representations via contrastive learning (CL) has...
research
∙
10/07/2021
Multi-tasking Dialogue Comprehension with Discourse Parsing
Multi-party dialogue machine reading comprehension (MRC) raises an even ...
research
∙
10/04/2021
A Novel Metric for Evaluating Semantics Preservation
In this paper, we leverage pre-trained language models (PLMs) to precise...
research
∙
09/14/2021
Sparse Fuzzy Attention for Structured Sentiment Analysis
Attention scorers have achieved success in parsing tasks like semantic a...
research
∙
09/09/2021
Enhanced Speaker-aware Multi-party Multi-turn Dialogue Comprehension
Multi-party multi-turn dialogue comprehension brings unprecedented chall...
research
∙
09/08/2021
Self- and Pseudo-self-supervised Prediction of Speaker and Key-utterance for Multi-party Dialogue Reading Comprehension
Multi-party dialogue machine reading comprehension (MRC) brings tremendo...
research
∙
08/31/2021
Unsupervised Open-Domain Question Answering
Open-domain Question Answering (ODQA) has achieved significant results i...
research
∙
08/29/2021