research
∙
05/24/2023
Bi-Drop: Generalizable Fine-tuning for Pre-trained Language Models via Adaptive Subnetwork Optimization
Pretrained language models have achieved remarkable success in a variety...
share
research
∙
05/24/2023
Denoising Bottleneck with Mutual Information Maximization for Video Multimodal Fusion
Video multimodal fusion aims to integrate multimodal signals in videos, ...
research
∙
05/23/2023
Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
In-context learning (ICL) emerges as a promising capability of large lan...
research
∙
12/31/2022
A Survey for In-context Learning
With the increasing ability of large language models (LLMs), in-context ...
research
∙
12/20/2022
Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers
Large pretrained language models have shown surprising In-Context Learni...
research
∙
10/07/2022
Calibrating Factual Knowledge in Pretrained Language Models
Previous literature has proved that Pretrained Language Models (PLMs) ca...
research
∙
07/31/2022
Neural Knowledge Bank for Pretrained Transformers
The ability of pretrained Transformers to remember factual knowledge is ...
research
∙
05/02/2022
Robust Fine-tuning via Perturbation and Interpolation from In-batch Instances
Fine-tuning pretrained language models (PLMs) on downstream tasks has be...
research
∙
04/20/2022
On the Representation Collapse of Sparse Mixture of Experts
Sparse mixture of experts provides larger model capacity while requiring...
research
∙
04/18/2022
StableMoE: Stable Routing Strategy for Mixture of Experts
The Mixture-of-Experts (MoE) technique can scale up the model size of Tr...
research
∙
04/15/2022
Mixture of Experts for Biomedical Question Answering
Biomedical Question Answering (BQA) has attracted increasing attention i...
research
∙
08/29/2021
Behind the Scenes: An Exploration of Trigger Biases Problem in Few-Shot Event Classification
Few-Shot Event Classification (FSEC) aims at developing a model for even...
research
∙
06/21/2021
Explicit Interaction Network for Aspect Sentiment Triplet Extraction
Aspect Sentiment Triplet Extraction (ASTE) aims to recognize targets, th...
research
∙
04/18/2021
Knowledge Neurons in Pretrained Transformers
Large-scale pretrained language models are surprisingly good at recallin...
research
∙
03/26/2021
Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehension
Conventional Machine Reading Comprehension (MRC) has been well-addressed...
research
∙
12/04/2020
Coarse-to-Fine Entity Representations for Document-level Relation Extraction
Document-level Relation Extraction (RE) requires extracting relations ex...
research
∙
09/27/2020
Inductively Representing Out-of-Knowledge-Graph Entities by Optimal Estimation Under Translational Assumptions
Conventional Knowledge Graph Completion (KGC) assumes that all test enti...
research
∙
09/13/2018
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
We introduce the task of automatic live commenting. Live commenting, whi...
research
∙
08/16/2018
Sememe Prediction: Learning Semantic Knowledge from Unstructured Textual Wiki Descriptions
Huge numbers of new words emerge every day, leading to a great need for ...
research
∙
08/13/2018
Live Video Comment Generation Based on Surrounding Frames and Live Comments
In this paper, we propose the task of live comment generation. Live comm...
research
∙
04/21/2017