research
∙
06/12/2023
RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation
Endowing chatbots with a consistent persona is essential to an engaging ...
share
research
∙
05/22/2023
Look-back Decoding for Open-Ended Text Generation
Given a prefix (context), open-ended generation aims to decode texts tha...
research
∙
05/18/2023
LIMA: Less Is More for Alignment
Large language models are trained in two stages: (1) unsupervised pretra...
research
∙
12/16/2022
On Human Visual Contrast Sensitivity and Machine Vision Robustness: A Comparative Study
It is well established in neuroscience that color vision plays an essent...
research
∙
12/16/2022
Better May Not Be Fairer: Can Data Augmentation Mitigate Subgroup Degradation?
It is no secret that deep learning models exhibit undesirable behaviors ...
research
∙
10/19/2022
Improving Stability of Fine-Tuning Pretrained Language Models via Component-Wise Gradient Norm Clipping
Fine-tuning over large pretrained language models (PLMs) has established...
research
∙
09/21/2022
Mega: Moving Average Equipped Gated Attention
The design choices in the Transformer attention mechanism, including wea...
research
∙
05/25/2022
Know Where You're Going: Meta-Learning for Parameter-Efficient Fine-tuning
A recent family of techniques, dubbed as lightweight fine-tuning methods...
research
∙
04/29/2022
Prompt Consistency for Zero-Shot Task Generalization
One of the most impressive results of recent NLP history is the ability ...
research
∙
02/18/2022
Learning Representations Robust to Group Shifts and Adversarial Examples
Despite the high performance achieved by deep neural networks on various...
research
∙
10/08/2021
Towards a Unified View of Parameter-Efficient Transfer Learning
Fine-tuning large pre-trained language models on downstream tasks has be...
research
∙
06/14/2021
Examining and Combating Spurious Features under Distribution Shift
A central goal of machine learning is to learn robust representations th...
research
∙
06/03/2021
Luna: Linear Unified Nested Attention
The quadratic computational and memory complexities of the Transformer's...
research
∙
06/02/2021
COM2SENSE: A Commonsense Reasoning Benchmark with Complementary Sentences
Commonsense reasoning is intuitive for humans but has been a long-term c...
research
∙
02/03/2021
DiSCoL: Toward Engaging Dialogue Systems through Conversational Line Guided Response Generation
Having engaging and informative conversations with users is the utmost g...
research
∙
09/28/2020
Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization
In this paper, we introduce Apollo, a quasi-Newton method for nonconvex ...
research
∙
09/20/2019
Cross-lingual Dependency Parsing with Unlabeled Auxiliary Languages
Cross-lingual transfer learning has become an important weapon to battle...
research
∙
09/05/2019
FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow
Most sequence-to-sequence (seq2seq) models are autoregressive; they gene...
research
∙
08/30/2019
Handling Syntactic Divergence in Low-resource Machine Translation
Despite impressive empirical successes of neural machine translation (NM...
research
∙
05/29/2019
Choosing Transfer Languages for Cross-Lingual Learning
Cross-lingual transfer, where a high-resource transfer language is used ...
research
∙
04/04/2019
Density Matching for Bilingual Word Embedding
Recent approaches to cross-lingual word embedding have generally been ba...
research
∙
02/12/2019
MaCow: Masked Convolutional Generative Flow
Flow-based generative models, conceptually attractive due to tractabilit...
research
∙
01/06/2019
MAE: Mutual Posterior-Divergence Regularization for Variational AutoEncoders
Variational Autoencoder (VAE), a simple and effective deep generative mo...
research
∙
11/01/2018
Near or Far, Wide Range Zero-Shot Cross-Lingual Dependency Parsing
Cross-lingual transfer is the major means toleverage knowledge from high...
research
∙
09/04/2018
Texar: A Modularized, Versatile, and Extensible Toolkit for Text Generation
We introduce Texar, an open-source toolkit aiming to support the broad s...
research
∙
05/03/2018
Stack-Pointer Networks for Dependency Parsing
We introduce a novel architecture for dependency parsing: stack-pointer ...
research
∙
05/19/2017
Softmax Q-Distribution Estimation for Structured Prediction: A Theoretical Interpretation for RAML
Reward augmented maximum likelihood (RAML), a simple and effective learn...
research
∙
04/19/2017
An Interpretable Knowledge Transfer Model for Knowledge Base Completion
Knowledge bases are important resources for a variety of natural languag...
research
∙
01/04/2017
Neural Probabilistic Model for Non-projective MST Parsing
In this paper, we propose a probabilistic parsing model, which defines a...
research
∙
09/26/2016
Dropout with Expectation-linear Regularization
Dropout, a simple and effective way to train deep neural networks, has l...
research
∙
03/21/2016
Harnessing Deep Neural Networks with Logic Rules
Combining deep neural networks with structured logic rules is desirable ...
research
∙
03/15/2016
Unsupervised Ranking Model for Entity Coreference Resolution
Coreference resolution is one of the first stages in deep language under...
research
∙
03/04/2016
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
State-of-the-art sequence labeling systems traditionally require large a...
research
∙
02/14/2015