research
∙
07/13/2023
In-context Autoencoder for Context Compression in a Large Language Model
We propose the In-context Autoencoder (ICAE) for context compression in ...
share
research
∙
07/11/2023
Unleashing Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration
Human intelligence thrives on the concept of cognitive synergy, where co...
research
∙
05/17/2023
Smart Word Suggestions for Writing Assistance
Enhancing word usage is a desired feature for writing assistance. To fur...
research
∙
04/17/2023
Low-code LLM: Visual Programming over LLMs
Effectively utilizing LLMs for complex tasks is challenging, often invol...
research
∙
03/02/2023
Semiparametric Language Models Are Scalable Continual Learners
Semiparametric language models (LMs) have shown promise in continuously ...
research
∙
02/01/2023
MB-DECTNet: A Model-Based Unrolled Network for Accurate 3D DECT Reconstruction
Numerous dual-energy CT (DECT) techniques have been developed in the pas...
research
∙
12/20/2022
Pay Attention to Your Tone: Introducing a New Dataset for Polite Language Rewrite
We introduce PoliteRewrite – a dataset for polite language rewrite which...
research
∙
12/01/2022
Extensible Prompts for Language Models
We propose eXtensible Prompt (X-Prompt) for prompting a large language m...
research
∙
10/21/2022
DL-Corrector-Remapper: A grid-free bias-correction deep learning methodology for data-driven high-resolution global weather forecasting
Data-driven models, such as FourCastNet (FCN), have shown exemplary perf...
research
∙
05/20/2022
Lossless Acceleration for Seq2seq Generation with Aggressive Decoding
We study lossless acceleration for seq2seq generation with a novel decod...
research
∙
04/15/2022
Text Revision by On-the-Fly Representation Optimization
Text revision refers to a family of natural language generation tasks, w...
research
∙
03/30/2022
Lossless Speedup of Autoregressive Translation with Generalized Aggressive Decoding
In this paper, we propose Generalized Aggressive Decoding (GAD) – a nove...
research
∙
02/16/2022
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation
We propose EdgeFormer – a parameter-efficient Transformer of the encoder...
research
∙
01/26/2022
A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model
Synthetic data construction of Grammatical Error Correction (GEC) for no...
research
∙
09/07/2021
Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression
Recent studies on compression of pretrained language models (e.g., BERT)...
research
∙
07/30/2021
A Machine-learning Based Initialization for Joint Statistical Iterative Dual-energy CT with Application to Proton Therapy
Dual-energy CT (DECT) has been widely investigated to generate more info...
research
∙
06/09/2021
Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding
In this paper, we propose Shallow Aggressive Decoding (SAD) to improve t...
research
∙
04/06/2021
Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge
Cant is important for understanding advertising, comedies and dog-whistl...
research
∙
01/02/2021
Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting
In this paper, we generalize text infilling (e.g., masked language model...
research
∙
10/07/2020
Improving the Efficiency of Grammatical Error Correction with Erroneous Span Detection and Correction
We propose a novel language-independent approach to improve the efficien...
research
∙
06/07/2020
BERT Loses Patience: Fast and Robust Inference with Early Exit
In this paper, we propose Patience-based Early Exit, a straightforward y...
research
∙
05/14/2020
Parallel Data Augmentation for Formality Style Transfer
The main barrier to progress in the task of Formality Style Transfer is ...
research
∙
04/28/2020
Scheduled DropHead: A Regularization Method for Transformer Models
In this paper, we introduce DropHead, a structured dropout method specif...
research
∙
02/07/2020
BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
In this paper, we propose a novel model compression approach to effectiv...
research
∙
01/31/2020
Pseudo-Bidirectional Decoding for Local Sequence Transduction
Local sequence transduction (LST) tasks are sequence transduction tasks ...
research
∙
01/31/2020
Self-Adversarial Learning with Comparative Discrimination for Text Generation
Conventional Generative Adversarial Networks (GANs) for text generation ...
research
∙
01/16/2020
Fact-aware Sentence Split and Rephrase with Permutation Invariant Training
Sentence Split and Rephrase aims to break down a complex sentence into s...
research
∙
12/03/2019
Proximal Newton Methods for X-Ray Imaging with Non-Smooth Regularization
Non-smooth regularization is widely used in image reconstruction to elim...
research
∙
11/07/2019
Improving Grammatical Error Correction with Machine Translation Pairs
We propose a novel data synthesis method to generate diverse error-corre...
research
∙
09/13/2019
Sequence-to-sequence Pre-training with Data Augmentation for Sentence Rewriting
We study sequence-to-sequence (seq2seq) pre-training with data augmentat...
research
∙
03/15/2019
Formality Style Transfer with Hybrid Textual Annotations
Formality style transformation is the task of modifying the formality of...
research
∙
07/03/2018
Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Study
Neural sequence-to-sequence (seq2seq) approaches have proven to be succe...
research
∙
04/11/2018