research
∙
08/08/2023
Learning Evaluation Models from Large Language Models for Sequence Generation
Large language models achieve state-of-the-art performance on sequence g...
share
research
∙
08/04/2023
ESRL: Efficient Sampling-based Reinforcement Learning for Sequence Generation
Applying Reinforcement Learning (RL) to sequence generation models enabl...
research
∙
06/24/2023
Towards Robust Aspect-based Sentiment Analysis through Non-counterfactual Augmentations
While state-of-the-art NLP models have demonstrated excellent performanc...
research
∙
06/15/2023
Understanding Parameter Sharing in Transformers
Parameter sharing has proven to be a parameter-efficient approach. Previ...
research
∙
06/07/2023
MobileNMT: Enabling Translation in 15MB and 30ms
Deploying NMT models on mobile devices is essential for privacy, low lat...
research
∙
05/27/2023
Augmenting Large Language Model Translators via Translation Memories
Using translation memories (TMs) as prompts is a promising approach to i...
research
∙
05/26/2023
TranSFormer: Slow-Fast Transformer for Machine Translation
Learning multiscale Transformer models has been evidenced as a viable ap...
research
∙
05/10/2023
Multi-Path Transformer is Better: A Case Study on Neural Machine Translation
For years the model performance in machine learning obeyed a power-law r...
research
∙
02/01/2023
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection
Knowledge distillation addresses the problem of transferring knowledge f...
research
∙
01/13/2023
Prompting Neural Machine Translation with Translation Memories
Improving machine translation (MT) systems with translation memories (TM...
research
∙
12/20/2022
EIT: Enhanced Interactive Transformer
In this paper, we propose a novel architecture, the Enhanced Interactive...
research
∙
06/19/2022
Learning Multiscale Transformer Models for Sequence Generation
Multiscale feature hierarchies have been witnessed the success in the co...
research
∙
03/17/2022
On Vision Features in Multimodal Machine Translation
Previous work on multimodal machine translation (MMT) has focused on the...
research
∙
09/22/2021
The NiuTrans Machine Translation Systems for WMT21
This paper describes NiuTrans neural machine translation systems of the ...
research
∙
09/16/2021
The NiuTrans System for WNGT 2020 Efficiency Task
This paper describes the submissions of the NiuTrans Team to the WNGT 20...
research
∙
09/16/2021
The NiuTrans System for the WMT21 Efficiency Task
This paper describes the NiuTrans system for the WMT21 translation effic...
research
∙
09/15/2021
RankNAS: Efficient Neural Architecture Search by Pairwise Ranking
This paper addresses the efficiency challenge of Neural Architecture Sea...
research
∙
09/09/2021
Bag of Tricks for Optimizing Transformer Efficiency
Improving Transformer efficiency has become increasingly attractive rece...
research
∙
07/06/2021
The NiuTrans End-to-End Speech Translation System for IWSLT 2021 Offline Task
This paper describes the submission of the NiuTrans end-to-end speech tr...
research
∙
05/12/2021
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders
Encoder pre-training is promising in end-to-end Speech Translation (ST),...
research
∙
04/06/2021
ODE Transformer: An Ordinary Differential Equation-Inspired Model for Neural Machine Translation
It has been found that residual networks are an Euler discretization of ...
research
∙
01/03/2021
An Efficient Transformer Decoder with Compressed Sub-layers
The large attention-based encoder-decoder network (Transformer) has beco...
research
∙
12/27/2020
Learning Light-Weight Translation Models from Deep Transformer
Recently, deep models have shown tremendous improvements in neural machi...
research
∙
11/30/2020
A Simple and Effective Approach to Robust Unsupervised Bilingual Dictionary Induction
Unsupervised Bilingual Dictionary Induction methods based on the initial...
research
∙
11/30/2020
Dynamic Curriculum Learning for Low-Resource Neural Machine Translation
Large amounts of data has made neural machine translation (NMT) a big su...
research
∙
11/03/2020
Layer-Wise Multi-View Learning for Neural Machine Translation
Traditional neural machine translation is limited to the topmost encoder...
research
∙
10/16/2020
Training Flexible Depth Model by Multi-Task Learning for Neural Machine Translation
The standard neural machine translation model can only decode with the s...
research
∙
10/08/2020
Shallow-to-Deep Training for Neural Machine Translation
Deep encoders have been proven to be effective in improving neural machi...
research
∙
09/19/2020
Weight Distillation: Transferring the Knowledge in Neural Network Parameters
Knowledge distillation has been proven to be effective in model accelera...
research
∙
09/17/2020
Towards Fully 8-bit Integer Inference for the Transformer Model
8-bit integer inference, as a promising direction in reducing both the l...
research
∙
05/07/2020
Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translation
In encoder-decoder neural models, multiple encoders are in general used ...
research
∙
05/06/2020
Learning Architectures from an Extended Search Space for Language Modeling
Neural architecture search (NAS) has advanced significantly in recent ye...
research
∙
02/16/2020
Multi-layer Representation Fusion for Neural Machine Translation
Neural machine translation systems require a number of stacked layers fo...
research
∙
02/16/2020
Neural Machine Translation with Joint Representation
Though early successes of Statistical Machine Translation (SMT) systems ...
research
∙
06/26/2019
Sharing Attention Weights for Fast Transformer
Recently, the Transformer machine translation system has shown strong re...
research
∙
06/07/2019
Shared-Private Bilingual Word Embeddings for Neural Machine Translation
Word embedding is central to neural machine translation (NMT), which has...
research
∙
06/05/2019
Learning Deep Transformer Models for Machine Translation
Transformer is the state-of-the-art model in recent machine translation ...
research
∙
07/17/2017