research
∙
08/22/2023
Towards an On-device Agent for Text Rewriting
Large Language Models (LLMs) have demonstrated impressive capabilities f...
share
research
∙
04/12/2023
Measuring Re-identification Risk
Compact user representations (such as embeddings) form the backbone of p...
research
∙
11/08/2022
Conciseness: An Overlooked Language Task
We report on novel investigations into training models that make sentenc...
research
∙
09/10/2022
Simple and Effective Gradient-Based Tuning of Sequence-to-Sequence Models
Recent trends towards training ever-larger language models have substant...
research
∙
06/14/2022
Text Generation with Text-Editing Models
Text-editing models have recently become a prominent alternative to seq2...
research
∙
05/02/2022
Jam or Cream First? Modeling Ambiguity in Neural Machine Translation with SCONES
The softmax layer in neural machine translation is designed to model the...
research
∙
04/01/2022
Uncertainty Determines the Adequacy of the Mode and the Tractability of Decoding in Sequence-to-Sequence Models
In many natural language processing (NLP) tasks the same input (e.g. sou...
research
∙
03/09/2022
Sentence-Select: Large-Scale Language Model Data Selection for Rare-Word Speech Recognition
Language model fusion helps smart assistants recognize words which are r...
research
∙
02/01/2022
Transformer-based Models of Text Normalization for Speech Applications
Text normalization, or the process of transforming text into a consisten...
research
∙
05/27/2021
Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Models
Synthetic data generation is widely known to boost the accuracy of neura...
research
∙
04/09/2021
Lookup-Table Recurrent Language Models for Long Tail Speech Recognition
We introduce Lookup-Table Language Models (LookupLM), a method for scali...
research
∙
09/23/2020
Seq2Edits: Sequence Transduction Using Span-level Edit Operations
We propose Seq2Edits, an open-vocabulary approach to sequence editing fo...
research
∙
08/24/2020
Improving Tail Performance of a Deliberation E2E ASR Model Using a Large Text Corpus
End-to-end (E2E) automatic speech recognition (ASR) systems lack the dis...
research
∙
08/07/2020
Data Weighted Training Strategies for Grammatical Error Correction
Recent progress in the task of Grammatical Error Correction (GEC) has be...
research
∙
02/07/2020
Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss
In this paper we present an end-to-end speech recognition model with Tra...
research
∙
04/10/2019
Corpora Generation for Grammatical Error Correction
Grammatical Error Correction (GEC) has been recently modeled using the s...
research
∙
03/07/2019
Neural Language Modeling with Visual Features
Multimodal language models attempt to incorporate non-linguistic feature...
research
∙
02/21/2019
Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling
Lingvo is a Tensorflow framework offering a complete solution for collab...
research
∙
10/31/2018
Weakly Supervised Grammatical Error Correction using Iterative Decoding
We describe an approach to Grammatical Error Correction (GEC) that is ef...
research
∙
12/05/2017
No Need for a Lexicon? Evaluating the Value of the Pronunciation Lexica in End-to-End Models
For decades, context-dependent phonemes have been the dominant sub-word ...
research
∙
11/15/2017
Lattice Rescoring Strategies for Long Short Term Memory Language Models in Speech Recognition
Recurrent neural network (RNN) language models (LMs) and Long Short Term...
research
∙
06/23/2016
NN-grams: Unifying neural network and n-gram language models for Speech Recognition
We present NN-grams, a novel, hybrid language model integrating n-grams ...
research
∙
03/22/2015