research
∙
09/12/2023
CleanUNet 2: A Hybrid Speech Denoising Model on Waveform and Spectrogram
In this work, we present CleanUNet 2, a speech denoising model that comb...
share
research
∙
08/15/2023
RAVEN: In-Context Learning with Retrieval Augmented Encoder-Decoder Language Models
In this paper, we investigate the in-context learning ability of retriev...
research
∙
08/07/2023
GraPhSyM: Graph Physical Synthesis Model
In this work, we introduce GraPhSyM, a Graph Attention Network (GATv2) m...
research
∙
04/13/2023
Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study
Large decoder-only language models (LMs) can be largely improved in term...
research
∙
02/14/2023
Adding Instructions during Pretraining: Effective Way of Controlling Toxicity in Language Models
Pretrained large language models have become indispensable for solving v...
research
∙
02/09/2023
Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning
Augmenting pretrained language models (LMs) with a vision encoder (e.g.,...
research
∙
01/24/2023
Multilingual Multiaccented Multispeaker TTS with RADTTS
We work to create a multilingual speech synthesis system which can gener...
research
∙
11/02/2022
eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers
Large-scale diffusion-based generative models have led to breakthroughs ...
research
∙
10/25/2022
Evaluating Parameter Efficient Learning for Generation
Parameter efficient learning methods (PERMs) have recently gained signif...
research
∙
10/12/2022
Context Generation Improves Open Domain Question Answering
Closed-book question answering (QA) requires a model to directly answer ...
research
∙
06/09/2022
BigVGAN: A Universal Neural Vocoder with Large-Scale Training
Despite recent progress in generative adversarial network(GAN)-based voc...
research
∙
06/09/2022
Factuality Enhanced Language Models for Open-Ended Text Generation
Pretrained language models (LMs) are susceptible to generate text with n...
research
∙
05/14/2022
PrefixRL: Optimization of Parallel Prefix Circuits using Deep Reinforcement Learning
In this work, we present a reinforcement learning (RL) based approach to...
research
∙
05/10/2022
Reducing Activation Recomputation in Large Transformer Models
Training large transformer models is one of the most important computati...
research
∙
03/16/2022
Multi-Stage Prompting for Knowledgeable Dialogue Generation
Existing knowledge-grounded dialogue systems typically use finetuned ver...
research
∙
03/03/2022
Generative Modeling for Low Dimensional Speech Attributes with Neural Spline Flows
Despite recent advances in generative modeling for text-to-speech synthe...
research
∙
02/15/2022
Speech Denoising in the Waveform Domain with Self-Attention
In this work, we present CleanUNet, a causal speech denoising model on t...
research
∙
02/08/2022
Exploring the Limits of Domain-Adaptive Training for Detoxifying Large-Scale Language Models
Pre-trained language models (LMs) are shown to easily generate toxic lan...
research
∙
01/31/2022
Leveraging Bitstream Metadata for Fast and Accurate Video Compression Correction
Video compression is a central feature of the modern internet powering t...
research
∙
01/28/2022
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model
Pretrained general-purpose language models can achieve state-of-the-art ...
research
∙
12/15/2021
Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biases
Detecting social bias in text is challenging due to nuance, subjectivity...
research
∙
09/06/2021
Guiding Global Placement With Reinforcement Learning
Recent advances in GPU accelerated global and detail placement have redu...
research
∙
08/23/2021
One TTS Alignment To Rule Them All
Speech-to-text alignment is a critical component of neural textto-speech...
research
∙
07/05/2021
Long-Short Transformer: Efficient Transformers for Language and Vision
Transformers have achieved success in both language and vision domains. ...
research
∙
04/09/2021
Efficient Large-Scale Language Model Training on GPU Clusters
Large language models have led to state-of-the-art accuracies across a r...
research
∙
01/02/2021
End-to-End Training of Neural Retrievers for Open-Domain Question Answering
Recent work on training neural retrievers for open-domain question answe...
research
∙
10/20/2020
Local Knowledge Powered Conversational Agents
State-of-the-art conversational agents have advanced significantly in co...
research
∙
10/02/2020
MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models
Existing pre-trained large language models have shown unparalleled gener...
research
∙
09/21/2020
DiffWave: A Versatile Diffusion Model for Audio Synthesis
In this work, we propose DiffWave, a versatile Diffusion probabilistic m...
research
∙
07/14/2020
Transposer: Universal Texture Synthesis Using Feature Maps as Transposed Convolution Filter
Conventional CNNs for texture synthesis consist of a sequence of (de)-co...
research
∙
05/21/2020
Hierarchical Multi-Scale Attention for Semantic Segmentation
Multi-scale inference is commonly used to improve the results of semanti...
research
∙
05/13/2020
Large Scale Multi-Actor Generative Dialog Modeling
Non-goal oriented dialog agents (i.e. chatbots) aim to produce varying a...
research
∙
05/12/2020
Flowtron: an Autoregressive Flow-based Generative Network for Text-to-Speech Synthesis
generative network for text-to-speech synthesis with control over speec...
research
∙
02/22/2020
Training Question Answering Models From Synthetic Data
Question and answer generation is a data augmentation method that aims t...
research
∙
01/26/2020
Unsupervised Disentanglement of Pose, Appearance and Background from Images and Videos
Unsupervised landmark learning is the task of learning semantic keypoint...
research
∙
12/25/2019
Neural ODEs for Image Segmentation with Level Sets
We propose a novel approach for image segmentation that combines Neural ...
research
∙
12/10/2019
Zero-shot Text Classification With Generative Language Models
This work investigates the use of natural language to enable zero-shot m...
research
∙
10/28/2019
Few-shot Video-to-Video Synthesis
Video-to-video synthesis (vid2vid) aims at converting an input semantic ...
research
∙
10/26/2019
Mellotron: Multispeaker expressive voice synthesis by conditioning on rhythm, pitch and global style tokens
Mellotron is a multispeaker voice synthesis model based on Tacotron 2 GS...
research
∙
09/26/2019
Improving SAT Solver Heuristics with Graph Networks and Reinforcement Learning
We present GQSAT, a branching heuristic in a Boolean SAT solver trained ...
research
∙
09/17/2019
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Recent work in unsupervised language modeling demonstrates that training...
research
∙
09/17/2019
Megatron-LM: Training Multi-Billion Parameter Language Models Using GPU Model Parallelism
Recent work in unsupervised language modeling demonstrates that training...
research
∙
09/06/2019
Video Interpolation and Prediction with Unsupervised Landmarks
Prediction and interpolation for long-range video data involves the comp...
research
∙
06/13/2019
Unsupervised Video Interpolation Using Cycle Consistency
Learning to synthesize high frame rate videos via interpolation requires...
research
∙
03/29/2019
SysML: The New Frontier of Machine Learning Systems
Machine learning (ML) techniques are enjoying rapidly increasing adoptio...
research
∙
03/07/2019
Graphical Contrastive Losses for Scene Graph Generation
Most scene graph generators use a two-stage pipeline to detect visual re...
research
∙
12/04/2018
Improving Semantic Segmentation via Video Propagation and Label Relaxation
Semantic segmentation requires large amounts of pixel-wise annotations t...
research
∙
12/04/2018
Practical Text Classification With Large Pre-Trained Language Models
Multi-emotion sentiment classification is a natural language processing ...
research
∙
11/28/2018
Partial Convolution based Padding
In this paper, we present a simple yet effective padding scheme that can...
research
∙
11/21/2018