research
∙
08/04/2023
Towards Improving Harmonic Sensitivity and Prediction Stability for Singing Melody Extraction
In deep learning research, many melody extraction models rely on redesig...
share
research
∙
08/03/2023
MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategies
Diffusion models have shown promising results in cross-modal generation ...
research
∙
06/16/2023
CLIPSonic: Text-to-Audio Synthesis with Unlabeled Videos and Pretrained Language-Vision Models
Recent work has studied text-to-audio synthesis using large amounts of p...
research
∙
06/12/2023
Contrastive Attention Networks for Attribution of Early Modern Print
In this paper, we develop machine learning techniques to identify unknow...
research
∙
05/29/2023
Membership Inference Attacks against Language Models via Neighbourhood Comparison
Membership Inference attacks (MIAs) aim to predict whether a data sample...
research
∙
05/24/2023
Text Conditional Alt-Text Generation for Twitter Images
In this work we present an approach for generating alternative text (or ...
research
∙
05/17/2023
Smaller Language Models are Better Black-box Machine-Generated Text Detectors
With the advent of fluent generative language models that can produce co...
research
∙
05/11/2023
Universal Source Separation with Weakly Labelled Data
Universal source separation (USS) is a fundamental research task for com...
research
∙
01/11/2023
ClimaBench: A Benchmark Dataset For Climate Change Text Understanding in English
The topic of Climate Change (CC) has received limited attention in NLP d...
research
∙
12/21/2022
Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval
Contrastive learning has been successfully used for retrieval of semanti...
research
∙
12/14/2022
CLIPSep: Learning Text-queried Sound Separation with Noisy Unlabeled Videos
Recent years have seen progress beyond domain-specific sound separation ...
research
∙
11/12/2022
Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentation
Contrastive learning has shown remarkable success in the field of multim...
research
∙
09/13/2022
Non-Parametric Temporal Adaptation for Social Media Topic Classification
User-generated social media data is constantly changing as new trends in...
research
∙
09/12/2022
Checklist Models for Improved Output Fluency in Piano Fingering Prediction
In this work we present a new approach for the task of predicting finger...
research
∙
09/07/2022
Improving Choral Music Separation through Expressive Synthesized Data from Sampled Instruments
Choral music separation refers to the task of extracting tracks of voice...
research
∙
07/14/2022
Multitrack Music Transformer: Learning Long-Term Dependencies in Music with Diverse Instruments
Existing approaches for generating multitrack music with transformer mod...
research
∙
05/25/2022
Memorization in NLP Fine-tuning Methods
Large language models are shown to present privacy risks through memoriz...
research
∙
04/29/2022
Prompt Consistency for Zero-Shot Task Generalization
One of the most impressive results of recent NLP history is the ability ...
research
∙
03/24/2022
Mix and Match: Learning-free Controllable Text Generation using Energy Language Models
Recent work on controlled text generation has either required attribute-...
research
∙
03/22/2022
Achieving Conversational Goals with Unsupervised Post-hoc Knowledge Injection
A limitation of current neural dialog models is that they tend to suffer...
research
∙
03/08/2022
Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attacks
The wide adoption and application of Masked language models (MLMs) on se...
research
∙
02/12/2022
Deep Performer: Score-to-Audio Music Performance Synthesis
Music performance synthesis aims to synthesize a musical score into a na...
research
∙
02/02/2022
TONet: Tone-Octave Network for Singing Melody Extraction from Polyphonic Music
Singing melody extraction is an important problem in the field of music ...
research
∙
02/02/2022
HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection
Audio classification is an important task of mapping audio samples into ...
research
∙
01/07/2022
An Unsupervised Masking Objective for Abstractive Multi-Document News Summarization
We show that a simple unsupervised masking objective can approach near s...
research
∙
12/16/2021
Lacuna Reconstruction: Self-supervised Pre-training for Low-Resource Historical Document Transcription
We present a self-supervised pre-training approach for learning rich vis...
research
∙
12/16/2021
Masked Measurement Prediction: Learning to Jointly Predict Quantities and Units from Textual Context
Physical measurements constitute a large portion of numbers in academic ...
research
∙
12/15/2021
Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data
Deep learning techniques for separating audio into different sound sourc...
research
∙
10/08/2021
Towards a Unified View of Parameter-Efficient Transfer Learning
Fine-tuning large pre-trained language models on downstream tasks has be...
research
∙
10/05/2021
Truth-Conditional Captioning of Time Series Data
In this paper, we explore the task of automatically generating natural l...
research
∙
10/01/2021
UserIdentifier: Implicit User Representations for Simple and Effective Personalized Sentiment Analysis
Global models are trained to be as generalizable as possible, with user ...
research
∙
09/10/2021
Scalable Font Reconstruction with Dual Latent Manifolds
We propose a deep generative model that performs typography analysis and...
research
∙
09/10/2021
Style Pooling: Automatic Text Style Obfuscation for Improved Classification Fairness
Text style can reveal sensitive attributes of the author (e.g. race or a...
research
∙
09/09/2021
Efficient Nearest Neighbor Language Models
Non-parametric neural language models (NLMs) learn predictive distributi...
research
∙
08/03/2021
An Empirical Evaluation of End-to-End Polyphonic Optical Music Recognition
Previous work has shown that neural architectures are able to perform op...
research
∙
07/13/2021
Towards Automatic Instrumentation by Learning to Separate Parts in Symbolic Multitrack Music
Modern keyboards allow a musician to play multiple instruments at the sa...
research
∙
06/15/2021
Unsupervised Enrichment of Persona-grounded Dialog with Background Stories
Humans often refer to personal narratives, life experiences, and events ...
research
∙
06/04/2021
Exposing the Implicit Energy Networks behind Masked Language Models via Metropolis–Hastings
While recent work has shown that scores from models trained by the ubiqu...
research
∙
04/30/2021
Paraphrastic Representations at Scale
We present a system that allows users to train their own state-of-the-ar...
research
∙
04/16/2021
An Empirical Study of Extrapolation in Text Generation with Scalar Control
We conduct an empirical evaluation of extrapolation performance when con...
research
∙
03/12/2021
Privacy Regularization: Joint Privacy-Utility Optimization in Language Models
Neural language models are known to have a high capacity for memorizatio...
research
∙
10/07/2020
Narrative Text Generation with a Latent Discrete Plan
Past work on story generation has demonstrated the usefulness of conditi...
research
∙
10/07/2020
Like hiking? You probably enjoy nature: Persona-grounded Dialog with Commonsense Expansions
Existing persona-grounded dialog models often fail to capture simple imp...
research
∙
08/05/2020
MusPy: A Toolkit for Symbolic Music Generation
In this paper, we present MusPy, an open source Python library for symbo...
research
∙
08/04/2020
Music SketchNet: Controllable Music Generation via Factorized Representations of Pitch and Rhythm
Drawing an analogy with automatic image completion systems, we propose M...
research
∙
06/29/2020
Learning Sparse Prototypes for Text Generation
Prototype-driven text generation uses non-parametric models that first c...
research
∙
05/05/2020
Phonetic and Visual Priors for Decipherment of Informal Romanization
Informal romanization is an idiosyncratic process used by humans in info...
research
∙
05/04/2020
A Probabilistic Generative Model for Typographical Analysis of Early Modern Printing
We propose a deep and interpretable probabilistic generative model to an...
research
∙
02/10/2020
A Probabilistic Formulation of Unsupervised Text Style Transfer
We present a deep generative model for unsupervised text style transfer ...
research
∙
01/21/2020