research
∙
08/14/2023
CausalLM is not optimal for in-context learning
Recent empirical evidence indicates that transformer based in-context le...
share
research
∙
07/28/2023
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
We study how vision-language models trained on Internet-scale data can b...
research
∙
02/22/2023
Connecting Vision and Language with Video Localized Narratives
We propose Video Localized Narratives, a new form of multimodal video an...
research
∙
11/22/2022
Improving Robust Generalization by Direct PAC-Bayesian Bound Minimization
Recent research in robust optimization has shown an overfitting-like phe...
research
∙
09/14/2022
PaLI: A Jointly-Scaled Multilingual Language-Image Model
Effective scaling and a flexible task interface enable large language mo...
research
∙
09/12/2022
PreSTU: Pre-Training for Scene-Text Understanding
The ability to read and reason about texts in an image is often lacking ...
research
∙
09/12/2022
Towards Multi-Lingual Visual Question Answering
Visual Question Answering (VQA) has been primarily studied through the l...
research
∙
05/25/2022
Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset
Research in massively multilingual image captioning has been severely ha...
research
∙
05/04/2022
All You May Need for VQA are Image Captions
Visual Question Answering (VQA) has benefited from increasingly sophisti...
research
∙
04/18/2022
End-to-end Dense Video Captioning as Sequence Generation
Dense video captioning aims to identify the events of interest in an inp...
research
∙
03/10/2022
PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Tasks
With the increasing abundance of pretrained models in recent years, the ...
research
∙
07/25/2021
H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences
We describe an efficient hierarchical method to compute attention in the...
research
∙
05/28/2021
Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learning
Despite recent advances in its theoretical understanding, there still re...
research
∙
02/17/2021
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts
The availability of large-scale image captioning and visual question ans...
research
∙
02/09/2021
Telling the What while Pointing the Where: Fine-grained Mouse Trace and Language Supervision for Improved Image Retrieval
Existing image retrieval systems use text queries to provide a natural a...
research
∙
12/04/2020
Understanding Guided Image Captioning Performance across Domains
Image captioning models generally lack the capability to take into accou...
research
∙
11/10/2020
Multimodal Pretraining for Dense Video Captioning
Learning specific hands-on skills such as cooking, car maintenance, and ...
research
∙
10/13/2020
Improving Text Generation Evaluation with Batch Centering and Tempered Word Mover Distance
Recent advances in automatic evaluation metrics for text have shown that...
research
∙
10/07/2020
TeaForN: Teacher-Forcing with N-grams
Sequence generation models trained with teacher-forcing suffer from issu...
research
∙
09/29/2020
Attention that does not Explain Away
Models based on the Transformer architecture have achieved better accura...
research
∙
09/10/2020
Weakly Supervised Content Selection for Improved Image Captioning
Image captioning involves identifying semantic concepts in the scene and...
research
∙
06/15/2020
Multi-Image Summarization: Textual Summary from a Set of Cohesive Images
Multi-sentence summarization is a well studied problem in NLP, while gen...
research
∙
05/01/2020
Cross-modal Language Generation using Pivot Stabilization for Web-scale Language Coverage
Cross-modal language generation tasks such as image captioning are direc...
research
∙
04/29/2020
Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTube
Pretraining from unlabelled web videos has quickly become the de-facto m...
research
∙
12/06/2019
Connecting Vision and Language with Localized Narratives
We propose Localized Narratives, an efficient way to collect image capti...
research
∙
11/21/2019
Reinforcing an Image Caption Generator Using Off-Line Human Feedback
Human ratings are currently the most accurate way to assess the quality ...
research
∙
10/07/2019
A Case Study on Combining ASR and Visual Features for Generating Instructional Video Captions
Instructional videos get high-traffic on video sharing platforms, and pr...
research
∙
09/26/2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Increasing model size when pretraining natural language representations ...
research
∙
09/23/2019
Multi-stage Pretraining for Abstractive Summarization
Neural models for abstractive summarization tend to achieve the best per...
research
∙
09/08/2019
Quality Estimation for Image Captions Based on Large-scale Human Evaluations
Automatic image captioning has improved significantly in the last few ye...
research
∙
09/04/2019
Decoupled Box Proposal and Featurization with Ultrafine-Grained Semantic Labels Improve Image Captioning and Visual Question Answering
Object detection plays an important role in current solutions to vision ...
research
∙
06/20/2019
Informative Image Captioning with External Sources of Information
An image caption should fluently present the essential information in a ...
research
∙
04/11/2018
SHAPED: Shared-Private Encoder-Decoder for Text Style Adaptation
Supervised training of abstractive language generation models results in...
research
∙
12/22/2016
Understanding Image and Text Simultaneously: a Dual Vision-Language Machine Comprehension Task
We introduce a new multi-modal task for computer systems, posed as a com...
research
∙
12/14/2016
Multilingual Word Embeddings using Multigraphs
We present a family of neural-network--inspired models for computing con...
research
∙
12/13/2016
Building Large Machine Reading-Comprehension Datasets using Paragraph Vectors
We present a dual contribution to the task of machine reading-comprehens...
research
∙
12/16/2015