research
∙
09/20/2023
Kosmos-2.5: A Multimodal Literate Model
We present Kosmos-2.5, a multimodal literate model for machine reading o...
share
research
∙
02/27/2023
Language Is Not All You Need: Aligning Perception with Language Models
A big convergence of language, multimodal perception, action, and world ...
research
∙
10/07/2022
Neighbor Regularized Bayesian Optimization for Hyperparameter Optimization
Bayesian Optimization (BO) is a common solution to search optimal hyperp...
research
∙
10/06/2022
XDoc: Unified Pre-training for Cross-Format Document Understanding
The surge of pre-training has witnessed the rapid development of documen...
research
∙
09/05/2022
ADTR: Anomaly Detection Transformer with Feature Reconstruction
Anomaly detection with only prior knowledge from normal samples attracts...
research
∙
06/08/2022
A Unified Model for Multi-class Anomaly Detection
Despite the rapid advance of unsupervised anomaly detection, existing me...
research
∙
05/05/2022
Invariant Content Synergistic Learning for Domain Generalization of Medical Image Segmentation
While achieving remarkable success for medical image segmentation, deep ...
research
∙
04/18/2022
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Self-supervised pre-training techniques have achieved remarkable progres...
research
∙
03/04/2022
DiT: Self-supervised Pre-training for Document Image Transformer
Image Transformer has recently achieved significant progress for natural...
research
∙
01/22/2022
Iterative Correlation-based Feature Refinement for Few-shot Counting
Few-shot counting aims to count objects of any class in an image given o...
research
∙
11/16/2021
Document AI: Benchmarks, Models and Applications
Document AI, or Document Intelligence, is a relatively new research topi...
research
∙
10/16/2021
MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding
Multimodal pre-training with text, layout, and image has made significan...
research
∙
09/21/2021
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Text recognition is a long-standing research problem for document digita...
research
∙
08/26/2021
LayoutReader: Pre-training of Text and Layout for Reading Order Detection
Reading order detection is the cornerstone to understanding visually-ric...
research
∙
06/10/2021
VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization
Video transcript summarization is a fundamental task for video understan...
research
∙
05/28/2021
AutoSampling: Search for Effective Data Sampling Schedules
Data sampling acts as a pivotal role in training deep learning models. H...
research
∙
04/18/2021
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
Multimodal pre-training with text, layout, and image has achieved SOTA p...
research
∙
12/29/2020
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
Pre-training of text and layout has proved effective in a variety of vis...
research
∙
06/01/2020
DocBank: A Benchmark Dataset for Document Layout Analysis
Document layout analysis usually relies on computer vision models to und...
research
∙
02/07/2020
Multimodal Matching Transformer for Live Commenting
Automatic live commenting aims to provide real-time comments on videos f...
research
∙
12/31/2019
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
Pre-training techniques have been verified successfully in a variety of ...
research
∙
12/17/2019
Cross-Modality Attention with Semantic Graph Embedding for Multi-Label Classification
Multi-label image and video classification are fundamental yet challengi...
research
∙
03/05/2019
TableBank: Table Benchmark for Image-based Table Detection and Recognition
We present TableBank, a new image-based table detection and recognition ...
research
∙
09/13/2018
Unsupervised Machine Commenting with Neural Variational Topic Model
Article comments can provide supplementary opinions and facts for reader...
research
∙
09/13/2018
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
We introduce the task of automatic live commenting. Live commenting, whi...
research
∙
09/12/2018
Neural Melody Composition from Lyrics
In this paper, we study a novel task that learns to compose music from n...
research
∙
09/12/2018
Retrieval-Enhanced Adversarial Training for Neural Response Generation
Dialogue systems are usually built on either generation-based or retriev...
research
∙
05/11/2018