research
∙
07/13/2023
AutoHint: Automatic Prompt Optimization with Hint Generation
This paper presents AutoHint, a novel framework for automatic prompt eng...
share
research
∙
06/30/2023
DeepTagger: Knowledge Enhanced Named Entity Recognition for Web-Based Ads Queries
Named entity recognition (NER) is a crucial task for online advertisemen...
research
∙
05/16/2023
AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
Diffusion models have gained significant attention in the realm of image...
research
∙
05/16/2023
Dual-Alignment Pre-training for Cross-lingual Sentence Embedding
Recent studies have shown that dual encoder models trained with the sent...
research
∙
03/29/2023
AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators
Many natural language processing (NLP) tasks rely on labeled data to tra...
research
∙
03/28/2023
Pre-training Transformers for Knowledge Graph Completion
Learning transferable representation of knowledge graphs (KGs) is challe...
research
∙
12/18/2022
Curriculum Sampling for Dense Retrieval with Document Expansion
The dual-encoder has become the de facto architecture for dense retrieva...
research
∙
12/15/2022
Efficient Long Sequence Modeling via State Space Augmented Transformer
Transformer models have achieved superior performance in various natural...
research
∙
12/10/2022
LEAD: Liberal Feature-based Distillation for Dense Retrieval
Knowledge distillation is often used to transfer knowledge from a strong...
research
∙
10/21/2022
Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoning
Commonsense generation aims to generate a realistic sentence describing ...
research
∙
09/27/2022
PROD: Progressive Distillation for Dense Retrieval
Knowledge distillation is an effective way to transfer knowledge from a ...
research
∙
08/17/2022
The Counterfactual-Shapley Value: Attributing Change in System Metrics
Given an unexpected change in the output metric of a large-scale system,...
research
∙
07/10/2022
NGAME: Negative Mining-aware Mini-batching for Extreme Classification
Extreme Classification (XC) seeks to tag data points with the most relev...
research
∙
05/23/2022
A Self-Paced Mixed Distillation Method for Non-Autoregressive Generation
Non-Autoregressive generation is a sequence generation paradigm, which r...
research
∙
04/04/2022
Age of Information with Hybrid-ARQ: A Unified Explicit Result
Delivering timely status updates in a timeliness-critical communication ...
research
∙
10/08/2021
Taming Sparsely Activated Transformer with Stochastic Experts
Sparsely activated models (SAMs), such as Mixture-of-Experts (MoE), can ...
research
∙
09/14/2021
KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning
Pre-trained language models have led to substantial gains over a broad r...
research
∙
03/25/2021
Mask Attention Networks: Rethinking and Strengthen Transformer
Transformer is an attention-based neural network, which consists of two ...
research
∙
01/20/2021
Spinal Codes Optimization: Error Probability Analysis and Transmission Scheme Design
Spinal codes are known to be capacity achieving over both the additive w...
research
∙
12/01/2020
An Enhanced Knowledge Injection Model for Commonsense Generation
Commonsense generation aims at generating plausible everyday scenario de...
research
∙
10/21/2020
ProphetNet-Ads: A Looking Ahead Strategy for Generative Retrieval Models in Sponsored Search Engine
In a sponsored search engine, generative retrieval models are recently p...
research
∙
08/28/2020
HittER: Hierarchical Transformers for Knowledge Graph Embeddings
This paper examines the challenging problem of learning representations ...
research
∙
02/14/2020
TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval
Pre-trained language models like BERT have achieved great success in a w...
research
∙
11/27/2018
MagicVO: End-to-End Monocular Visual Odometry through Deep Bi-directional Recurrent Convolutional Neural Network
This paper proposes a new framework to solve the problem of monocular vi...
research
∙
05/25/2018
A Novel High-Rate Polar-Staircase Coding Scheme
The long-haul communication systems can offer ultra high-speed data tran...
research
∙
02/18/2018