research
∙
08/08/2023
All-pairs Consistency Learning for Weakly Supervised Semantic Segmentation
In this work, we propose a new transformer-based regularization to bette...
share
research
∙
07/27/2023
Scaling TransNormer to 175 Billion Parameters
We present TransNormerLLM, the first linear attention-based Large Langua...
research
∙
07/19/2023
Exploring Transformer Extrapolation
Length extrapolation has attracted considerable attention recently since...
research
∙
07/18/2023
Linearized Relative Positional Encoding
Relative positional encoding is widely used in vanilla and linear transf...
research
∙
07/11/2023
PePNet: A Periodicity-Perceived Workload Prediction Network Supporting Rare Occurrence of Heavy Workload
Cloud providers can greatly benefit from accurate workload prediction. H...
research
∙
06/15/2023
Stable Tomography for Structured Quantum States
The reconstruction of quantum states from experimental measurements, oft...
research
∙
06/14/2023
Learning to Rank when Grades Matter
Graded labels are ubiquitous in real-world learning-to-rank applications...
research
∙
06/07/2023
RD-Suite: A Benchmark for Ranking Distillation
The distillation of ranking models has become an important topic in both...
research
∙
05/08/2023
Toeplitz Neural Network for Sequence Modeling
Sequence modeling has important applications in natural language process...
research
∙
05/05/2023
Query Expansion by Prompting Large Language Models
Query expansion is a widely used technique to improve the recall of sear...
research
∙
03/27/2023
Fine-grained Audible Video Description
We explore a new task for audio-visual-language modeling called fine-gra...
research
∙
12/21/2022
Learning List-Level Domain-Invariant Representations for Ranking
Domain adaptation aims to transfer the knowledge acquired by models trai...
research
∙
11/02/2022
Regression Compatible Listwise Objectives for Calibrated Ranking
As Learning-to-Rank (LTR) approaches primarily seek to improve ranking q...
research
∙
10/19/2022
The Devil in Linear Transformer
Linear transformers aim to reduce the quadratic space-time complexity of...
research
∙
10/15/2022
Linear Video Transformer with Feature Fixation
Vision Transformers have achieved impressive performance in video classi...
research
∙
10/12/2022
RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses
Recently, substantial progress has been made in text ranking based on pr...
research
∙
10/11/2022
Retrieval Augmentation for T5 Re-ranker using External Sources
Retrieval augmentation has shown promising improvements in different tas...
research
∙
09/21/2022
A Validation Approach to Over-parameterized Matrix and Image Recovery
In this paper, we study the problem of recovering a low-rank matrix from...
research
∙
07/28/2022
Neural Architecture Search on Efficient Transformers and Beyond
Recently, numerous efficient Transformers have been proposed to reduce t...
research
∙
07/09/2022
Error Analysis of Tensor-Train Cross Approximation
Tensor train decomposition is widely used in machine learning and quantu...
research
∙
06/21/2022
Vicinity Vision Transformer
Vision transformers have shown great success on numerous computer vision...
research
∙
05/21/2022
Secure and Efficient Decentralized Federated Learning with Data Representation Protection
Federated learning (FL) is a promising technical support to the vision o...
research
∙
04/25/2022
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference
State-of-the-art neural models typically encode document-query pairs usi...
research
∙
02/17/2022
cosFormer: Rethinking Softmax in Attention
Transformer has shown great successes in natural language processing, co...
research
∙
12/17/2021
Rank4Class: A Ranking Formulation for Multiclass Classification
Multiclass classification (MCC) is a fundamental machine learning proble...
research
∙
09/30/2021
Born Again Neural Rankers
We introduce Born Again neural Rankers (BAR) in the Learning to Rank (LT...
research
∙
06/23/2021
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization
State-of-the-art models in natural language processing rely on separate ...
research
∙
05/07/2021
Are Pre-trained Convolutions Better than Pre-trained Transformers?
In the era of pre-trained language models, Transformers are the de facto...
research
∙
03/01/2021
OmniNet: Omnidirectional Representations from Transformers
This paper proposes Omnidirectional Representations from Transformers (O...
research
∙
01/20/2021
Air-Ground Collaborative Mobile Edge Computing: Architecture, Challenges, and Opportunities
By pushing computation, cache, and network control to the edge, mobile e...
research
∙
12/21/2020
DeepKeyGen: A Deep Learning-based Stream Cipher Generator for Medical Image Encryption and Decryption
The need for medical image encryption is increasingly pronounced, for ex...
research
∙
06/06/2020
Do RNN and LSTM have Long Memory?
The LSTM network was proposed to overcome the difficulty in learning lon...
research
∙
06/28/2019
An Improvement of PAA on Trend-Based Approximation for Time Series
Piecewise Aggregate Approximation (PAA) is a competitive basic dimension...
research
∙
09/15/2018