research
∙
08/19/2023
Understanding Self-attention Mechanism via Dynamical System Perspective
The self-attention mechanism (SAM) is widely used in various fields of a...
share
research
∙
05/09/2023
LSAS: Lightweight Sub-attention Strategy for Alleviating Attention Bias Problem
In computer vision, the performance of deep neural networks (DNNs) is hi...
research
∙
05/09/2023
SUR-adapter: Enhancing Text-to-Image Pre-trained Diffusion Models with Large Language Models
Diffusion models, which have emerged to become popular text-to-image gen...
research
∙
04/13/2023
ASR: Attention-alike Structural Re-parameterization
The structural re-parameterization (SRP) technique is a novel deep learn...
research
∙
02/05/2023
On Robust Numerical Solver for ODE via Self-Attention Mechanism
With the development of deep learning techniques, AI-enhanced numerical ...
research
∙
10/27/2022
Layer-wise Shared Attention Network on Dynamical System Perspective
Attention networks have successfully boosted accuracy in various vision ...
research
∙
10/27/2022
Deepening Neural Networks Implicitly and Locally via Recurrent Attention Strategy
More and more empirical and theoretical evidence shows that deepening ne...
research
∙
10/06/2022
Causal Inference for Chatting Handoff
Aiming to ensure chatbot quality by predicting chatbot failure and enabl...
research
∙
08/07/2022
Accelerating Numerical Solvers for Large-Scale Simulation of Dynamical System via NeurVec
Ensemble-based large-scale simulation of dynamical systems is essential ...
research
∙
11/30/2020
Continuous Transition: Improving Sample Efficiency for Continuous Control Problems via MixUp
Although deep reinforcement learning (RL) has been successfully applied ...
research
∙
11/28/2020
Efficient Attention Network: Accelerate Attention by Searching Where to Plug
Recently, many plug-and-play self-attention modules are proposed to enha...
research
∙
04/24/2020
Convolution-Weight-Distribution Assumption: Rethinking the Criteria of Channel Pruning
Channel pruning is one of the most important techniques for compressing ...
research
∙
08/12/2019
Instance Enhancement Batch Normalization: an Adaptive Regulator of Batch Noise
Batch Normalization (BN) (Ioffe and Szegedy 2015) normalizes the feature...
research
∙
05/25/2019