research
∙
05/30/2023
Dynamic Sparsity Is Channel-Level Sparsity Learner
Sparse training has received an upsurging interest in machine learning d...
share
research
∙
05/03/2023
Rethinking Graph Lottery Tickets: Graph Sparsity Matters
Lottery Ticket Hypothesis (LTH) claims the existence of a winning ticket...
research
∙
11/02/2022
The Lottery Ticket Hypothesis for Vision Transformers
The conventional lottery ticket hypothesis (LTH) claims that there exist...
research
∙
09/03/2022
Sion: Elastic Serverless Cloud Storage
Cloud object storage such as AWS S3 is cost-effective and highly elastic...
research
∙
02/09/2022
Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets
The lottery ticket hypothesis (LTH) has shown that dense models contain ...
research
∙
12/20/2021
Load-balanced Gather-scatter Patterns for Sparse Deep Neural Networks
Deep neural networks (DNNs) have been proven to be effective in solving ...
research
∙
07/09/2021
A Topological-Framework to Improve Analysis of Machine Learning Model Performance
As both machine learning models and the datasets on which they are evalu...
research
∙
07/01/2021
Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?
There have been long-standing controversies and inconsistencies over the...
research
∙
06/16/2021
Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI
Recent research demonstrated the promise of using resistive random acces...
research
∙
06/16/2021
FORMS: Fine-grained Polarized ReRAM-based In-situ Computation for Mixed-signal DNN Accelerator
Recent works demonstrated the promise of using resistive random access m...
research
∙
02/19/2021
Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?
In deep model compression, the recent finding "Lottery Ticket Hypothesis...
research
∙
05/11/2020
CSB-RNN: A Faster-than-Realtime RNN Acceleration Framework with Compressed Structured Blocks
Recurrent neural networks (RNNs) have been widely adopted in temporal se...
research
∙
04/12/2020
A Unified DNN Weight Compression Framework Using Reweighted Optimization Methods
To address the large model size and intensive computation requirement of...
research
∙
03/13/2020
A Privacy-Preserving DNN Pruning and Mobile Acceleration Framework
To facilitate the deployment of deep neural networks (DNNs) on resource-...
research
∙
02/11/2020
PCNN: Pattern-based Fine-Grained Regular Pruning towards Optimizing CNN Accelerators
Weight pruning is a powerful technique to realize model compression. We ...
research
∙
01/28/2020
InfiniCache: Exploiting Ephemeral Serverless Functions to Build a Cost-Effective Memory Cache
Internet-scale web applications are becoming increasingly storage-intens...
research
∙
01/23/2020
SS-Auto: A Single-Shot, Automatic Structured Weight Pruning Framework of DNNs with Ultra-High Efficiency
Structured weight pruning is a representative model compression techniqu...
research
∙
01/23/2020
BLK-REW: A Unified Block-based DNN Pruning Framework using Reweighted Regularization Method
Accelerating DNN execution on various resource-limited computing platfor...
research
∙
01/20/2020
An Image Enhancing Pattern-based Sparsity for Real-time Inference on Mobile Devices
Weight pruning has been widely acknowledged as a straightforward and eff...
research
∙
01/01/2020
PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning
With the emergence of a spectrum of high-end mobile devices, many applic...
research
∙
11/24/2019
A SOT-MRAM-based Processing-In-Memory Engine for Highly Compressed DNN Implementation
The computing wall and data movement challenges of deep neural networks ...
research
∙
09/06/2019
PCONV: The Missing but Desirable Sparsity in DNN Weight Pruning for Real-time Execution on Mobile Devices
Model compression techniques on Deep Neural Network (DNN) have been wide...
research
∙
08/29/2019
An Ultra-Efficient Memristor-Based DNN Framework with Structured Weight Pruning and Quantization Using ADMM
The high computation and memory storage of large deep neural networks (D...
research
∙
08/27/2019
Tiny but Accurate: A Pruned, Quantized and Optimized Memristor Crossbar Framework for Ultra Efficient DNN Implementation
The state-of-art DNN structures involve intensive computation and high m...
research
∙
07/06/2019
AutoSlim: An Automatic DNN Structured Pruning Framework for Ultra-High Compression Rates
Structured weight pruning is a representative model compression techniqu...
research
∙
07/06/2019
AutoCompress: An Automatic DNN Structured Pruning Framework for Ultra-High Compression Rates
Structured weight pruning is a representative model compression techniqu...
research
∙
07/03/2019
Non-structured DNN Weight Pruning Considered Harmful
Large deep neural network (DNN) models pose the key challenge to energy ...
research
∙
05/02/2019
Toward Extremely Low Bit and Lossless Accuracy in DNNs with Progressive ADMM
Weight quantization is one of the most important techniques of Deep Neur...
research
∙
05/02/2019
26ms Inference Time for ResNet-50: Towards Real-Time Execution of all DNNs on Smartphone
With the rapid emergence of a spectrum of high-end mobile devices, many ...
research
∙
04/30/2019
ResNet Can Be Pruned 60x: Introducing Network Purification and Unused Path Removal (P-RM) after Weight Pruning
The state-of-art DNN structures involve high computation and great deman...
research
∙
03/23/2019
Progressive DNN Compression: A Key to Achieve Ultra-High Weight Pruning and Quantization Rates using ADMM
Weight pruning and weight quantization are two important categories of D...
research
∙
03/28/2018
Structured Weight Matrices-Based Hardware Accelerators in Deep Neural Networks: FPGAs and ASICs
Both industry and academia have extensively investigated hardware accele...
research
∙
03/20/2018
C3PO: Database and Benchmark for Early-stage Malicious Activity Detection in 3D Printing
Increasing malicious users have sought practices to leverage 3D printing...
research
∙
02/18/2018
Towards Ultra-High Performance and Energy Efficiency of Deep Learning Systems: An Algorithm-Hardware Co-Optimization Framework
Hardware accelerations of deep learning systems have been extensively in...
research
∙
02/15/2018
Image Dataset for Visual Objects Classification in 3D Printing
The rapid development in additive manufacturing (AM), also known as 3D p...
research
∙
02/03/2018
An Area and Energy Efficient Design of Domain-Wall Memory-Based Deep Convolutional Neural Networks using Stochastic Computing
With recent trend of wearable devices and Internet of Things (IoTs), it ...
research
∙
08/29/2017
CirCNN: Accelerating and Compressing Deep Neural Networks Using Block-CirculantWeight Matrices
Large-scale deep neural networks (DNNs) are both compute and memory inte...
research
∙
11/25/2016