research
∙
03/21/2023
Sparse Iso-FLOP Transformations for Maximizing Training Efficiency
Recent works have explored the use of weight sparsity to improve the tra...
share
research
∙
03/18/2023
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models
The pre-training and fine-tuning paradigm has contributed to a number of...
research
∙
06/28/2022
RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network
This work introduces the RevSilo, the first reversible module for bidire...
research
∙
04/19/2021
Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation
We propose combining memory saving techniques with traditional U-Net arc...
research
∙
06/30/2020
Enabling Continual Learning with Differentiable Hebbian Plasticity
Continual learning is the problem of sequentially learning new tasks or ...
research
∙
07/24/2018