research
∙
07/03/2023
Rockmate: an Efficient, Fast, Automatic and Generic Tool for Re-materialization in PyTorch
We propose Rockmate to control the memory requirements when training PyT...
share
research
∙
02/21/2022
Survey on Large Scale Neural Network Training
Modern Deep Neural Networks (DNNs) require significant memory to store w...
research
∙
02/21/2022
I/O-Optimal Algorithms for Symmetric Linear Algebra Kernels
In this paper, we consider two fundamental symmetric kernels in linear a...
research
∙
11/09/2020
Geometric Deep Reinforcement Learning for Dynamic DAG Scheduling
In practice, it is quite common to face combinatorial optimization probl...
research
∙
11/27/2019
Optimal checkpointing for heterogeneous chains: how to train deep neural networks with limited memory
This paper introduces a new activation checkpointing method which allows...
research
∙
09/25/2019
Scheduling on Two Types of Resources: a Survey
We study the problem of executing an application represented by a preced...
research
∙
02/13/2019