research
∙
05/22/2023
Flover: A Temporal Fusion Framework for Efficient Autoregressive Model Parallel Inference
In the rapidly evolving field of deep learning, the performance of model...
share
research
∙
03/15/2023
MCR-DL: Mix-and-Match Communication Runtime for Deep Learning
In recent years, the training requirements of many state-of-the-art Deep...
research
∙
03/09/2023
Performance Characterization of using Quantization for DNN Inference on Edge Devices: Extended Version
Quantization is a popular technique used in Deep Neural Networks (DNN) i...
research
∙
10/20/2021
OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems
Python has become a dominant programming language for emerging areas lik...
research
∙
09/17/2021
Cross-layer Visualization and Profiling of Network and I/O Communication for HPC Clusters
Understanding and visualizing the full-stack performance trade-offs and ...
research
∙
01/21/2021
Efficient MPI-based Communication for GPU-Accelerated Dask Applications
Dask is a popular parallel and distributed computing framework, which ri...
research
∙
11/12/2019
HyPar-Flow: Exploiting MPI and Keras for Scalable Hybrid-Parallel DNN Training using TensorFlow
The enormous amount of data and computation required to train DNNs have ...
research
∙
10/25/2018
Scalable Distributed DNN Training using TensorFlow and CUDA-Aware MPI: Characterization, Designs, and Performance Evaluation
TensorFlow has been the most widely adopted Machine/Deep Learning framew...
research
∙
07/27/2016