research
∙
02/23/2023
Hera: A Heterogeneity-Aware Multi-Tenant Inference Server for Personalized Recommendations
While providing low latency is a fundamental requirement in deploying re...
share
research
∙
02/27/2022
PARIS and ELSA: An Elastic Scheduling Algorithm for Reconfigurable Multi-GPU Inference Servers
In cloud machine learning (ML) inference systems, providing low latency ...
research
∙
10/25/2020
LazyBatching: An SLA-aware Batching System for Cloud Machine Learning Inference
In cloud ML inference systems, batching is an essential technique to inc...
research
∙
11/15/2019
NeuMMU: Architectural Support for Efficient Address Translations in Neural Processing Units
To satisfy the compute and memory demands of deep neural networks, neura...
research
∙
09/06/2019