research
∙
09/13/2023
Lotaru: Locally Predicting Workflow Task Runtimes for Resource Management on Heterogeneous Infrastructures
Many resource management techniques for task scheduling, energy and carb...
share
research
∙
03/31/2023
Workflows Community Summit 2022: A Roadmap Revolution
Scientific workflows have become integral tools in broad scientific comp...
research
∙
02/15/2023
How Workflow Engines Should Talk to Resource Managers: A Proposal for a Common Workflow Scheduling Interface
Scientific workflow management systems (SWMSs) and resource managers tog...
research
∙
11/23/2022
Towards Advanced Monitoring for Scientific Workflows
Scientific workflows consist of thousands of highly parallelized tasks e...
research
∙
11/22/2022
Leveraging Reinforcement Learning for Task Resource Allocation in Scientific Workflows
Scientific workflows are designed as directed acyclic graphs (DAGs) and ...
research
∙
11/15/2022
Perona: Robust Infrastructure Fingerprinting for Resource-Efficient Big Data Analytics
Choosing a good resource configuration for big data analytics applicatio...
research
∙
11/08/2022
Ruya: Memory-Aware Iterative Optimization of Cluster Configurations for Big Data Processing
Selecting appropriate computational resources for data processing jobs o...
research
∙
10/17/2022
Macaw: The Machine Learning Magnetometer Calibration Workflow
In Earth Systems Science, many complex data pipelines combine different ...
research
∙
08/16/2022
Reshi: Recommending Resources for Scientific Workflow Tasks on Heterogeneous Infrastructures
Scientific workflows typically comprise a multitude of different process...
research
∙
06/28/2022
Get Your Memory Right: The Crispy Resource Allocation Assistant for Large-Scale Data Processing
Distributed dataflow systems like Apache Spark and Apache Hadoop enable ...
research
∙
06/01/2022
Collaborative Cluster Configuration for Distributed Data-Parallel Processing: A Research Overview
Many organizations routinely analyze large datasets using systems for di...
research
∙
05/23/2022
Lotaru: Locally Estimating Runtimes of Scientific Workflow Tasks in Heterogeneous Clusters
Many scientific workflow scheduling algorithms need to be informed about...
research
∙
03/28/2022
SyncMesh: Improving Data Locality for Function-as-a-Service in Meshed Edge Networks
The increasing use of Internet of Things devices coincides with more com...
research
∙
11/16/2021
On the Potential of Execution Traces for Batch Processing Workload Optimization in Public Clouds
With the growing amount of data, data processing workloads and the manag...
research
∙
11/15/2021
Training Data Reduction for Performance Models of Data Analytics Jobs in the Cloud
Distributed dataflow systems like Apache Flink and Apache Spark simplify...
research
∙
11/09/2021
Tarema: Adaptive Resource Allocation for Scalable Scientific Workflows in Heterogeneous Clusters
Scientific workflow management systems like Nextflow support large-scale...
research
∙
08/30/2021
AuctionWhisk: Using an Auction-Inspired Approach for Function Placement in Serverless Fog Platforms
The Function-as-a-Service (FaaS) paradigm has a lot of potential as a co...
research
∙
07/28/2021
C3O: Collaborative Cluster Configuration Optimization for Distributed Data Processing in Public Clouds
Distributed dataflow systems enable data-parallel processing of large da...
research
∙
11/16/2020