Continued from B1: Scheduling and Adaptive Execution of Data Analysis Workflows across Heterogeneous Infrastructures
Description
Data centers are significant contributors to carbon emissions, which are highly influenced by a center’s spatiotemporal variability of energy sources and the time of executing a workload. We reduce the carbon footprint of multi-site DAW executions by investigating methods that characterize the energy and carbon emissions of sites over time to create task and machine profiles used for infrastructure-aware and carbon-aware mapping and scheduling under uncertainty.

Scientists
- Jonathan Bader
- Dominik Schweisgut
Publications
2025
WOW: Workflow-Aware Data Movement and Task Scheduling for Dynamic Scientific Workflows Proceedings Article
In: 2025 IEEE 25th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), Tromsø, Norway, 2025.
Memory-aware Adaptive Scheduling of Scientific Workflows On Heterogeneous Architectures Proceedings Article
In: 2025 IEEE 25th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), Tromsø, Norway, 2025.
Flora: Efficient Cloud Resource Selection for Big Data Processing via Job Classification Proceedings Article
In: IEEE International Symposium on Cluster, Cloud, and Internet Computing (CCGRID), IEEE, 2025.
2024
Sizey: Memory-Efficient Execution of Scientific Workflow Tasks Proceedings Article
In: 2024 IEEE International Conference on Cluster Computing (CLUSTER), 2024.
KS+: Predicting Workflow Task Memory Usage Over Time Proceedings Article
In: 2024 IEEE 20th International Conference on e-Science (e-Science), 2024.
Lotaru: Locally predicting workflow task runtimes for resource management on heterogeneous infrastructures Journal Article
In: Future Generation Computer Systems, vol. 150, pp. 171-185, 2024, ISSN: 0167-739X.
2023
Predicting Dynamic Memory Requirements for Scientific Workflow Tasks Proceedings Article
In: 2023 IEEE International Conference on Big Data (Big Data), 2023.
Novel Approaches Toward Scalable Composable Workflows in Hyper-Heterogeneous Computing Environments Proceedings Article
In: Proceedings of the SC'23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis, pp. 2097–2108, 2023.
The Common Workflow Scheduler Interface: Status Quo and Future Plans Proceedings Article
In: Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis (SC-W 2023), ACM, Denver, Colorado, 2023, ISBN: 979-8-4007-0785-8/23/11.
Mapping Tree-shaped Workflows on Systems with Different Memory Sizes and Processor Speeds Journal Article
In: Concurrency and Computation: Practice and Experience, 2023.