B1: Carbon-aware Multi-site Workflow Scheduling Under Uncertainty

Continued from B1: Scheduling and Adaptive Execution of Data Analysis Workflows across Heterogeneous Infrastructures

Description

Data centers are significant contributors to carbon emissions, which are highly influenced by a center’s spatiotemporal variability of energy sources and the time of executing a workload. We reduce the carbon footprint of multi-site DAW executions by investigating methods that characterize the energy and carbon emissions of sites over time to create task and machine profiles used for infrastructure-aware and carbon-aware mapping and scheduling under uncertainty.

Scientists

  • Jonathan Bader
  • Dominik Schweisgut

Publications

28 entries « 1 of 3 »

2025

Lehmann, Fabian; Bader, Jonathan; Tschirpke, Friedrich; Mecquenem, Ninon De; Lößer, Ansgar; Becker, Sören; Lewińska, Katarzyna Ewa; Thamsen, Lauritz; Leser, Ulf

WOW: Workflow-Aware Data Movement and Task Scheduling for Dynamic Scientific Workflows Proceedings Article

In: 2025 IEEE 25th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), Tromsø, Norway, 2025.

BibTeX

Kulagina, Svetlana; Benoit, Anne; Meyerhenke, Henning

Memory-aware Adaptive Scheduling of Scientific Workflows On Heterogeneous Architectures Proceedings Article

In: 2025 IEEE 25th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), Tromsø, Norway, 2025.

BibTeX

Will, Jonathan; Thamsen, Lauritz; Bader, Jonathan; Kao, Odej

Flora: Efficient Cloud Resource Selection for Big Data Processing via Job Classification Proceedings Article

In: IEEE International Symposium on Cluster, Cloud, and Internet Computing (CCGRID), IEEE, 2025.

Links | BibTeX

2024

Bader, Jonathan; Skalski, Fabian; Lehmann, Fabian; Scheinert, Dominik; Will, Jonathan; Thamsen, Lauritz; Kao, Odej

Sizey: Memory-Efficient Execution of Scientific Workflow Tasks Proceedings Article

In: 2024 IEEE International Conference on Cluster Computing (CLUSTER), 2024.

Links | BibTeX

Bader, Jonathan; Lößer, Ansgar; Thamsen, Lauritz; Scheuermann, Björn; Kao, Odej

KS+: Predicting Workflow Task Memory Usage Over Time Proceedings Article

In: 2024 IEEE 20th International Conference on e-Science (e-Science), 2024.

Links | BibTeX

Bader, Jonathan; Lehmann, Fabian; Thamsen, Lauritz; Leser, Ulf; Kao, Odej

Lotaru: Locally predicting workflow task runtimes for resource management on heterogeneous infrastructures Journal Article

In: Future Generation Computer Systems, vol. 150, pp. 171-185, 2024, ISSN: 0167-739X.

Links | BibTeX

2023

Bader, Jonathan; Diedrich, Nils; Thamsen, Lauritz; Kao, Odej

Predicting Dynamic Memory Requirements for Scientific Workflow Tasks Proceedings Article

In: 2023 IEEE International Conference on Big Data (Big Data), 2023.

Links | BibTeX

Bader, Jonathan; Belak, Jim; Bement, Matthew; Berry, Matthew; Carson, Robert; Cassol, Daniela; Chan, Stephen; Coleman, John; Day, Kastan; Duque, Alejandro; others,

Novel Approaches Toward Scalable Composable Workflows in Hyper-Heterogeneous Computing Environments Proceedings Article

In: Proceedings of the SC'23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis, pp. 2097–2108, 2023.

Links | BibTeX

Lehmann, Fabian; Bader, Jonathan; Thamsen, Lauritz; Leser, Ulf

The Common Workflow Scheduler Interface: Status Quo and Future Plans Proceedings Article

In: Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis (SC-W 2023), ACM, Denver, Colorado, 2023, ISBN: 979-8-4007-0785-8/23/11.

Links | BibTeX

Kulagina, Svetlana; Meyerhenke, Henning; Benoit, Anne

Mapping Tree-shaped Workflows on Systems with Different Memory Sizes and Processor Speeds Journal Article

In: Concurrency and Computation: Practice and Experience, 2023.

Abstract | BibTeX

28 entries « 1 of 3 »