FONDA PhD Defense: Fabian Lehmann on “Adaptive Scheduling of Dynamic Workflows”

Fabian Lehmann defended his dissertation, “Adaptive Scheduling of Dynamic Workflows” with distinction on June 29th, 2026. Fabian was a member of subproject B5 in FONDA Phase I. His work examines the tradeoff between workflow portability and efficiency, and introduces WONDERS, a best of both worlds optimization strategy for Nextflow workflows.

In order for scientific workflows to be portable, workflow management systems such as Nextflow cannot rely on hard-coded assumptions about the dataset or underlying infrastructure to improve efficiency. WONDERS utilizes the Common Workflow Scheduling Interface (CWSI), developed by Fabian, to bring workflow context to the resource manager, then combines his three novel approaches for workflow optimization: WOW, PONDER, and SCALE.

WOW is a scheduling approach which reduces network congestion within a cluster by basing scheduling decisions primarily on the co-location of tasks and data. PONDER and SCALE are tools which predict and minimize the ongoing use of memory (PONDER) and CPU (SCALE) over the course of a workflow execution. The combination of the three techniques in WONDERS results in super-additive improvements in workflow makespan (average reduction ~50% compared to nf-core default settings) when tested on a variety of Nextflow workflows using real-world data from remote sensing and bioinformatics.

Congratulations Fabian!

Our book is published!

FONDA members, along with over 100 co-authors from 54 organizations in 17 countries, are proud to present Workflow Systems for Large-Scale Scientific Data Analysis!

The book’s 25 chapters are divided into four main areas (1) Introduction, (2) Systems, (3) Applications, and (4) Technologies, and cover the current state of the art in workflow research for scientific data analysis. The book is open access, and digital copies can be downloaded for free. Hard copies can also be ordered (at the same link) for € 42 each.

Book Cover for Workflow systems for large scale scientific data analysis

We would especially like to thank the editors of the book, Rafael Ferreira da Silva, Sean Wilkinson, Marcus Hilbrich, and Ulf Leser. Funding for the first edition, along with much of the underlying research was provided by the German Research Foundation (DFG). The book is published by Berlin Universities Publishing. Finally, thanks to all the co-authors for their contributions and ongoing support!

Links to the individual chapters along with a comprehensive author list for each can be found here: The Workflow Book

November 25th-26th: Workshop on reducing carbon emissions in large-scale computational data analysis

On Tuesday November 25th, in lieu of our normal Lecture Series talks, we will begin our Workshop on reducing carbon emissions in large-scale computational data analysis! The workshop will continue on Wednesday with more speakers and opportunities for discussion.

The workshop was planned in collaboration with the Quantitative Biology Center (QBiC), the bioinformatics core facility from the University of Tübingen. We have invited 14 speakers from around Europe and the UK to discuss current research into the environmental impacts of large scale scientific computing. More information, including the schedule, can be found here.