Data Aware Scheduling Method Now Available for Nextflow

With the latest release of the nf-cws Nextflow-Plugin, Fabian Lehmann and Friedrich Tschirpke introduce the WOW scheduling method as a production-ready feature. This release marks the transition of the WOW approach from a research prototype to a usable software component, fully integrated with the official Nextflow versions (v24.04.0 up to v25.02.3-edge).

Key Features:

  • WOW Scheduling for Nextflow: The Workflow-Aware data movement and task scheduling (WOW) method is now available as part of nf-cws. This enables dynamic coordination of data transfers and task execution, reducing network congestion and workflow runtime.
  • Seamless Integration: The nf-cws plugin can be used directly with Nextflow’s Kubernetes executor, requiring no experimental patches or custom setups.
  • Production Use: The improvements demonstrated in the original publication can now be leveraged by all Nextflow users in real-world scenarios.

-Fabian Lehmann