B5: Transparent Multi-Site Data Analysis Workflows for Earth Observation

Continued from B5: Adaptive, Distributed and Scalable Analysis of Massive Satellite Data

Description

DAWs for satellite data analysis are highly heterogeneous and complex in terms of input data, software, and resource requirements. Furthermore, data for DAWs are often available at different data centers, with data download being a major bottleneck in DAWs execution.

Our goal is to expand orchestration of Earth Observation Workflows (EOWs) from FONDA I to a federated multi-center scenario to enable analysis of changes in agricultural land use over very large, heterogeneous and distributed data sets.

Scientists

  • Felix Kummer
  • Katarzyna Ewa Lewińska

Publications

29 entries « 2 of 3 »

2023

Lehmann, Fabian; Bader, Jonathan; Thamsen, Lauritz; Leser, Ulf

The Common Workflow Scheduler Interface: Status Quo and Future Plans Proceedings Article

In: Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis (SC-W 2023), ACM, Denver, Colorado, 2023, ISBN: 979-8-4007-0785-8/23/11.

Links | BibTeX

Lewińska, Katarzyna Ewa; Frantz, David; Leser, Ulf; Hostert, Patrick

Usable Observations over Europe: Evaluation of Compositing Windows for Landsat and Sentinel-2 Time Series Journal Article

In: Preprints, 2023.

Links | BibTeX

Lehmann, Fabian; Bader, Jonathan; Tschirpke, Friedrich; Thamsen, Lauritz; Leser, Ulf

How Workflow Engines Should Talk to Resource Managers: A Proposal for a Common Workflow Scheduling Interface Proceedings Article

In: 2023 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGrid), pp. 166-179, 2023.

Links | BibTeX

Schintke, Florian; De Mecquenem, Ninon; Frantz, David; Guarino, Vanessa Emanuela; Hilbrich, Marcus; Lehmann, Fabian; Sattler, Rebecca; Sparka, Jan Arne; Speckhard, Daniel T.; Stolte, Hermann; Vu, Anh Duc; Leser, Ulf

Validity Constraints for Data Analysis Workflows Miscellaneous

2023.

BibTeX

Silva, Rafael Ferreira Da; Badia, Rosa M.; Bala, Venkat; Bard, Debbie; Bremer, Peer-Timo; Buckley, Ian; Caino-Lores, Silvina; Chard, Kyle; Goble, Carole; Jha, Shantenu; Katz, Daniel S.; Laney, Daniel; Parashar, Manish; Suter, Frederic; Tyler, Nick; Uram, Thomas; Altintas, Ilkay; Andersson, Stefan; Arndt, William; Aznar, Juan; Bader, Jonathan; Balis, Bartosz; Blanton, Chris; Braghetto, Kelly Rosa; Brodutch, Aharon; Brunk, Paul; Casanova, Henri; Lierta, Alba Cervera; Chigu, Justin; Coleman, Taina; Collier, Nick; Colonnelli, Iacopo; Coppens, Frederik; Crusoe, Michael; Cunningham, Will; Kinoshita, Bruno De Paula; Tommaso, Paolo Di; Doutriaux, Charles; Downton, Matthew; Elwasif, Wael; Enders, Bjoern; Erdmann, Chris; Fahringer, Thomas; Figueiredo, Ludmilla; Filgueira, Rosa; Foltin, Martin; Fouilloux, Anne; Gadelha, Luiz; Gallo, Andy; Saez, Artur Garcia; Garijo, Daniel; Gerlach, Roman; Grant, Ryan; Grayson, Samuel; Grubel, Patricia; Gustafsson, Johan; Hayot-Sasson, Valerie; Hernandez, Oscar; Hilbrich, Marcus; Justine, AnnMary; Laflotte, Ian; Lehmann, Fabian; Luckow, Andre; Luettgau, Jakob; Maheshwari, Ketan; Matsuda, Motohiko; Medic, Doriana; Mendygral, Pete; Michalewicz, Marek; Nonaka, Jorji; Pawlik, Maciej; Pottier, Loic; Pouchard, Line; Putz, Mathias; Radha, Santosh Kumar; Ramakrishnan, Lavanya; Ristov, Sashko; Romano, Paul; Rosendo, Daniel; Ruefenacht, Martin; Rycerz, Katarzyna; Saurabh, Nishant; Savchenko, Volodymyr; Schulz, Martin; Simpson, Christine; Sirvent, Raul; Skluzacek, Tyler; Soiland-Reyes, Stian; Souza, Renan; Sukumar, Sreenivas Rangan; Sun, Ziheng; Sussman, Alan; Thain, Douglas; Titov, Mikhail; Tovar, Benjamin; Tripathy, Aalap; Turilli, Matteo; Tuznik, Bartosz; Dam, Hubertus Van; Vivas, Aurelio; Ward, Logan; Widener, Patrick; Wilkinson, Sean; Zawalska, Justyna; Zulfiqar, Mahnoor

Workflows Community Summit 2022: A Roadmap Revolution Miscellaneous

2023.

Links | BibTeX

Jakimow, Benjamin; Janz, Andreas; Thiel, Fabian; Okujeni, Akpona; Hostert, Patrick; Linden, Sebastian

EnMAP-Box: Imaging spectroscopy in QGIS Journal Article

In: SoftwareX, vol. 23, pp. 101507, 2023.

BibTeX

Sänger, Mario; De Mecquenem, Ninon; Lewińska, Katarzyna Ewa; Bountris, Vasilis; Lehmann, Fabian; Leser, Ulf; Kosch, Thomas

Large Language Models to the Rescue: Reducing the Complexity in Scientific Workflow Development Using ChatGPT Miscellaneous

2023.

BibTeX

2022

Bader, Jonathan; Witzke, Joel; Becker, Soeren; Lößer, Ansgar; Lehmann, Fabian; Doehler, Leon; Vu, Anh Duc; Kao, Odej

Towards Advanced Monitoring for Scientific Workflows Proceedings Article

In: 2022 IEEE International Conference on Big Data (IEEE BigData 2022), IEEE, 2022.

Links | BibTeX

Bader, Jonathan; Lehmann, Fabian; Groth, Alexander; Thamsen, Lauritz; Scheinert, Dominik; Will, Jonathan; Leser, Ulf; Kao, Odej

Reshi: Recommending Resources for Scientific Workflow Tasks on Heterogeneous Infrastructures Proceedings Article

In: 41th International Performance Computing and Communications Conference 2022, IEEE, 2022.

Links | BibTeX

Bader, Jonathan; Lehmann, Fabian; Thamsen, Lauritz; Will, Jonathan; Leser, Ulf; Kao, Odej

Lotaru: Locally Estimating Runtimes of Scientific Workflow Tasks in Heterogeneous Clusters Proceedings Article

In: 34th International Conference on Scientific and Statistical Database Management (SSDBM 2022), pp. 1–12, ACM, 2022.

Links | BibTeX

29 entries « 2 of 3 »