B5: Transparent Multi-Site Data Analysis Workflows for Earth Observation

Continued from B5: Adaptive, Distributed and Scalable Analysis of Massive Satellite Data

Description

DAWs for satellite data analysis are highly heterogeneous and complex in terms of input data, software, and resource requirements. Furthermore, data for DAWs are often available at different data centers, with data download being a major bottleneck in DAWs execution.

Our goal is to expand orchestration of Earth Observation Workflows (EOWs) from FONDA I to a federated multi-center scenario to enable analysis of changes in agricultural land use over very large, heterogeneous and distributed data sets.

Scientists

  • Felix Kummer
  • Katarzyna Ewa Lewińska

Publications

33 entries « 2 of 3 »

2023

Lewińska, Katarzyna Ewa

Research Data Management Plan, Trends in European Grasslands: test sites study, B5, Adaptive, Distributed and Scalable Analysis of Massive Satellite Data Miscellaneous

2023.

Links | BibTeX

Lehmann, Fabian; Bader, Jonathan; Tschirpke, Friedrich; Thamsen, Lauritz; Leser, Ulf

How Workflow Engines Should Talk to Resource Managers: A Proposal for a Common Workflow Scheduling Interface Proceedings Article

In: 2023 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGrid), pp. 166-179, 2023.

Links | BibTeX

Lehmann, Fabian; Hilbrich, Marcus

Research Data Management Plan, FORCE Workflow, B5, Adaptive, Distributed and Scalable Analysis of Massive Satellite Data Technical Report

2023.

Links | BibTeX

Jakimow, Benjamin; Janz, Andreas; Thiel, Fabian; Okujeni, Akpona; Hostert, Patrick; Linden, Sebastian

EnMAP-Box: Imaging spectroscopy in QGIS Journal Article

In: SoftwareX, vol. 23, pp. 101507, 2023.

Links | BibTeX

Sänger, Mario; Mecquenem, Ninon De; Lewińska, Katarzyna Ewa; Bountris, Vasilis; Lehmann, Fabian; Leser, Ulf; Kosch, Thomas

Large Language Models to the Rescue: Reducing the Complexity in Scientific Workflow Development Using ChatGPT Miscellaneous

Preprint, 2023.

Links | BibTeX

Silva, Rafael Ferreira Da; Badia, Rosa M.; Bala, Venkat; Bard, Debbie; Bremer, Peer-Timo; Buckley, Ian; Caino-Lores, Silvina; Chard, Kyle; Goble, Carole; Jha, Shantenu; Katz, Daniel S.; Laney, Daniel; Parashar, Manish; Suter, Frederic; Tyler, Nick; Uram, Thomas; Altintas, Ilkay; Andersson, Stefan; Arndt, William; Aznar, Juan; Bader, Jonathan; Balis, Bartosz; Blanton, Chris; Braghetto, Kelly Rosa; Brodutch, Aharon; Brunk, Paul; Casanova, Henri; Lierta, Alba Cervera; Chigu, Justin; Coleman, Taina; Collier, Nick; Colonnelli, Iacopo; Coppens, Frederik; Crusoe, Michael; Cunningham, Will; Kinoshita, Bruno De Paula; Tommaso, Paolo Di; Doutriaux, Charles; Downton, Matthew; Elwasif, Wael; Enders, Bjoern; Erdmann, Chris; Fahringer, Thomas; Figueiredo, Ludmilla; Filgueira, Rosa; Foltin, Martin; Fouilloux, Anne; Gadelha, Luiz; Gallo, Andy; Saez, Artur Garcia; Garijo, Daniel; Gerlach, Roman; Grant, Ryan; Grayson, Samuel; Grubel, Patricia; Gustafsson, Johan; Hayot-Sasson, Valerie; Hernandez, Oscar; Hilbrich, Marcus; Justine, AnnMary; Laflotte, Ian; Lehmann, Fabian; Luckow, Andre; Luettgau, Jakob; Maheshwari, Ketan; Matsuda, Motohiko; Medic, Doriana; Mendygral, Pete; Michalewicz, Marek; Nonaka, Jorji; Pawlik, Maciej; Pottier, Loic; Pouchard, Line; Putz, Mathias; Radha, Santosh Kumar; Ramakrishnan, Lavanya; Ristov, Sashko; Romano, Paul; Rosendo, Daniel; Ruefenacht, Martin; Rycerz, Katarzyna; Saurabh, Nishant; Savchenko, Volodymyr; Schulz, Martin; Simpson, Christine; Sirvent, Raul; Skluzacek, Tyler; Soiland-Reyes, Stian; Souza, Renan; Sukumar, Sreenivas Rangan; Sun, Ziheng; Sussman, Alan; Thain, Douglas; Titov, Mikhail; Tovar, Benjamin; Tripathy, Aalap; Turilli, Matteo; Tuznik, Bartosz; Dam, Hubertus Van; Vivas, Aurelio; Ward, Logan; Widener, Patrick; Wilkinson, Sean; Zawalska, Justyna; Zulfiqar, Mahnoor

Workflows Community Summit 2022: A Roadmap Revolution Miscellaneous

2023.

Links | BibTeX

Schintke, Florian; Mecquenem, Ninon De; Frantz, David; Guarino, Vanessa Emanuela; Hilbrich, Marcus; Lehmann, Fabian; Sattler, Rebecca; Sparka, Jan Arne; Speckhard, Daniel T.; Stolte, Hermann; Vu, Anh Duc; Leser, Ulf

Validity Constraints for Data Analysis Workflows Miscellaneous

2023.

Links | BibTeX

2022

Bader, Jonathan; Witzke, Joel; Becker, Soeren; Lößer, Ansgar; Lehmann, Fabian; Doehler, Leon; Vu, Anh Duc; Kao, Odej

Towards Advanced Monitoring for Scientific Workflows Proceedings Article

In: 2022 IEEE International Conference on Big Data (IEEE BigData 2022), IEEE, 2022.

Links | BibTeX

Bader, Jonathan; Lehmann, Fabian; Groth, Alexander; Thamsen, Lauritz; Scheinert, Dominik; Will, Jonathan; Leser, Ulf; Kao, Odej

Reshi: Recommending Resources for Scientific Workflow Tasks on Heterogeneous Infrastructures Proceedings Article

In: 41th International Performance Computing and Communications Conference 2022, IEEE, 2022.

Links | BibTeX

Bader, Jonathan; Lehmann, Fabian; Thamsen, Lauritz; Will, Jonathan; Leser, Ulf; Kao, Odej

Lotaru: Locally Estimating Runtimes of Scientific Workflow Tasks in Heterogeneous Clusters Proceedings Article

In: 34th International Conference on Scientific and Statistical Database Management (SSDBM 2022), pp. 1–12, ACM, 2022.

Links | BibTeX

Hilbrich, Marcus; Lehmann, Fabian

ßMACH — A Software Management Guidance Proceedings Article

In: Reichelt, David Georg; Müller, Richard; Becker, Steffen; Hasselbring, Wilhelm; Hoorn, André; Kounev, Samuel; Koziolek, Anne; Reussner, Ralf (Ed.): Symposium on Software Performance 2021, CEUR-WS, Leipzig, Germany, 2022.

Abstract | Links | BibTeX

Frantz, David; Hostert, Patrick; Rufin, Philippe; Ernst, Stefan; Röder, Achim; Linden, Sebastian

Revisiting the Past: Replicability of a Historic Long-Term Vegetation Dynamics Assessment in the Era of Big Data Analytics Journal Article

In: Remote Sensing, vol. 14, no. 3, 2022, ISSN: 2072-4292.

Abstract | Links | BibTeX

Schug, Franz; Frantz, David; Okujeni, Akpona; Hostert, Patrick

Sub-pixel building area mapping based on synthetic training data and regression-based unmixing using Sentinel-1 and-2 data Journal Article

In: Remote Sensing Letters, vol. 13, no. 8, pp. 822–832, 2022.

Links | BibTeX

Blickensdörfer, Lukas; Schwieder, Marcel; Pflugmacher, Dirk; Nendel, Claas; Erasmi, Stefan; Hostert, Patrick

Mapping of crop types and crop sequences with combined time series of Sentinel-1, Sentinel-2 and Landsat 8 data for Germany Journal Article

In: Remote sensing of environment, vol. 269, pp. 112831, 2022.

Links | BibTeX

Hilbrich, Marcus; Lehmann, Fabian

Discussing Microservices: Definitions, Pitfalls, and their Relations Proceedings Article

In: 2022 IEEE International Conference on Services Computing (SCC), pp. 39-44, 2022.

Links | BibTeX

33 entries « 2 of 3 »