B6: Distributed Run-Time Monitoring and Control of Data Analysis Workflows

Description

B6-Bild

Executions of DAWs are driven by specifications of the individual steps of a data-processing pipeline and the data it processes. However, for a multitude of reasons, execution may not function as desired, especially when distributed systems are used, which calls for proactive runtime monitoring of executions to detect and possibly resolve any problems early on. B6 will investigate the foundations of distributed monitoring and of control systems for DAWs, which is a prerequisite for the design of dependable DAWs. Cooperations will be established especially with A1, on the notion of “abnormal” versus “normal” behavior of an execution, and with B3 regarding the monitoring of distributed executions. The subproject will be led by Prof. Grunske, an expert in automated software analysis for error detection, and Prof. Rabl, an expert in efficient distributed streaming engines.

PIs

Publications

2022

Lawrence Benson; Leon Papke; Tilmann Rabl

PerMA-Bench: Benchmarking Persistent Memory Access Journal Article

In: Proceedings of the VLDB Endowment, vol. 15, no. 11, pp. 2463-2476, 2022.

Abstract | Links | BibTeX

Gábor E. Gévay; Tilmann Rabl; Sebastian Breß; Loránd Madai-Tahy; Jorge-Arnulfo Quiané-Ruiz; Volker Markl

Imperative or Functional Control Flow Handling: Why not the Best of Both Worlds? Journal Article

In: ACM SIGMOD Record, vol. 51, no. 1, pp. 1-8, 2022.

Abstract | BibTeX

Nina Ihde; Paula Marten; Ahmed Eleliemy; Gabrielle Poerwawinata; Pedro Silva; Ilin Tolovski; Florina M. Ciorba; Tilmann Rabl

A Survey of Big Data, High Performance Computing, and Machine Learning Benchmarks Inproceedings

In: Nambiar, Raghunath; Poess, Meikel (Ed.): Performance Evaluation and Benchmarking, pp. 98–118, Springer International Publishing, Cham, 2022, ISBN: 978-3-030-94437-7.

Abstract | BibTeX

Nils Strassenburg; Ilin Tolovski; Tilmann Rabl

Efficiently Managing Deep Learning Models in a Distributed Environment Conference

25th International Conference on Extending Database Technology (EDBT '22), 2022.

Abstract | BibTeX

Tobias Maltenberger; Ivan Ilic; Ilin Tolovski; Tilmann Rabl

Evaluating Multi-GPU Sorting with Modern Interconnects Inproceedings

In: 2022 ACM SIGMOD International Conference on Management of Data (SIGMOD ’22), 2022.

Abstract | BibTeX

Lawrence Benson; Tilmann Rabl

Darwin: Scale-In Stream Processing Inproceedings

In: 12th Annual Conference on Innovative Data Systems Research (CIDR ’22), 2022.

Abstract | BibTeX

Bonaventura Del Monte; Steffen Zeuch; Tilmann Rabl; Volker Markl

Rethinking Stateful Stream Processing with RDMA Inproceedings

In: ACM SIGMOD International Conference on Management of Data (SIGMOD ’22), 2022.

Abstract | BibTeX

2021

Jonas Traub; Philipp Marian Grulich; Alejandro Rodríguez Cuéllar; Sebastian Breß; Asterios Katsifodimos; Tilmann Rabl; Volker Markl

Scotty: General and Efficient Open-Source Window Aggregation for Stream Processing Systems Journal Article

In: Transactions on Database Systems, vol. 46, no. 1, pp. 46, 2021.

BibTeX

Gábor E. Gévay; Tilmann Rabl; Sebastian Breß; Loránd Madai-Tahy; Jorge-Arnulfo Quiané-Ruiz; Volker Markl

Efficient Control Flow in Dataflow Systems: When Ease-of-Use Meets High Performance Journal Article

In: 37th IEEE International Conference on Data Engineering, 2021.

BibTeX

Lawrence Benson; Hendrik Makait; Tilmann Rabl

Viper: An Efficient Hybrid PMem-DRAM Key-Value Store Journal Article

In: Proceedings of the VLDB Endowment, vol. 14, no. 9, pp. 1544-1556, 2021.

Abstract | BibTeX