Publications

Below you can find a list of publications that utilize, describe, or evaluate Theodolite:

• S. Henning, A. Vogel, E. Perez-Wohlfeil, O. Ertl, and R. Rabiser. “When Should I Run My Application Benchmark?: Studying Cloud Performance Variability for the Case of Stream Processing Applications”. In: 33rd ACM International Conference on the Foundations of Software Engineering. 2025. DOI: 10.1145/3696630.3728563.
• S. Henning, A. Vogel, E. Perez-Wohlfeil, O. Ertl, and R. Rabiser. “Should I Run My Cloud Benchmark on Black Friday?”. In: Softwaretechnik-Trends 45 (4) (Symposium on Software Performance). 2025.
• L. Leko, S. Henning, A. Vogel, O. Ertl, and R. Rabiser. “Benchmarking Pattern Matching Strategies for Scalable Log Analytics”. In: Softwaretechnik-Trends 45 (4) (Symposium on Software Performance). 2025.
• A.R. Hamid, H. Reiter, M.B. Kjærgaard, W. Hasselbring. “Investigating Quality Attributes of Machine Learning Inference on the Edge-Cloud Continuum”. In: Softwaretechnik-Trends 45 (1) (Symposium on Software Performance 2024). 2025.
• S. Henning and W. Hasselbring. “Benchmarking scalability of stream processing frameworks deployed as microservices in the cloud”. In: Journal of Systems and Software 208. 2024. DOI: 10.1016/j.jss.2023.111879.
• S. Henning, A. Vogel, M. Leichtfried, O. Ertl, and R. Rabiser. “ShuffleBench: A Benchmark for Large-Scale Data Shuffling Operations with Distributed Stream Processing Frameworks”. In: Proceedings of the 15th ACM/SPEC International Conference on Performance Engineering. 2024. DOI: 10.1145/3629526.3645036. 🏆
• A. Vogel, S. Henning, E. Perez-Wohlfeil, O. Ertl, and R. Rabiser. “A Comprehensive Benchmarking Analysis of Fault Recovery in Stream Processing Frameworks”. In: Proceedings of the 18th ACM International Conference on Distributed and Event-based Systems. 2024. DOI: 10.1145/3629104.3666040.
• S. Henning and W. Hasselbring. “Scalability Benchmarking of Cloud-Native Applications: The Theodolite Approach”. In: Softwaretechnik-Trends 44 (2). 2024.
• Govind KP, G. Pierre, R. Rouvoy. “Studying the Energy Consumption of Stream Processing Engines in the Cloud”. In: IEEE International Conference on Cloud Engineering. 2023. DOI: 10.1109/IC2E59103.2023.00019
• S. Henning, A. Vogel, M. Leichtfried, O. Ertl, and R. Rabiser. “Benchmarking Stream Processing Frameworks for Large Scale Data Shuffling”. In: Softwaretechnik-Trends 43 (4) (Symposium on Software Performance). 2023.
• S. Henning. “Scalability Benchmarking of Cloud-Native Applications Applied to Event-Driven Microservices”. In: Kiel Computer Science Series 2023/2. 2023. Dissertation, Faculty of Engineering, Kiel University. DOI: 10.21941/kcss/2023/2.
• S. Henning and W. Hasselbring. “Benchmarking Scalability of Cloud-Native Applications”. In: Software Engineering. 2023.
• S. Henning and W. Hasselbring. “A Configurable Method for Benchmarking Scalability of Cloud-Native Applications”. In: Empirical Software Engineering 27. 2022. DOI: 10.1007/s10664-022-10162-1.
• T. Pfandzelter, S. Henning, T. Schirmer, W. Hasselbring, and D. Bermbach. “Streaming vs. Functions: A Cost Perspective on Cloud Event Processing”. In: IEEE International Conference on Cloud Engineering. 2022. DOI: 10.1109/IC2E55432.2022.00015.
• S. Henning and W. Hasselbring. “Demo Paper: Benchmarking Scalability of Cloud-Native Applications with Theodolite”. In: IEEE International Conference on Cloud Engineering. 2022. DOI: 10.1109/IC2E55432.2022.00037.
• S. Henning, B. Wetzel, and W. Hasselbring. “Cloud-Native Scalability Benchmarking with Theodolite Applied to the TeaStore Benchmark”. In: Softwaretechnik-Trends 43 (1) (Symposium on Software Performance). 2022.
• S. Henning, B. Wetzel, and W. Hasselbring. “Reproducible Benchmarking of Cloud-Native Applications With the Kubernetes Operator Pattern”. In: Symposium on Software Performance. 2021.
• S. Henning and W. Hasselbring. “How to Measure Scalability of Distributed Stream Processing Engines?” In: Companion of the ACM/SPEC International Conference on Performance Engineering. 2021. DOI: 10.1145/3447545.3451190.
• S. Henning and W. Hasselbring. “Theodolite: Scalability Benchmarking of Distributed Stream Processing Engines in Microservice Architectures”. In: Big Data Research 25. 2021. DOI: 10.1016/j.bdr.2021.100209.
• S. Henning and W. Hasselbring. “Toward Efficient Scalability Benchmarking of Event-Driven Microservice Architectures at Large Scale”. In: Softwaretechnik-Trends 40 (3) (Symposium on Software Performance). 2020.