VLDB 2026 Research / reviewers in the wild / expert
Steffen Becker 0001
dblp:78/3405
· DBLP profile ↗
59ranked-venue papers
2as first author
31since 2021 · last 2026
0000-0002-4532-1460ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Software engineering, systems software and programming languages · 34 · 2 first-author · 13 since 2021Systems, architecture and hardware · 10 · 7 since 2021Human-computer interaction and ubiquitous computing · 7 · 7 since 2021Applied, interdisciplinary, general and emerging computing · 4 · 3 since 2021Databases, data management, data science and information retrieval · 3Artificial intelligence and machine learning · 1 · 1 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Let LLMs Autoscale Microservices: A Quantitative Evaluation of Architectures
Floriment Klinaku, Tim Summerer, Steffen Becker 0001 |
ICSA | 3 |
| 2026 | Supporting Architecture-Level Resilience Analysis with an Integrated Chaos and Load Experimentation Framework
Sandro Speth, Elias Müller, Niklas Meißner, Niklas Krieger, Steffen Becker 0001 |
ICSA | 5 |
| 2026 | Boosting Student Motivation through Game-based Learning in Programming Education with Gamify-ITabstractGame-based learning (GBL) has emerged as a powerful instrument for enhancing student engagement and motivation in education. This paper evaluates the impact of Gamify-IT, an educational game designed for programming education, on student motivation and learning experiences. Building on the original Gamify-IT concept, we extended it with novel features, including diverse minigames, leaderboards, and a redesigned achievement system, to align with Marczewski's HEXAD player types. The platform was used in a first-semester programming course by about 100 students, and its impact was evaluated through comparative analyses of two cohorts in consecutive CS1 programming courses: one limited to traditional teaching methods and the other incorporating Gamify-IT. Our results demonstrate that Gamify-IT has a positive impact on student motivation, as evidenced by higher initial and sustained motivation levels throughout the semester. Feedback from a survey regarding the usefulness and experiences of the platform highlights its strengths, including an engaging and innovative learning approach, game design, and visuals, while also identifying areas for improvement, such as addressing technical issues and expanding game variety. Despite these challenges, Gamify-IT demonstrates the potential of GBL in programming education, offering valuable insights for designing inclusive and effective gamified educational tools for programming education. Niklas Meißner, Sandro Speth, Niklas Krieger, Steffen Becker 0001 |
SIGCSE (1) | 4 |
| 2025 | Exploring the Limits of LLMs for System-Level Test Program Generation: Can LLaMas Outrun Darwin?abstractSystem-Level Test (SLT) is important in semiconductor testing as it can detect defects missed by traditional methods. Test engineers use off-the-shelf software to manually compose test suites, often written in high-level languages such as $\mathrm{C} / \mathrm{C}++$ or Rust. Several methods for automatically generating test programs have been investigated, using assembly language. However, one could argue that the resulting test programs are not capturing all possible interactions in actual software. Large Language Models (LLMs) can generate code in high-level languages closer to actual software. In this work, we examine the limitations of LLMs and high-level languages for generating SLT programs. We run an experiment using genetic programming (GP) to find an assembly snippet with the highest power consumption. Then, we utilize LLMs to generate $\mathbf{C}$ code and demonstrate that the compiler, the enabled optimization level, and the LLM have a significant influence on the resulting power consumption. Furthermore, we show via decompilation that the snippet from the GP run has no direct equivalent in C. Finally, we demonstrate that the initial values have a significant impact on power consumption for both the GP-generated and the decompiled snippet. Denis Schwachhofer, Steffen Becker 0001, Stefan Wagner 0001, Matthias Sauer 0002, Ilia Polian |
ATS | 2 |
| 2025 | Developing a Method for an Optimized Static Vehicle Function DistributionabstractThe design of automotive electric/electronic (E/E) architectures has become increasingly complex due to the integration of numerous software-controlled functions. To address this complexity, we present a generic method for developing and implementing a vehicle function distribution optimization process. Our approach involves defining the design space, gathering relevant information from various sources, solving the optimization problem, and displaying the best configurations. Two processes are described for firstly developing, and successively using a method for the optimization. The resulting method is validated through two use-cases from the series development of current Mercedes vehicles. Validation runs show that our method can effectively optimize function distributions, reduce overhead costs, and improve system quality criteria in general, therefore providing a solid foundation for enhancing the design and development process of automotive E/E architectures. Jan Ruhnau, Steffen Becker 0001 |
CoDIT | 2 |
| 2025 | A Method for Automated Deployment Architecture Reconstruction from Heterogeneously Nested Deployment Models
Marcel Weller, Uwe Breitenbücher, Steffen Becker 0001 |
CoopIS | 3 |
| 2025 | Model-Based Proactive Self-adaptation for Cloud Systems
Raphael Straub 0001, Sarah Stieß, Steffen Becker 0001, Matthias Tichy |
ECSA | 3 |
| 2025 | ViMoTest: A Tool to Specify ViewModel-Based GUI Test Scenarios Using Projectional EditingabstractAutomated GUI testing is crucial in ensuring that presentation logic behaves as expected. However, existing tools often apply end-to-end approaches and face challenges such as high specification efforts, maintenance difficulties, and flaky tests while coupling to GUI framework specifics. To address these challenges, we introduce the ViMoTest tool, which leverages Behavior-driven Development, the ViewModel architectural pattern, and projectional Domain-specific Languages (DSLs) to isolate and test presentation logic independently of GUI frameworks. We demonstrate the tool with a small JavaFX-based task manager example and generate executable code. Mario Fuksa, Sandro Speth, Steffen Becker 0001 |
ICST | 3 |
| 2025 | A Method for the Quality-Aware Automated Selection of Deployment TechnologiesabstractABSTRACT Domain The deployment of distributed multi‐component cloud applications typically requires a combination of multiple heterogeneous deployment technologies. A different combination of deployment technologies should be chosen due to varying deployment qualities, such as the functional suitability and reliability of the deployment technologies for the deployment of the components. A suboptimal selection of deployment technologies makes the deployment error‐prone. Problem Selecting and maintaining the combination of deployment technologies requires modeling effort and expertise. Contributions We present a method that automatically selects deployment technologies based on a knowledge base of deployment scenarios and corresponding deployment qualities of deployment technologies. Evaluation We show the practical applicability and the usefulness of our method. For the practical applicability, we conduct two case studies based on an open‐source reference architecture application and a real‐world industry application using a prototypical implementation of our method. For the usefulness, we conduct a user study in which participants assign deployment technologies with and without our method. Conclusions Our method is a useful contribution that reduces the modeling effort and the required expertise when maintaining the combination of deployment technologies. Further, our method enhances the deployment quality. Miles Stötzner, Niklas Krieger, Sandro Speth, Marcel Weller, Steffen Becker 0001, Benjamin Weder, Jacopo Soldani, Valentin Morlock |
Softw. Pract. Exp. | 5 |
| 2024 | Hosting-Aware Pruning of Components in Deployment Models
Miles Stötzner, Sandro Speth, Steffen Becker 0001 |
CLOSER | 3 |
| 2024 | Pruning Modes for Deployment Models: From Manual Modeling to Automated Removal of Elements and Their Implications
Miles Stötzner, Sandro Speth, Steffen Becker 0001 |
CLOSER | 3 |
| 2024 | Automated Programming Exercise Generation in the Era of Large Language ModelsabstractLecturers are increasingly attempting to use large language models (LLMs) to simplify and make the creation of exercises for students more efficient. Efforts are also being made to automate the exercise creation process in software engineering (SE) education. This study explores the use of advanced LLMs, including GPT-4 and LaMDA, for automated programming exercise creation in higher education and compares the results with related work using GPT-3.5-turbo. Utilizing applications such as ChatGPT, Bing AI Chat, and Google Bard, we identify LLMs capable of initiating different exercise designs. However, manual refinement is crucial for accuracy. Common error patterns across LLMs highlight challenges in complex programming concepts, while specific strengths in various topics showcase model distinctions. This research underscores LLMs' value in exercise generation, emphasizing the critical role of human supervision in refining these processes. Our concise insights cater to educators, practitioners, and other researchers seeking to enhance SE education through LLM applications. Niklas Meißner, Sandro Speth, Steffen Becker 0001 |
CSEE&T | 3 |
| 2024 | ChatGPT's Aptitude in Utilizing UML Diagrams for Software Engineering Exercise GenerationabstractThe integration of Artificial Intelligence (AI) tech-nologies into educational settings has paved the way for inno-vative teaching and learning approaches. In Software Engineering (SE) education, using Unified Modeling Language (UML) diagrams is a fundamental teaching element for understanding complex software systems. This research addresses ChatGPT's ability to utilize UML class and sequence diagrams to create SE modeling exercises. We use ChatGPT to generate exercises based on the information from uploaded UML diagrams by analyzing textual UML representations such as Mermaid and graphical diagrams. The research explores ChatGPT's ability to synthesize UML-specific information from class and sequence diagrams, enabling the generation of various exercises tailored to strengthen conceptual understanding and practical application. Furthermore, we investigate generating graphical UML class and sequence diagrams based on natural language as input. By bridging the gap between AI -driven natural language understanding and the comprehension of UML diagrams, this study highlights the potential of ChatGPT to improve SE education. Our concise findings address educators, practitioners, and other researchers engaged in the field of SE education with a special focus on UML. Sandro Speth, Niklas Meißner, Steffen Becker 0001 |
CSEE&T | 3 |
| 2024 | Architecture-Based Issue Propagation Analysis
Sandro Speth, Niklas Krieger, Robert Heinrich, Steffen Becker 0001 |
ECSA | 4 |
| 2024 | MVVM Revisited: Exploring Design Variants of the Model-View-ViewModel Pattern
Mario Fuksa, Sandro Speth, Steffen Becker 0001 |
EDOC | 3 |
| 2024 | Optimizing System-Level Test Program Generation via Genetic ProgrammingabstractThe rising complexity of integrated devices has led to new defect types and failure modes at the system level that are not detected by structural tests. System-Level Test (SLT) is another test step to combat this challenge. SLT is in charge of exercising system-level interactions between hardware components and software. Non-functional properties, e.g., temperature, play a major role in SLT.This work focuses on the automatic generation of assembly test programs for SLT that aim to indirectly maximize a particular non-functional property, for example, the temperature. It is based on two-step generation with genetic algorithms. First, a fast architectural simulation is used with the genetic algorithm to provide a structure for the test programs. Afterward, an additional generation is done on the hardware to optimize the initial register contents of the program.The case study for gathering experimental results is a super-scalar out-of-order RISC-V processor, the Berkeley Out-of-Order Machine (BOOM). Experimental results show that the two-step generation is more effective in converging to a better power-hungry test program than only using the power consumption as a fitness function for the genetic algorithm. Denis Schwachhofer, Francesco Angione, Steffen Becker 0001, Stefan Wagner 0001, Matthias Sauer 0002, Paolo Bernardi 0002, Ilia Polian |
ETS | 3 |
| 2024 | Training Large Language Models for System-Level Test Program Generation Targeting Non-functional PropertiesabstractSystem-Level Test (SLT) has been an integral part of integrated circuit test flows for over a decade and continues to be significant. Nevertheless, there is a lack of systematic approaches for generating test programs, specifically focusing on the non-functional aspects of the Device under Test (DUT). Currently, test engineers manually create test suites using commercially available software to simulate the end-user environment of the DUT. This process is challenging and laborious and does not assure adequate control over non-functional properties. This paper proposes to use Large Language Models (LLMs) for SLT program generation. We use a pre-trained LLM and fine-tune it to generate test programs that optimize non-functional properties of the DUT, e.g., instructions per cycle. Therefore, we use Gem5, a microarchitectural simulator, in conjunction with Reinforcement Learning-based training. Finally, we write a prompt to generate C code snippets that maximize the instructions per cycle of the given architecture. In addition, we apply hyperparameter optimization to achieve the best possible results in inference. Denis Schwachhofer, Peter Domanski, Steffen Becker 0001, Stefan Wagner 0001, Matthias Sauer 0002, Dirk Pflüger, Ilia Polian |
ETS | 3 |
| 2024 | Compositio Prompto: An Architecture to Employ Large Language Models in Automated Service Computing
Robin D. Pesl, Carolin Mombrey, Kevin Klein 0002, Denesa Zyberaj, Ilche Georgievski, Steffen Becker 0001, Georg Herzwurm, Marco Aiello 0001 |
ICSOC (2) | 6 |
| 2024 | CARISMA: CAR-Integrated Service Mesh ArchitectureabstractThe amount of software in modern cars is increasing continuously with traditional electric/electronic (E/E) architectures reaching their limit when deploying complex applications, e.g., regarding bandwidth or computational power. To mitigate this situation, more powerful computing platforms are being employed and applications are developed as distributed applications, e.g., involving microservices. Microservices received widespread adoption and changed the way modern applications are developed. However, they also introduce additional complexity regarding inter-service communication. This has led to the emergence of service meshes, a promising approach to cope with this complexity. In this paper, we present an architecture applying the service mesh approach to automotive E/E platforms comprising multiple interlinked High-Performance Computers (HPCs). We validate the feasibility of our approach through a prototypical implementation. Kevin Klein 0002, Pascal Hirmer, Steffen Becker 0001 |
VEHITS | 3 |
| 2024 | ADVISE: Understanding Reconfigurations in Self-Adaptive Cloud SystemsabstractSelf-adaptive cloud systems dynamically adapt their configuration to achieve Service Level Objectives (SLOs), for example, to ensure a response time below a certain threshold, in changing environments. However, understanding these recon-figurations is challenging. To address this issue, we introduce ADVISE, a visualization tool for reconfigurations in self-adaptive systems. Our adaption approach leverages the Palladio ecosystem to predict system performance and plan optimal reconfigurations by exploring the state space. The optimal path in the state space graph, determined by a utility value based on the SLOs, represents the ideal policy. Our tool provides real-time visualizations of performance predictions and reconfiguration plans aiding developers in managing and optimizing system behavior effectively. We enable both the analysis of individual states and the examination of paths within the state space graph, enabling users to analyze not only single adaptation decisions but also the overall reconfiguration behavior. Video URL: [1] Raphael Straub 0001, Sarah Stieß, Matthias Tichy, Steffen Becker 0001 |
VISSOFT | 4 |
| 2023 | Managing the Variability of Component Implementations and Their Deployment Configurations Across Heterogeneous Deployment Technologies
Miles Stötzner, Uwe Breitenbücher, Robin D. Pesl, Steffen Becker 0001 |
CoopIS | 4 |
| 2023 | Investigating the Use of AI-Generated Exercises for Beginner and Intermediate Programming Courses: A ChatGPT Case StudyabstractIn recent years, artificial intelligence (AI) has been increasingly used in education and supports teachers in creating educational material and students in their learning progress. AI-driven learning support has recently been further strengthened by the release of ChatGPT, in which users can retrieve explanations for various concepts in a few minutes through chat. However, to what extent the use of AI models, such as ChatGPT, is suitable for the creation of didactically and content-wise good exercises for programming courses is not yet known. Therefore, in this paper, we investigate the use of AI-generated exercises for beginner and intermediate programming courses in higher education using ChatGPT. We created 12 exercise sheets with ChatGPT for a beginner to intermediate programming course focusing on the objects-first approach. We report our process, prompts, and experience using ChatGPT for this task and outline good practices we identified. The generated exercises are assessed and revised, primarily using ChatGPT, until they met the requirements of the programming course. We assessed the quality of these exercises by using them in our external teaching assignment course at the University of Education Ludwigsburg and let the students evaluate them. Results indicate the quality of the generated exercises and the time-saving for creating them using ChatGPT. However, our experience showed that while it is fast to generate a good version of an exercise, almost every exercise requires minor manual changes to improve its quality. Sandro Speth, Niklas Meißner, Steffen Becker 0001 |
CSEE&T | 3 |
| 2023 | A Survey of Recent Developments in Testability, Safety and Security of RISC-V ProcessorsabstractWith the continued success of the open RISC-V architecture, practical deployment of RISC-V processors necessitates an in-depth consideration of their testability, safety and security aspects. This survey provides an overview of recent developments in this quickly-evolving field. We start with discussing the application of state-of-the-art functional and system-level test solutions to RISC-V processors. Then, we discuss the use of RISC-V processors for safety-related applications; to this end, we outline the essential techniques necessary to obtain safety both in the functional and in the timing domain and review recent processor designs with safety features. Finally, we survey the different aspects of security with respect to RISC-V implementations and discuss the relationship between cryptographic protocols and primitives on the one hand and the RISC-V processor architecture and hardware implementation on the other. We also comment on the role of a RISC-V processor for system security and its resilience against side-channel attacks. Jens Anders, Pablo Andreu, Bernd Becker 0001, Steffen Becker 0001, Riccardo Cantoro, Nikolaos Ioannis Deligiannis, Nourhan Elhamawy, Tobias Faller, Carles Hernández 0001, Nele Mentens, Mahnaz Namazi Rizi, Ilia Polian, Abolfazl Sajadi, Matthias Sauer 0002, Denis Schwachhofer, Matteo Sonza Reorda, Todor Stefanov, Ilya Tuzov, Stefan Wagner 0001, Nusa Zidaric |
ETS | 4 |
| 2023 | Automating Greybox System-Level Test GenerationabstractSystem-Level Test (SLT) emerged as an additional test step to detect manufacturing defects not caught by traditional testing. For SLT, the Device Under Test (DUT) is embedded into an environment that emulates the end-user application as closely as possible and runs workloads composed of existing off-the-shelf software. We present an automatic greybox SLT program generation method to find code snippets that control the DUT’s extra-functional properties, to achieve better characterization, or to improve the coverage of emerging defect types. In contrast to ATPG or formal methods, our method does not require structural information and relies solely on simulation results or hardware measurements to guide the generation. We show that our method outperforms hand-crafted snippets on a RISC-V super-scalar processor and look into possible reasons why the snippets perform the way they do. Denis Schwachhofer, Maik Betka, Steffen Becker 0001, Stefan Wagner 0001, Matthias Sauer 0002, Ilia Polian |
ETS | 3 |
| 2023 | Model-Driven Integration of Analysis Components for Cyber-Physical Production SystemsabstractIn the course of the rapid development of Industry 4.0, manufacturing machinery is becoming ever more connected. Such Cyber-Physical Production Systems (CPPSs) produce large amounts of data, which can be used to analyze the system’s state and optimize its operation. To enable this analysis, the respective software components need to be interoperable with the CPPSs. While standards, such as OPC UA, provide interoperability on a technical protocol level, we see a vastly heterogeneous landscape of data models. Therefore, the integration of analysis components with their underlying CPPS is usually a laborious, manual process, also discouraging reuse. To facilitate the reuse of analysis software in this setting, we propose a model-driven method for integration with the underlying CPPS and the consumers of analysis results. Our contribution consists of (i) domain-specific languages for semantically enriched interface descriptions and simple mappings, (ii) a code generator toolchain to realize the specified mappings, and (iii) a simple, loosely coupled architecture for the resulting system. Patrick Spaney, Steffen Becker 0001 |
SEAA | 2 |
| 2023 | The MechatronicUML Code Generator for Distributed Cyber-Physical SystemsabstractDemonstrating the real-time execution of the software in distributed cyber-physical systems like vehicles in a realistic way, e.g., in the context of teaching students at universities, often requires a real car which is costly and hard to acquire. Therefore, we present an approach for using the MechatronicUML to model structural and behavioral aspects of the software for vehicles and generate code that we deploy and run on robot cars in our laboratory environment. We demonstrate this approach with an exemplary application scenario that comprises two vehicles driving on a road and exchanging information to prepare for a cooperative overtaking through a remotely deployed message broker. After adding support for our robot car hardware platform in an existing code generator for MechatronicUML, the robot cars could execute this scenario as envisioned with the generated code. The approach allows us to model distributed cyber-physical systems in a realistic way while demonstrating them in a simplified setup that is accessible to students. A video showcasing this demonstration can be accessed at https://youtu.be/8XgSudDxDB4. Marcel Weller, Sandro Speth, Georg Reißner, Steffen Becker 0001 |
SEAA | 4 |
| 2023 | Integrating Issue Management Systems of Independently Developed Software ComponentsabstractAbstract Modern component-based architectural styles, e.g., microservices, enable developing the components independently from each other. However, this independence can result in problems when it comes to managing issues, such as bugs, as developer teams can freely choose their technology stacks, such as issue management systems (IMSs), e.g., Jira, GitHub, or Redmine. In the case of a microservice architecture, if an issue of a downstream microservice depends on an issue of an upstream microservice, this must be both identified and communicated, and the downstream service’s issues should link to its causing issue. However, agile project management today requires efficient communication, which is why more and more teams are communicating through comments in the issues themselves. Unfortunately, IMSs are not integrated with each other, thus, semantically linking these issues is not supported, and identifying such issue dependencies from different IMSs is time-consuming and requires manual searching in multiple IMS technologies. This results in many context switches and prevents developers from being focused and getting things done. Therefore, in this paper, we present a concept for seamlessly integrating different IMS technologies into each other and providing a better architectural context. The concept is based on augmenting the websites of issue management systems through a browser extension. We validate the approach with a prototypical implementation for the Chrome browser. For evaluation, we conducted expert interviews, which approved that the presented approach provides significant advantages for managing issues of agile microservice architectures. Sandro Speth, Uwe Breitenbücher, Niklas Krieger, Pia Wippermann, Steffen Becker 0001 |
XP | 5 |
| 2022 | Planning for Software System Recovery by Knowing Design Limitations of Cloud-native Patterns
M. Alireza Hakamian, Floriment Klinaku, Sebastian Frank 0001, André van Hoorn, Steffen Becker 0001 |
CLOSER | 5 |
| 2022 | Intelligent Methods for Test and ReliabilityabstractTest methods that can keep up with the ongoing increase in complexity of semiconductor products and their underlying technologies are an essential prerequisite for maintaining quality and safety of our daily lives and for continued success of our economies and societies. There is a huge potential how test methods can benefit from recent breakthroughs in domains such as artificial intelligence, data analytics, virtual/augmented reality, and security. The Graduate School on “Intelligent Methods for Semiconductor Test and Reliability” (GS-IMTR) at the University of Stuttgart is a large-scale, radically interdisciplinary effort to address the scientific-technological challenges in this domain. It is funded by Advantest, one of the world leaders in automatic test equipment. In this paper, we describe the overall philosophy of the Graduate School and the specific scientific questions targeted by its ten projects. Hussam Amrouch, Jens Anders, Steffen Becker 0001, Maik Betka, Gerd Bleher, Peter Domanski, Nourhan Elhamawy, Thomas Ertl, Athanasios Gatzastras, Paul R. Genssler, Sebastian Hasler, Martin Heinrich, André van Hoorn, Hanieh Jafarzadeh, Ingmar Kallfass, Florian Klemme, Steffen Koch 0001, Ralf Küsters, Andrés Lalama, Raphaël Latty, Yiwen Liao, Natalia Lylina, Zahra Paria Najafi-Haghi, Dirk Pflüger, Ilia Polian, Jochen Rivoir, Matthias Sauer 0002, Denis Schwachhofer, Steffen Templin, Christian Volmer, Stefan Wagner 0001, Daniel Weiskopf, Hans-Joachim Wunderlich, Bin Yang 0009 |
DATE | 3 |
| 2021 | Cross-Component Issue Metamodel and Modelling Language
Sandro Speth, Steffen Becker 0001, Uwe Breitenbücher |
CLOSER | 2 |
| 2021 | Security, Reliability and Test Aspects of the RISC-V EcosystemabstractRISC-V has emerged as a viable solution on academia and industry. However, to use open source hardware for safety-critical applications, we need a deep understanding of the way in which well established mechanisms for testing and reliability could be integrated and deployed on the RISC-V ecosystem, and we need a clear knowledge on how such an ecosystem can be leveraged to improve security. This paper includes four contributions presenting the potential of RISC-V in security research, the way in which RISC-V can be hardened against power analysis attacks, how to implement, using RISC-V, software and hardware/software solutions for dual core lock step, and how to perform system-level testing in the RISC-V ecosystem. Jaume Abella 0001, Sergi Alcaide, Jens Anders, Francisco Bas, Steffen Becker 0001, Elke De Mulder, Nourhan Elhamawy, Frank K. Gürkaynak, Helena Handschuh, Carles Hernández 0001, Michael Hutter, Leonidas Kosmidis, Ilia Polian, Matthias Sauer 0002, Stefan Wagner 0001, Francesco Regazzoni 0001 |
ETS | 5 |
| 2020 | Exploring the Mysteries of System-Level TestabstractSystem-level test, or SLT, is an increasingly important process step in today's integrated circuit testing flows. Broadly speaking, SLT aims at executing functional workloads in operational modes. In this paper, we consolidate available knowledge about what SLT is precisely and why it is used despite its considerable costs and complexities. We discuss the types or failures covered by SLT, and outline approaches to quality assessment, test generation and root-cause diagnosis in the context of SLT. Observing that the theoretical understanding for all these questions has not yet reached the level of maturity of the more conventional structural and functional test methods, we outline new and promising directions for methodical developments leveraging on recent findings from software engineering. Ilia Polian, Jens Anders, Steffen Becker 0001, Paolo Bernardi 0002, Krishnendu Chakrabarty, Nourhan Elhamawy, Matthias Sauer 0002, Adit D. Singh, Matteo Sonza Reorda, Stefan Wagner 0001 |
ATS | 3 |
| 2020 | An exploratory study on performance engineering in model transformationsabstractModel-Driven Software Engineering (MDSE) is a widely used approach to deal with the increasing complexity of software. This increasing complexity also leads to the fact that the models used and the model transformations applied become larger and more complex as well. This means that the execution performance of model transformations is gaining in importance. While improving the performance of model transformation execution engines has been a focus of the MDSE-community in the past, there does not exist any empirical study on how developers of model transformation deal with performance issues. Consequently, we conducted an exploratory mixed method study consisting of a quantitative online survey and a qualitative interview study. We used a questionnaire to investigate whether the performance of a transformation is actually important for transformation developers and whether they have already tried to improve the performance of a model transformation. Subsequently, we conducted semi-structured interviews based on the answers to the questionnaire to investigate how transformation developers deal with performance issues, what causes and solutions they found and also what they think could help them to easier find causes. The results of the quantitative online survey show that 43 of 81 participants have already tried to improve the performance of a transformation and 34 of the 81 are sometimes or only rarely satisfied with the execution performance. Based on the answers from our 13 interviews, we identified different strategies to prevent or find performance issues in model transformations as well as different types of causes of performance issues and solutions. Finally, we compiled a collection of additional tool features perceived helpful by the interviewees to address performance issues. Raffaela Groner, Luis Beaucamp, Matthias Tichy, Steffen Becker 0001 |
MoDELS | 4 |
| 2020 | Extended Abstract of Performance Analysis and Prediction of Model TransformationabstractNo abstract available. Vijayshree Vijayshree, Markus Frank, Steffen Becker 0001 |
ICPE | 3 |
| 2019 | The Elastic Processing of Data Streams in Cloud Environments: A Systematic Mapping Study
Floriment Klinaku, Michael Zigldrum, Markus Frank, Steffen Becker 0001 |
CLOSER | 4 |
| 2019 | Transactional execution of hierarchical reconfigurations in cyber-physical systems
Christian Heinzemann, Steffen Becker 0001, Andreas Volk |
Softw. Syst. Model. | 2 |
| 2018 | The architectural template method: templating architectural knowledge to efficiently conduct quality-of-service analysesabstractSummary Software architects plan the realization of software systems by assessing design decisions on the basis of architectural models. Using these models as input, architectural analyses assess the impact of architects' decisions on quality‐of‐service properties. While the creation of suitable architectural models requires software architects to apply complex architectural knowledge, for example, in the form of established architectural styles and patterns, current architectural analyses lack support for directly reusing such knowledge. This lack points to an unused potential to make the work of software architects more effective and efficient. To use this potential, we introduce the architectural template (AT) method, an engineering method that makes design‐time analyses of quality‐of‐service properties of software systems more efficient. The AT method allows to quantify quality‐of‐service properties on the basis of reusable modeling templates that capture recurring architectural knowledge. Architects just need to customize such templates with system‐specific parts. In a case study, we illustrate the applicability of the AT method in the domains of distributed and cloud computing and its suitability for the quality‐of‐service properties performance, scalability, elasticity, and cost‐efficiency. Copyright © 2017 John Wiley & Sons, Ltd. Sebastian Lehrig, Marcus Hilbrich, Steffen Becker 0001 |
Softw. Pract. Exp. | 3 |
| 2015 | Systematically Deriving Quality Metrics for Cloud Computing SystemsabstractIn cloud computing, software architects develop systems for virtually unlimited resources that cloud providers account on a pay-per-use basis. Elasticity management systems provision these resources autonomously to deal with changing workload. Such changing workloads call for new objective metrics allowing architects to quantify quality properties like scalability, elasticity, and efficiency, e.g., for requirements/SLO engineering and software design analysis. In literature, initial metrics for these properties have been proposed. However, current metrics lack a systematic derivation and assume knowledge of implementation details like resource handling. Therefore, these metrics are inapplicable where such knowledge is unavailable. Matthias Becker 0001, Sebastian Lehrig, Steffen Becker 0001 |
ICPE | 3 |
| 2015 | The CloudScale Method for Software Scalability, Elasticity, and Efficiency Engineering: a TutorialabstractIn cloud computing, software engineers design systems for virtually unlimited resources that cloud providers account on a pay-per-use basis. Elasticity management systems provision these resource autonomously to deal with changing workloads. Such workloads call for new objective metrics allowing engineers to quantify quality properties like scalability, elasticity, and efficiency. However, software engineers currently lack engineering methods that aid them in engineering their software regarding such properties. Sebastian Lehrig, Steffen Becker 0001 |
ICPE | 2 |
| 2015 | Quantitative Evaluation of Model-Driven Performance Analysis and Simulation of Component-Based ArchitecturesabstractDuring the last decade, researchers have proposed a number of model transformations enabling performance predictions. These transformations map performance-annotated software architecture models into stochastic models solved by analytical means or by simulation. However, so far, a detailed quantitative evaluation of the accuracy and efficiency of different transformations is missing, making it hard to select an adequate transformation for a given context. This paper provides an in-depth comparison and quantitative evaluation of representative model transformations to, e.g., queueing petri nets and layered queueing networks. The semantic gaps between typical source model abstractions and the different analysis techniques are revealed. The accuracy and efficiency of each transformation are evaluated by considering four case studies representing systems of different size and complexity. The presented results and insights gained from the evaluation help software architects and performance engineers to select the appropriate transformation for a given context, thus significantly improving the usability of model transformations for performance prediction. Fabian Brosig, Philipp Meier, Steffen Becker 0001, Anne Koziolek, Heiko Koziolek, Samuel Kounev |
IEEE Trans. Software Eng. | 3 |
| 2014 | Integrating Service Matchers into a Service Market Architecture
Marie Platenius-Mohr, Steffen Becker 0001, Wilhelm Schäfer |
ECSA | 2 |
| 2014 | Market-Optimized Service Specification and Matching
Svetlana Arifulina, Marie Platenius-Mohr, Steffen Becker 0001, Christian Gerth, Gregor Engels, Wilhelm Schäfer |
ICSOC | 3 |
| 2014 | Experience of pragmatically combining RE methods for performance requirements in industryabstractTo meet end-user performance expectations, precise performance requirements are needed during development and testing, e.g., to conduct detailed performance and load tests. However, in practice, several factors complicate performance requirements elicitation: lacking skills in performance requirements engineering, outdated or unavailable functional specifications and architecture models, the specification of the system's context, lack of experience to collect good performance requirements in an industrial setting with very limited time, etc. From the small set of available non-functional requirements engineering methods, no method exists that alone leads to precise and complete performance requirements with feasible effort and which has been reported to work in an industrial setting. In this paper, we present our experiences in combining existing requirements engineering methods into a performance requirements method called PROPRE. It has been designed to require no up-to-date system documentation and to be applicable with limited time and effort. We have successfully applied PROPRE in an industrial case study from the process automation domain. Our lessons learned show that the stakeholders gathered good performance requirements which now improve performance testing. Rebekka Wohlrab, Thijmen de Gooijer, Anne Koziolek, Steffen Becker 0001 |
RE | 4 |
| 2014 | A tool suite for the model-driven software engineering of cyber-physical systemsabstractCyber-physical systems, e.g., autonomous cars or trains, interact with their physical environment. As a consequence, they commonly have to coordinate with other systems via complex message communication while realizing safety-critical and real-time tasks. As a result, those systems should be correct by construction. Software architects can achieve this by using the MechatronicUML process and language. This paper presents the MechatronicUML Tool Suite that offers unique features to support the MechatronicUML modeling and analyses tasks. Stefan Dziwok, Christopher Gerking, Steffen Becker 0001, Sebastian Thiele 0002, Christian Heinzemann, Uwe Pohlmann |
SIGSOFT FSE | 3 |
| 2014 | PBlaman: performance blame analysis based on Palladio contractsabstractSUMMARY In performance‐driven software engineering, the performance of a system is evaluated through models before the system is assembled. After assembly, the performance is then validated using performance tests. When a component‐based system fails certain performance requirements during the tests, it is important to find out whether individual components yield performance errors or whether the composition of components is faulty. This task is called performance blame analysis. Existing performance blame analysis approaches and also alternative error analysis approaches are restricted, because they either do not employ expected values, use expected values from regression testing, or use static developer‐set limits. In contrast, this paper describes the new performance blame analysis approach PBlaman that builds upon our previous work and that employs the context‐portable performance contracts of Palladio. PBlaman decides what components to blame by comparing the observed response time data series of each single component operation in a failed test case to the operation's expected response time data series derived from the contracts. System architects are then assisted by a visual presentation of the obtained analysis results. We exemplify the benefits of PBlaman in two case studies, each of which representing applications that follow a particular architectural style. Copyright © 2014 John Wiley & Sons, Ltd. Frank Brüseke, Henning Wachsmuth, Gregor Engels, Steffen Becker 0001 |
Concurr. Comput. Pract. Exp. | 4 |
| 2014 | Reengineering component-based software systems with Archimetrix
Markus von Detten, Marie Platenius-Mohr, Steffen Becker 0001 |
Softw. Syst. Model. | 3 |
| 2013 | Towards a methodology driven by relationships of quality attributes for qos-based analysisabstractEngineering high quality software is a tough task. In order to know whether a certain quality attribute has been achieved or degraded, it has to be quantified by analysis or measured. However, determining what to quantify and how these quantities are related to each other is the difficult part. Early analysis of the quality attributes of a software system on the basis of the system's planned architecture allows informed decisions on design trade-offs. Such decisions can be later validated by measurements on the running system. Steffen Becker 0001, Lucia Happe, Raffaela Mirandola, Catia Trubiani |
ICPE | 1 |
| 2013 | CloudScale: scalability management for cloud systemsabstractThis work-in-progress paper introduces the EU FP7 STREP CloudScale. The contribution of this paper is an overall description of CloudScale's engineering approach for the design and evolution of scalable cloud applications and services. An Electronic Health Record (EHR) system serves as a motivation scenario. The overall CloudScale method describes how CloudScale will identify and gradually solve scalability problems in this existing applications. CloudScale will also enable the modelling of design alternatives and the analysis of their effect on scalability and cost. Best practices for scalability will further guide the design process. The CloudScale method is supported by three integrated tools and a scalability description modelling language. CloudScale will be validated by two case studies. Gunnar Brataas, Erlend Stav, Sebastian Lehrig, Steffen Becker 0001, Goran Kopcak, Darko Huljenic |
ICPE | 4 |
| 2013 | Decision support via automated metric comparison for the palladio-based performance blame analysisabstractWhen developing component-based systems, we incorporate third-party black-box components. For each component, performance contracts have been specified by their developers. If errors occur when testing the system built from these components, it is very important to find out whether components violate their performance contracts or whether the composition itself is faulty. This task is called performance blame analysis. In our previous work we presented a performance blame analysis approach that blames components based on a comparison of response time values from the failed test case to expected values derived from the performance contract. In that approach, the system architect needs to manually assess if the test data series shows faster or slower response times than the data derived from the contract. This is laborious as the system architect has to do this for each component operation. In this paper we present an automated comparison of each pair of data series as decision support. In contrast to our work, other approaches do not achieve fully automated decision support, because they do not incorporate sophisticated contracts. We exemplify our performance blame analysis including the automated decision support using the "Common Component Modeling Example" (CoCoME) benchmark. Frank Brüseke, Gregor Engels, Steffen Becker 0001 |
ICPE | 3 |
| 2013 | Performance and reliability prediction for evolving service-oriented software systems - Industrial experience report
Heiko Koziolek, Bastian Schlich, Steffen Becker 0001, Michael Hauck 0001 |
Empir. Softw. Eng. | 3 |
| 2012 | Weaving-Based Configuration and Modular Transformation of Multi-layer Systems
Galina Besova, Sven Walther, Heike Wehrheim, Steffen Becker 0001 |
MoDELS | 4 |
| 2012 | Information Retrieval in the CommentsphereabstractThis article studies information retrieval tasks related to Web comments. Prerequisite of such a study and a main contribution of the article is a unifying survey of the research field. We identify the most important retrieval tasks related to comments, namely filtering, ranking, and summarization. Within these tasks, we distinguish two paradigms according to which comments are utilized and which we designate as comment-targeting and comment-exploiting . Within the first paradigm, the comments themselves form the retrieval targets. Within the second paradigm, the commented items form the retrieval targets (i.e., comments are used as an additional information source to improve the retrieval performance for the commented items). We report on four case studies to demonstrate the exploration of the commentsphere under information retrieval aspects: comment filtering, comment ranking, comment summarization and cross-media retrieval. The first three studies deal primarily with comment-targeting retrieval, while the last one deals with comment-exploiting retrieval. Throughout the article, connections to information retrieval research are pointed out. Martin Potthast, Benno Stein 0001, Fabian Loose, Steffen Becker 0001 |
ACM Trans. Intell. Syst. Technol. | 4 |
| 2011 | An industrial case study on quality impact prediction for evolving service-oriented softwareabstractSystematic decision support for architectural design decisions is a major concern for software architects of evolving service-oriented systems. In practice, architects often analyse the expected performance and reliability of design alternatives based on prototypes or former experience. Model-driven prediction methods claim to uncover the tradeoffs between different alternatives quantitatively while being more cost-effective and less error-prone. However, they often suffer from weak tool support and focus on single quality attributes. Furthermore, there is limited evidence on their effectiveness based on documented industrial case studies. Thus, we have applied a novel, model-driven prediction method called Q-ImPrESS on a large-scale process control system consisting of several million lines of code from the automation domain to evaluate its evolution scenarios. This paper reports our experiences with the method and lessons learned. Benefits of Q-ImPrESS are the good architectural decision support and comprehensive tool framework, while one drawback is the time-consuming data collection. Heiko Koziolek, Bastian Schlich, Carlos G. Bilich, Roland Weiss 0002, Steffen Becker 0001, Klaus Krogmann, Mircea Trifu, Raffaela Mirandola, Anne Koziolek |
ICSE | 5 |
| 2010 | Opinion Summarization of Web Comments
Martin Potthast, Steffen Becker 0001 |
ECIR | 2 |
| 2010 | Incremental Updates for Textual Modelling of Large Scale ModelsabstractModel-Driven Engineering (MDE) aims at improving the development of complex computer systems. Within this context textual concrete syntaxes for models are beneficial for many reasons. They foster usability and productivity because of their fast editing style, their usage of error markers, autocompletion and quick fixes. Several frameworks and tools from different communities for creating concrete textual syntaxes for models emerged during recent years. However, open issues are incremental parsing and model updating as well as the handling and synchronisation of partial and federated views with the underlying model. In this paper we present an approach for concrete textual syntaxes that makes use of incremental parsing and transformation techniques. Thomas Goldschmidt, Steffen Becker 0001, Axel Uhl |
ICECCS | 2 |
| 2010 | Performance modeling in industry: a case study on storage virtualizationabstractIn software engineering, performance and the integration of performance analysis methodologies gain increasing importance, especially for complex systems. Well-developed methods and tools can predict non-functional performance properties like response time or resource utilization in early design stages, thus promising time and cost savings. However, as performance modeling and performance prediction is still a young research area, the methods are not yet well-established and in wide-spread industrial use. This work is a case study of the applicability of the Palladio Component Model as a performance prediction method in an industrial environment. We model and analyze different design alternatives for storage virtualization on an IBM* system. The model calibration, validation and evaluation is based on data measured on a System z9* as a proof of concept. The results show that performance predictions can identify performance bottlenecks and evaluate design alternatives in early stages of system development. The experiences gained were that performance modeling helps to understand and analyze a system. Hence, this case study substantiates that performance modeling is applicable in industry and a valuable method for evaluating design decisions. Nikolaus Huber, Steffen Becker 0001, Christoph Rathfelder, Jochen Schweflinghaus, Ralf Reussner |
ICSE (2) | 2 |
| 2010 | Towards comment-based cross-media retrievalabstractThis paper investigates whether Web comments can be exploited for cross-media retrieval. Comparing Web items such as texts, images, videos, music, products, or personal profiles can be done at various levels of detail; our focus is on topic similarity. We propose to compare user-supplied comments on Web items in lieu of the commented items themselves. If this approach is feasible, the task of extracting and mapping features between arbitrary pairs of item types can be circumvented, and well-known text retrieval models can be applied instead - given that comments are available. We report on results of a preliminary, but nonetheless large-scale experiment which shows that, if comments on textual items are compared with comments on video items, topically similar pairs achieve a sufficiently high cross-media similarity. Martin Potthast, Benno Stein 0001, Steffen Becker 0001 |
WWW | 3 |
| 2010 | Parametric performance completions for model-driven performance prediction
Jens Happe, Steffen Becker 0001, Christoph Rathfelder, Holger Friedrich 0003, Ralf Reussner |
Perform. Evaluation | 2 |
| 2009 | The Palladio component model for model-driven performance prediction
Steffen Becker 0001, Heiko Koziolek, Ralf Reussner |
J. Syst. Softw. | 1 |