Abstract We study randomized generation of sequences of test inputs to a system using Prolog. Prolog is a natural fit to generate test sequences that have complex logical interdependent structure. To counter the problems posed by a large (or infinite) set of possible tests, randomization is a natural choice. We study the impact that randomization in conjunction with SLD resolution have on the test performance. To this end, this paper proposes two strategies to add randomization to a test-generating program. One strategy works on top of standard Prolog semantics, whereas the other alters the SLD selection function. We analyze the mean time to reach a test case and the mean number of generated test cases in the framework of Markov chains. Finally, we provide an additional empirical evaluation and comparison between both approaches.

Information security training is becoming increasingly relevant in recent years. Common learning methods experience an evolution towards both real-world scenarios (such as phishing simulations), as well as gamified learning and training materials. In this paper, we attempt to shed light on the role the game design as well as the target audience play in its effectiveness. For our study, we used four games that were developed over the course of three years. The games cover a spectrum of design decisions: We compare (1) simulation games (e.g. games that simulate a workspace) to games that are more abstract, (2) games with an attacker-perspective to games with a defender-perspective and (3) whether prior experience of the player with IT security incidents have an impact. To this end, we conducted an empirical study built on the Gamefulquest questionnaire to assess the perceived gamefulness. We found that most studied factors show no statistically significant impact. This is a surprising result and can have major implications for the cost-benefit calculus during development stages. One statistically significant and surprising result is the role a subject’s prior exposure to IT-security incidents has: Subjects who have been exposed find some games more difficult than subjects who have not. This effect might lead to counterproductive results: Subjects without exposure can be mislead into a false sense of acuity.