Although conversational agents are successfully applied in teaching, it is largely unclear which communication principles should be employed to optimise learning. We examine the influence of common ground (i.e. shared knowledge on which to build during conversation) on learning. In an in-class experiment, students studied with one of two pedagogical conversational agents. The control version provided information without emphasising grounding, whereas the common ground version emphasised grounding, for example, by encouraging students to monitor and repair common ground. After the learning unit, students evaluated their learning experience and the pedagogical conversational agent, after which they were tested on the studied material. Students in the common ground (vs. the control) condition performed better in a post-study knowledge test and engaged longer with the pedagogical conversational agent. Thus, the common ground emphasis facilitated learning with a conversational agent, indicating that grounding principles should be incorporated when designing conversational agents.

Providing argumentation feedback is considered helpful for students preparing to work in collaborative environments, helping them with writing higher-quality argumentative texts. Domain-independent natural language processing (NLP) methods, such as generative models, can utilize learner errors and fallacies in argumentation learning to help students write better argumentative texts. To test this, we collect design requirements, and then design and implement two different versions of our system called ALure to improve the students' argumentation skills. We test how ALure helps students learn argumentation in a university lecture with 305 students and compare the learning gains of the two versions of ALure with a control group using video tutoring. We find and discuss the differences of learning gains in argument structure and fallacies in both groups after using ALure, as well as the control group. Our results shed light on the applicability of computer-supported systems using recent advances in NLP to help students in learning argumentation as a necessary skill for collaborative working settings.

New political objectives, emerging regulatory regimes for the digital sphere, and higher penalties for violations have intensified the pressure to develop lawful IT artefacts. As the adaptation of existing IT artefacts to new regulations can be expensive and arduous, a more attractive approach would be to design IT artefacts lawfully from the beginning. A major challenge is that the law is generally technology-neutral, and lawful design requires legal expertise throughout the development, which is costly and time consuming due to communication challenges between legal experts and developers. One possible approach to proactively consider IT regulations in the systems development is design patterns that convey legal design knowledge and support developers in determining the appropriate design options. Consequently, we develop a framework for lawful design patterns and demonstrate their feasibility and advantages using the example of developing AI-based assistants and the regulation of the General Data Protection Regulation (GDPR). Using the design pattern framework, we develop design patterns for lawful AI-based assistants and evaluate them using (a) an experimental approach to show the usefulness of the patterns for developers and (b) rely on a legal simulation study to holistically evaluate how design patterns contribute to lawful IT.

This paper employs a longitudinal perspective to examine continued system use (CSU) by individuals in utilitarian, volitional contexts when alternative systems are present . We focus on two key behavioural antecedents of CSU – habit and continuance intention – and theorise how the relationships between CSU and these antecedents evolve over time. In addition, we hypothesise how the interaction effect of habit and intention on CSU evolves temporally. Our theorising differs from extant literature in two important respects: 1) In contrast to the widespread acceptance of the diminishing effect of continuance intention on CSU in the information systems (IS) literature, we hypothesise that in our context, its impact increases with time; and 2) In contrast to the negative moderation effect of habit on the relationship between intention and CSU proposed in the literature, we posit a positive interaction effect. We collect longitudinal survey data on the use of a higher education IS from students in a European university. Our results suggest that the impact of continuance intention on CSU as well as the interaction effect between habit and intention are increasing over time. We further introduce a methodological innovation – the permutation approach to conduct the multi-group analysis with repeated measures – to the literature.

The adoption of innovative technologies confronts IT-Service-Management (ITSM) with an increasing volume and variety of requests. Artificial intelligence (AI) possesses the potential to augment customer service employees. However, the training data for AI systems are annotated by domain experts with little interest in labeling correctly due to their limited perceived value. Ultimately, insufficient labeled data leads to diminishing returns in AI performance. Following a design science research approach, we provide a novel human-in-the-loop (HIL) design for ITSM support ticket recommendations by incorporating a value co-creation perspective. The design incentivizes ITSM agents to provide labels during their everyday ticket-handling procedures. We develop a functional prototype based on 17,120 support tickets provided by a pilot partner as an instantiation and evaluate the design through accuracy metrics and user evaluations. Our evaluation revealed that recommendations after label improvement showed increased user ratings, and users are willing to contribute their domain knowledge. The improved labels can be utilized to continuously enhance the AI system as rewards showed increasing growth with decreasing marginal returns. Overall, our results emphasize agents' need for value-in-use by providing better results if they improve the labeling of support tickets pre-labeled by AI. Thus, we provide prescriptive knowledge of a novel HIL design that enables efficient and interactive labeling in the context of diverse applications of reinforcement learning systems.

The increasing digitalization and automatization in the manufacturing industry as well as the need to learn on the job has reinforced the need for much more granular learning, which has not yet impacted the design of learning materials. In this regard, granular learning concepts require situated learning materials to support self-directed learning in the workplace in a targeted manner. Co-creation approaches offer promising opportunities to support employees in the independent design of such situated learning materials. Using an action-design research (ADR) approach, we derived requirements from co-creation concepts and practice by conducting focus group workshops in manufacturing and vocational training schools to develop design principles for a co-creation system that supports employees through the creation process of work-process-related learning material. Consequently, we formulate four design principles for the design of a collaborative learning and qualification system for manufacturing. Using an innovative mixed methods approach, we validate these design principles and design features to demonstrate the success of the developed artifact. The results provide insights regarding the design of a co-creation system to support learners in the co-creation of learning material with the consideration of cognitive load (CL). Our study contributes to research and practice by proposing novel design principles for supporting employees in peer creation processes. Furthermore, our study reveals how co-creation systems can support the collaborative development of learning materials in the work process.

IT carve-out projects are complex and cost-intensive components of M&A transactions. Existing research sheds little light on the determinants of IT carve-out project complexity and/or its effects on divestor performance. Instead, research has focused on the post-acquisition IT integration project and acquirer performance. This paper presents the first divestor-centric model of IT transactions from the divestor to the acquirer when a Business Unit in a Multi-Business Organization (MBO) is carved out and integrated into another MBO. The model explains how divestor business and IT alignment pre-conditions contribute to increased IT carve-out project complexity. Such complexity increases IT carve-out project time to physical IT separation and creates IT stranded assets, which decrease post-divestment business, IT alignment and divestor performance. The current recommended strategy of adopting transitional service agreements (TSAs) to handle IT carve-out complexity is compared with two new proactive strategies derived from the model. TSA-based strategies restrict the divestor from both decommissioning IT stranded assets and reconfiguring its IT assets to support its new post-divestment business strategy. The two new strategies address IT carve-out complexity without incurring the negative effects from adopting TSAs.

Advances in Natural Language Processing offer techniques to detect the empathy level in texts. To test if individual feedback on certain students’ empathy level in their peer review writing process will help them to write more empathic reviews, we developed ELEA, an adaptive writing support system that provides students with feedback on the cognitive and emotional empathy structures. We compared ELEA to a proven empathy support tool in a peer review setting with 119 students. We found students using ELEA wrote more empathic peer reviews with a higher level of emotional empathy compared to the control group. The high perceived skill learning, the technology acceptance, and the level of enjoyment provide promising results to use such an approach as a feedback application in traditional learning settings. Our results indicate that learning applications based on NLP are able to foster empathic writing skills of students in peer review scenarios.

Text-based conversational agents (CAs) are widely deployed across a number of daily tasks, including information retrieval. However, most existing agents follow a default design that disregards user needs and preferences, ultimately leading to a lack of usage and an unsatisfying user experience. To better understand how CAs can be designed in order to lead to effective system use, we deduced relevant design requirements from both literature and 13 user interviews. We built and tested a question-answering, text-based CA for an information retrieval task in an education scenario. Results from our experimental test with 41 students indicate that following a user-centered design has a significant positive effect on enjoyment and trust in a CA as opposed to deploying a default CA. If not designed with the user in mind, CAs are not necessarily more beneficial than traditional question-answering systems. Beyond practical implications for effective CA design, this paper points towards key challenges and potential research avenues when deploying social cues for CAs.

Recent advantages from computational linguists can be leveraged to nudge students with adaptive self-evaluation based on their argumentation skill level. To investigate how individual argumentation self-evaluation will help students write more convincing texts, we designed an intelligent argumentation writing support system called ArgumentFeedback based on nudging theory and evaluated it in a series of three qualitative and quantitative studies with a total of 83 students. We found that students who received a self-evaluation nudge wrote more convincing texts with a better quality of formal and perceived argumentation compared to the control group. The measured self-efficacy and the technology acceptance provide promising results for embedding adaptive argumentation writing support tools in combination with digital nudging in traditional learning settings to foster self-regulated learning. Our results indicate that the design of nudging-based learning applications for self-regulated learning combined with computational methods for argumentation self-evaluation has a beneficial use to foster better writing skills of students.

Conversational agents (CAs) provide opportunities for improving the interaction in evaluation surveys. To investigate if and how a user-centered conversational evaluation tool impacts users' response quality and their experience, we build EVA - a novel conversational course evaluation tool for educational scenarios. In a field experiment with 128 students, we compared EVA against a static web survey. Our results confirm prior findings from literature about the positive effect of conversational evaluation tools in the domain of education. Second, we then investigate the differences between a voice-based and text-based conversational human-computer interaction of EVA in the same experimental set-up. Against our prior expectation, the students of the voice-based interaction answered with higher information quality but with lower quantity of information compared to the text-based modality. Our findings indicate that using a conversational CA (voice and text-based) results in a higher response quality and user experience compared to a static web survey interface.

Thiemo Wambsganss, Christina Niklaus, Matthias Söllner, Siegfried Handschuh, Jan Marco Leimeister. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.

Techniques from Natural-Language-Processing offer the opportunities to design new dialog-based forms of human-computer interaction as well as to analyze the argumentation quality of texts. This can be leveraged to provide students with adaptive tutoring when doing a persuasive writing exercise. To test if individual tutoring for students’ argumentation will help them to write more convincing texts, we developed ArgueTutor, a conversational agent that tutors students with adaptive argumentation feedback in their learning journey. We compared ArgueTutor with 55 students to a traditional writing tool. We found students using ArgueTutor wrote more convincing texts with a better quality of argumentation compared to the ones using the alternative approach. The measured level of enjoyment and ease of use provides promising results to use our tool in traditional learning settings. Our results indicate that dialog-based learning applications combined with NLP text feedback have a beneficial use to foster better writing skills of students.

Recent advances in Natural Language Processing (NLP) bear the opportunity to analyze the argumentation quality of texts. This can be leveraged to provide students with individual and adaptive feedback in their personal learning journey. To test if individual feedback on students' argumentation will help them to write more convincing texts, we developed AL, an adaptive IT tool that provides students with feedback on the argumentation structure of a given text. We compared AL with 54 students to a proven argumentation support tool. We found students using AL wrote more convincing texts with better formal quality of argumentation compared to the ones using the traditional approach. The measured technology acceptance provided promising results to use this tool as a feedback application in different learning settings. The results suggest that learning applications based on NLP may have a beneficial use for developing better writing and reasoning for students in traditional learning settings.

Enrollment in online courses has sharply increased in higher education. Although online education can be scaled to large audiences, the lack of interaction between educators and learners is difficult to replace and remains a primary challenge in the field. Conversational agents may alleviate this problem by engaging in natural interaction and by scaffolding learners' understanding similarly to educators. However, whether this approach can also be used to enrich online video lectures has largely remained unknown. We developed Sara, a conversational agent that appears during an online video lecture. She provides scaffolds by voice and text when needed and includes a voice-based input mode. An evaluation with 182 learners in a 2 x 2 lab experiment demonstrated that Sara, compared to more traditional conversational agents, significantly improved learning in a programming task. This study highlights the importance of including scaffolding and voice-based conversational agents in online videos to improve meaningful learning.

In this paper, we present a novel annotation approach to capture claims and premises of arguments and their relations in student-written persuasive peer reviews on business models in German language.We propose an annotation scheme based on annotation guidelines that allows to model claims and premises as well as support and attack relations for capturing the structure of argumentative discourse in student-written peer reviews.We conduct an annotation study with three annotators on 50 persuasive essays to evaluate our annotation scheme.The obtained interrater agreement of α = 0.57 for argument components and α = 0.49 for argumentative relations indicates that the proposed annotation scheme successfully guides annotators to moderate agreement.Finally, we present our freely available corpus of 1,000 persuasive student-written peer reviews on business models and our annotation guidelines to encourage future research on the design and development of argumentative writing support systems for students.

1. With thousands of peer-reviewed publications and thousands of applications in education, industry, and government, gamification has taken the world by storm. But this explosion of gamification i...

Technology acceptance research has shown that trust is an important factor fostering use of information systems (IS). As a result, numerous IS researchers have studied factors that build trust in I...

This research-in-progress-paper describes the case of SAPiens, which is a Virtual Ideas Community (VIC). Typically, SAPiens - and VICs in general - focuses solely on supporting the ideation interactions among members. There is evidence from a survey that SAPiens members are also interested in actively signaling competences, experiences and skills to third parties. However, SAPiens does not offer IT functionalities that would allow for such a signaling. Against this backdrop, we propose to enrich SAPiens through User Profile Webpages allowing SAPiens members to construct a public profile within the community and thereby to signal individual capabilities, skills and experiences. The aim of this action design research is to design such an IT artifact by building on the signaling theory. After this initial design, our research constitutes a circular process of constant refinement as well as piloting and evaluation of the IT artifact in the real world setting of the SAPiens VIC.

Product service systems (PSS) are bundles of physical technological elements and service elements that are integrated to solve customer problems. In practice, most components of PSS are developed independently from each other, which leads to problems with coordination of development activities and integration of PSS components. Therefore, an integrated requirements engineering for PSS is needed that deals with the involvement of developers from product engineering, software engineering, and service engineering, as well as the inherent complexity of the PSS and the development process. In a case study with the development department of a PSS provider, we analyzed requirements documents and conducted expert interviews. We identified problems in the development, for example, that requirements on different levels of abstraction are intermingled, rationales for requirements are missing, and the concretization of requirements is unclear. To solve these problems, we propose a requirements data model (RDMod) for requirements to PSS. An RDMod describes different types of requirements and the relations between them. Thus, it is a scheme for the concretization of the requirements, which especially addresses the problems of structuring the requirements, enabling traceability, and finding conflicts. We then used an analytical evaluation, a feature-based evaluation and a retrospective application with requirements analysts of the industry partner. In a joint workshop, we specified requirements for a PSS with the RDMod. In structured interviews, we analyzed the perceived advantages of the RDMod. The experts confirmed that the RDMod is applicable in their development and it provides a clear structure for the requirements and therefore helps overcoming the identified problems.

This research-in-progress paper presents a research project that aims at developing, piloting and evaluating a crowdfunding platform to support financing for start-ups emerging from university. Currently, universities' own financial resources to support setting up businesses from universities are limited. Universities' business foundation consultancy can often only intermediate between entrepreneurs on the one side and restricted funding programs or few investors on the other side. A crowdfunding platform enables many individuals of the (university) crowd to support promising business ideas with little investments cumulating to a greater sum in total. Thus, it has the potential to extend universities' opportunities to support entrepreneurs. In addition, tasks like idea communication, idea evaluation and investment decisions can be outsourced to the crowd. The idea, research setting, first results and a future outlook of this research project are discussed in this paper.

In this paper, we describe a prototype that allows users to receive news on his NFC enabled mobile phone by touching a poster on the go.

The underlying paper describes a framework for the systematic and strategic planning of mobile broadband services, providing an industrial application and an impulse for further and future research on adoption and diffusion studies in the field of mobile broadband technology. Elaborated conditions and characteristics of innovations, keyfindings of basic theoretical approaches on adoption and diffusion studies and the critical review of advanced and recently developed modelling approaches are combined with the special characteristics of the telecommunication industry, to a two-level based framework describing factors of influence on adoption and diffusion of mobile broadband services. The framework strength is in its detailed state-of-the-art description of current industrial mobile broadband situation and the two-level- micro- and macro-level-approach on adoption and diffusion research. The novelty of the framework is its potential exemplary appliance on Germany, Finland or other countries, extraction of key-patterns in this highly competitive business field, highly consumer-oriented approach and its advanced scopes and recommendations for mobile broadband service development units.