EDBT 2026 Demo / reviewers in the wild / expert
John C. Stamper
dblp:02/6739
· DBLP profile ↗
107ranked-venue papers
16as first author
39since 2021 · last 2026
0000-0002-2291-1468ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Applied, interdisciplinary, general and emerging computing · 93 · 14 first-author · 32 since 2021Human-computer interaction and ubiquitous computing · 60 · 9 first-author · 24 since 2021Artificial intelligence and machine learning · 16 · 2 first-author · 11 since 2021Systems, architecture and hardware · 11 · 10 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 2 first-author · 1 since 2021Computer networks · 1
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Learning to Use AI for Learning: Teaching Responsible Use of AI Chatbot to K-12 Students Through an AI Literacy ModuleabstractAs Artificial Intelligence (AI) becomes increasingly integrated into daily life, there is a growing need to equip the next generation with the ability to apply, interact with, evaluate, and collaborate with AI systems responsibly. Prior research highlights the urgent demand from K-12 educators to teach students the ethical and effective use of AI for learning. To address this need, we designed a Large-Language Model (LLM)-based module to teach prompting literacy. This includes scenario-based deliberate practice activities with direct interaction with intelligent LLM agents, aiming to foster secondary school students' responsible engagement with AI chatbots. We conducted two iterations of classroom deployment in 11 authentic secondary education classrooms, and evaluated 1) AI-based auto-grader's capability; 2) students' prompting performance and confidence changes towards using AI for learning; and 3) the quality of learning and assessment materials. Results indicated that the AI-based auto-grader could grade student-written prompts with satisfactory quality. In addition, the instructional materials supported students in improving their prompting skills through practice and led to positive shifts in their perceptions of using AI for learning. Furthermore, data from Study 1 informed assessment revisions in Study 2. Analyses of item difficulty and discrimination in Study 2 showed that True/False and open-ended questions could measure prompting literacy more effectively than multiple-choice questions for our target learners. These promising outcomes highlight the potential for broader deployment and highlight the need for broader studies to assess learning effectiveness and assessment design. Ruiwei Xiao, Xinying Hou, Ying-Jui Tseng, Hsuan Nieu, Guanze Liao, John C. Stamper, Kenneth R. Koedinger |
AAAI | 6 |
| 2026 | Enabling Multi-agent Systems as Learning Designers: Applying Learning Sciences to AI Instructional Design
Ruiwei Xiao, Xinying Hou, John C. Stamper |
AIED (3) | 4 |
| 2026 | EdTech for Last Mile Learners in the Global South: Navigating Technological and Motivational Learning Insights with Radios and Mobile PhonesabstractEducational technology (EdTech) solutions have shown promise for disseminating educational opportunities to last-mile learners, particularly in the Global South. Low-infrastructure EdTech as a digital learning resource is especially critical to understand in remote contexts where educational opportunities and resources are limited. Our work investigated insights from 81 learners who engaged with a remote course that provided engineering education through radios and mobile phones in rural Uganda. Findings revealed that the course facilitated goal-driven and practical motivations in safe, adaptable environments. Our work goes beyond the idea that low-infrastructure EdTech can easily facilitate learning, highlighting diverse learner experiences navigating radio and phone use and presenting novel findings on community skepticism towards the course. Our research extends the EdTech and HCI literature by bringing light to the underrepresented voices of last-mile learners, sharing their insights on interacting with low-infrastructure EdTech, and how these insights can guide the design of contextually aligned EdTech. Christine Kwon, Dieyu Ouyang, Lingkan Wang, Debbie Eleene Conejo, Phenyo Phemelo Moletsane, John C. Stamper, Amy Ogan |
CHI | 6 |
| 2026 | Do Teachers Dream of GenAI Widening Educational (In)equality? Envisioning the Future of K-12 GenAI Education from Global Teachers' PerspectivesabstractGenerative artificial intelligence (GenAI) is rapidly entering K-12 classrooms worldwide, initiating urgent debates about its potential to either reduce or exacerbate educational inequalities. Drawing on interviews with 30 K-12 teachers across the United States, South Africa, and Taiwan, this study examines how teachers navigate this GenAI tension around educational equalities. We found teachers actively framed GenAI education as an equality-oriented practice: they used it to alleviate pre-existing inequalities while simultaneously working to prevent new inequalities from emerging. Despite these efforts, teachers confronted persistent systemic barriers, i.e., unequal infrastructure, insufficient professional training, and restrictive social norms, that individual initiative alone could not overcome. Teachers thus articulated normative visions for more inclusive GenAI education. By centering teachers’ practices, constraints, and future envisions, this study contributes a global account of how GenAI education is being integrated into K-12 contexts and highlights what is required to make its adoption genuinely equal. Ruiwei Xiao, Qing Xiao 0002, Xinying Hou, Phenyo Phemelo Moletsane, Hanqi Jane Li, Hong Shen 0004, John C. Stamper |
CHI | 7 |
| 2026 | Revisiting the Hint Button: Consistent Negative Associations Between Unproductive Hint Use and Learning Outcomes in Intelligent Tutoring Systems
Marshall An, Mahboobeh Mehrvarz, John C. Stamper, Bruce M. McLaren |
LAK | 3 |
| 2026 | Generate-Then-Validate: A Novel Question Generation Approach Using Small Language ModelsabstractWe explore the use of small language models (SLMs) for automatic question generation as a complement to the prevalent use of their large counterparts in learning analytics research. We present a novel question generation pipeline that leverages both the text generation and the probabilistic reasoning abilities of SLMs to generate high-quality questions. Adopting a “generate-then-validate” strategy, our pipeline first performs expansive generation to create an abundance of candidate questions and refine them through selective validation based on novel probabilistic reasoning. We conducted two evaluation studies, one with seven human experts and the other with a large language model (LLM), to assess the quality of the generated questions. Most judges (humans or LLMs) agreed that the generated questions had clear answers and generally aligned well with the intended learning objectives. Our findings suggest that an SLM can effectively generate high-quality questions when guided by a well-designed pipeline that leverages its strengths. Yumou Wei, John C. Stamper, Paulo Carvalho 0004 |
LAK | 2 |
| 2026 | How to Assess AI Literacy: Misalignment Between Self-Reported and Objective-Based Measures
Shan Zhang 0003, Ruiwei Xiao, Anthony Botelho, Guanze Liao, Thomas K. F. Chiu, John C. Stamper, Kenneth R. Koedinger |
LAK | 6 |
| 2026 | Can Multilingual Environments Promote Scalable EdTech? Evidence from a Randomized Controlled Trial
Phenyo Phemelo Moletsane, Christine Kwon, John C. Stamper, Amy Ogan, Paulo Carvalho 0004 |
L@S | 3 |
| 2026 | Deriving Instructional Insights from Human-LLM Co-Evaluation of Student Collaboration in Data-Centric ProgrammingabstractThis quasi-experimental study integrates a large language model (LLM) with expert qualitative analysis to examine how instructional design variations in computer-supported collaborative learning (CSCL) shape collaboration in data-centric programming. We collected 73 team transcripts from two contrasting CSCL designs deployed across five course offerings: a closed-ended variant with prescribed solution paths and auto-graded milestones, and an open-ended variant supporting exploratory tasks with multiple valid paths. LLM annotation revealed statistically significant differences in knowledge co-construction patterns: the open-ended design yielded a higher proportion of utterances focused on developing a shared understanding of problems and solutions. Guided by these quantitative results, human experts conducted qualitative coding that confirmed and enriched these findings, showing how open-ended tasks fostered elaborative solution negotiation while closed-ended structures promoted non-elaborative exchanges. Our contributions are: (1) instructional insights for data science education, demonstrating how open-ended CSCL designs better support collaborative sense-making essential for real-world data science projects; and (2) a documented workflow for human-LLM co-evaluation, providing the methodological detail necessary for others to replicate our process and apply it to future studies. Marshall An, Christine Kwon, Jihyeon Hur, Dongho Lee, Vincent Huai, Barry Zheng, Matthew Yu, Joana Liu, Jenny Pugh, Gahgene Gweon, John C. Stamper |
SIGCSE (1) | 12 |
| 2026 | Exploring Student Choice and the Use of Multimodal Generative AI in Programming LearningabstractThe broad adoption of Generative AI (GenAI) is impacting Computer Science education, and recent studies found its benefits and potential concerns when students use it for programming learning. However, most existing explorations focus on GenAI tools that primarily support text-to-text interaction. With recent developments, GenAI applications have begun supporting multiple modes of communication, known as multimodality. In this work, we explored how undergraduate programming novices choose and work with multimodal GenAI tools, and their criteria for choices. We selected a commercially available multimodal GenAI platform for interaction, as it supports multiple input and output modalities, including text, audio, image upload, and real-time screen-sharing. Through 16 think-aloud sessions that combined participant observation with follow-up semi-structured interviews, we investigated student modality choices for GenAI tools when completing programming problems and the underlying criteria for modality selections. With multimodal communication emerging as the future of AI in education, this work aims to spark continued exploration on understanding student interaction with multimodal GenAI in the context of CS education. Xinying Hou, Ruiwei Xiao, Runlong Ye 0002, Michael Liut, John C. Stamper |
SIGCSE (1) | 5 |
| 2025 | Deceptive Overgeneralization in Adaptive Learning
Marshall An, John C. Stamper |
AIED (6) | 2 |
| 2025 | Detecting Informal Reasoning Errors in Spoken Arguments: A Difficulty Factors Assessment of Distracted Reasoning
Nicholas Diana, John C. Stamper |
AIED (3) | 2 |
| 2025 | Generative AI in Instructional Design Education: Effects on Novice Microlesson Quality
Steven Moore, Lydia Eckstein, Christine Kwon, John C. Stamper |
AIED (4) | 4 |
| 2025 | KCluster: An LLM-based Clustering Approach to Knowledge Component Discovery
Yumou Wei, Paulo Carvalho 0004, John C. Stamper |
EDM | 3 |
| 2025 | Does the Doer Effect Generalize To Non-WEIRD Populations? Toward Analytics in Radio and Phone-Based LearningabstractThe Doer Effect states that completing more active learning activities, like practice questions, is more strongly related to positive learning outcomes than passive learning activities, like reading, watching, or listening to course materials. Although broad, most evidence has emerged from practice with tutoring systems in Western, Industrialized, Rich, Educated, and Democratic (WEIRD) populations in North America and Europe. Does the Doer Effect generalize beyond WEIRD populations, where learners may practice in remote locales through different technologies? Through learning analytics, we provide evidence from N = 234 Ugandan students answering multiple-choice questions via phones and listening to lectures via community radio. Our findings support the hypothesis that active learning is more associated with learning outcomes than passive learning. We find this relationship is weaker for learners with higher prior educational attainment. Our findings motivate further study of the Doer Effect in diverse populations. We offer considerations for future research in designing and evaluating contextually relevant active and passive learning opportunities including leveraging familiar technology, increasing the number of practice opportunities, and aligning multiple data sources. Darren Butler, Conrad Borchers, Michael W. Asher, Yongmin Lee, Sonya Karnataki, Sameeksha Dangi, Samyukta Athreya, John C. Stamper, Amy Ogan, Paulo Carvalho 0004 |
LAK | 8 |
| 2025 | Platform-based Adaptive Experimental Research in Education: Lessons Learned from The Digital Learning ChallengeabstractAdaptive Experimentation is one of the most promising approaches to support complex decision-making in learning experience design and delivery. This paper reports on our experience with a real-world, multi-experimental evaluation of an adaptive experimentation platform within the XPRIZE Digital Learning Challenge framework, and summarizes data-driven lessons learned and best practices for Adaptive Experimentation in education. We outline key scenarios of the applicability of platform-supported experiments and reflect on lessons learned from this two-year project, focusing on implications relevant to platform developers, researchers, practitioners, and policy stakeholders to integrate Adaptive Experiments in real-world courses. Ilya Musabirov, Mohi Reza, Haochen Song, Steven Moore, Pan Chen 0005, John C. Stamper, Norman L. Bier, Anna N. Rafferty, Thomas W. Price, Nina Deliu, Audrey Durand, Michael Liut, Joseph Jay Williams |
LAK | 8 |
| 2025 | Validating a New Approach for Measuring Student Engagement in Remote, Low-Infrastructure Learning EnvironmentsabstractExpanding access to education in rural African communities remains difficult, largely due to limited internet connectivity. Mobile learning courses delivered via radio and offline mobile phones offer a promising, scalable solution. However, it is challenging to track student engagement in these environments due to the absence of tools that monitor students' interactions with the radio. In this study, we investigate the potential of ''Prize Codes'' -- codes read aloud during broadcasts that students enter via text message -- to serve as a real-time measure of student engagement with mobile-learning broadcasts. Using data from a 2024 implementation of Yiya AirScience, a mobile engineering course in Uganda, we evaluate the validity of Prize Codes as an engagement metric. Specifically, we test whether Prize Code measures (1) demonstrate reliability, with students who enter correct codes in one lesson being more likely to do so in subsequent lessons; (2) demonstrate convergent validity with existing measures of engagement; and (3) demonstrate predictive validity, predicting learning outcomes in the course. Our findings suggest that Prize Codes are a reliable and valid measure of engagement. Prize-Code accuracy demonstrates strong internal consistency (alpha = .97) and moderate test-retest reliability (ICC = .44). The measure aligns closely with synchronous participation (87% agreement, Cohen's kappa = .50), indicating it captures similar engagement patterns. Importantly, students who consistently enter correct Prize Codes perform significantly better on assessments, with Prize Code engagement predicting final exam scores above and beyond other engagement metrics. After establishing the measure's validity, we use it to (1) characterize patterns of engagement with Yiya broadcasts, (2) investigate early engagement with the broadcasts as a predictor of course persistence, and (3) replicate findings about the benefits of learning by doing. This study suggests that Prize Codes can be a feasible, scalable approach for tracking real-time engagement in resource-limited mobile learning settings at scale. Michael W. Asher, Christine Kwon, John C. Stamper, Amy Ogan, Paulo Carvalho 0004 |
L@S | 3 |
| 2025 | Learnersourcing: Student-generated Content @ Scale: 3rd Annual WorkshopabstractPeer Reviewed Steven Moore, Xinyi Lu 0004, Hyoungwook Jin, Hassan Khosravi, Paul Denny 0001, Christopher Brooks 0001, Xu Wang 0016, Juho Kim 0001, John C. Stamper |
L@S | 10 |
| 2025 | Sixth Annual Workshop on A/B Testing and Platform-Enabled Learning Engineering (PELE)abstractLearning engineering applies data and learning science principles to better understand outcomes and support improvement research. One important approach is A/B testing-common in large software companies and also represented academically at conferences like the Annual Conference on Digital Experimentation (CODE), and the International Consortium for Innovation and Collaboration in Learning Engineering (IEEE ICICLE). Several systems supporting A/B testing in educational applications have arisen recently, including UpGrade, E-TRIALS, and Terracotta. A/B testing can help improve educational platforms, yet there are challenging issues unique to conducting such work in these contexts. In response, a number of digital learning platforms have opened their systems to learning-improvement research by instructors and/or third-party researchers, with specific supports necessary for education-specific research designs. This workshop will explore how A/B testing is conducted in educational contexts, how digital learning platforms are accelerating education research, and how empirical approaches can be used to drive powerful gains in student learning. It will also discuss opportunities for funding to conduct platform-enabled learning engineering. April Murphy, Stephen Fancsali, Steven Ritter 0001, Neil T. Heffernan, Debshila Basu Mallick, Jeremy Roschelle, Danielle S. McNamara, Joseph Jay Williams, John C. Stamper, Norman L. Bier, Jeffrey C. Carver |
L@S | 9 |
| 2025 | Granular Feedback: Leveraging Domain Expertise and Explainable AI to Effectively Steer Modelsabstractsponsorship: We would like to thank ZAVO, and Joke Vandepitte in particular, for allowing us to collaborate. We would like to thank FWO by facilitating this interdisciplinary research. Additionally, we would like to thank all participants for their time and valuable insights. This research is part of the research projects funded by KU Leuven (grant C14/21/072) and the Flanders AI Research Program (FAIR). (KU Leuven|C14/21/072, Flanders AI Research Program (FAIR)) Maxwell Szymanski, John C. Stamper, Vero Vanden Abeele, Katrien Verbert |
UMAP | 2 |
| 2024 | An Automatic Question Usability Evaluation Toolkit
Steven Moore, Eamon Costello, Huy Anh Nguyen, John C. Stamper |
AIED (2) | 4 |
| 2024 | Investigating Demographics and Motivation in Engineering Education Using Radio and Phone-Based Educational TechnologiesabstractDespite the best intentions to support equity with educational technologies, they often lead to a “rich get richer” effect, in which communities of more advantaged learners gain greater benefit from these solutions. Effective design of these technologies necessitates a deeper understanding of learners in understudied contexts and their motivations to pursue an education. Consequently, we studied a 15-week remote course launched in 2021 with 17,896 learners that provided engineering education through a radio and phone-based system aimed for use in rural settings within Northern Uganda. We address shifts in learners’ motivations for course participation and investigate the impact of demographic features and motivations of students on persistence and performance. We found significant increases in student motivation to learn more about and pursue STEM. Importantly, the course was most successful for learners in demographics who typically experience fewer educational opportunities, showing promise for such technologies to close opportunity gaps. Christine Kwon, Darren Butler, Judith Uchidiuno, John C. Stamper, Amy Ogan |
CHI | 4 |
| 2024 | Singular Action, Complex Cognition: An Intelligent Tutoring System in Riichi Mahjong
Marshall An, Mufei He, John C. Stamper |
EC-TEL (2) | 4 |
| 2024 | Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in ClassroomsabstractSelf-reflection on learning experiences constitutes a fundamental cognitive process, essential for consolidating knowledge and enhancing learning efficacy. However, traditional methods to facilitate reflection often face challenges in personalization, immediacy of feedback, engagement, and scalability. Integration of Large Language Models (LLMs) into the reflection process could mitigate these limitations. In this paper, we conducted two randomized field experiments in undergraduate computer science courses to investigate the potential of LLMs to help students engage in post-lesson reflection. In the first experiment (N=145), students completed a take-home assignment with the support of an LLM assistant; half of these students were then provided access to an LLM designed to facilitate self-reflection. The results indicated that the students assigned to LLM-guided reflection reported somewhat increased self-confidence compared to peers in a no-reflection control and a non-significant trend towards higher scores on a later assessment. Thematic analysis of students' interactions with the LLM showed that the LLM often affirmed the student's understanding, expanded on the student's reflection, and prompted additional reflection; these behaviors suggest ways LLM-interaction might facilitate reflection. In the second experiment (N=112), we evaluated the impact of LLM-guided self-reflection against other scalable reflection methods, such as questionnaire-based activities and review of key lecture slides, after assignment. Our findings suggest that the students in the questionnaire and LLM-based reflection groups performed equally well and better than those who were only exposed to lecture slides, according to their scores on a proctored exam two weeks later on the same subject matter. These results underscore the utility of LLM-guided reflection and questionnaire-based activities in improving learning outcomes. Our work highlights that focusing solely on the accuracy of LLMs can overlook their potential to enhance metacognitive skills through practices such as self-reflection. We discuss the implications of our research for the learning-at-scale community, highlighting the potential of LLMs to enhance learning experiences through personalized, engaging, and scalable reflection practices. Ruiwei Xiao, Benjamin Lawson, Ilya Musabirov, Jiakai Shi, Huayin Luo, Joseph Jay Williams, Anna N. Rafferty, John C. Stamper, Michael Liut |
L@S | 10 |
| 2024 | Learnersourcing: Student-generated Content @ Scale: 2nd Annual Workshopabstractaendees to leave the workshop with a practical understanding of how to engage with learnersourcing.Participants will get hands-on experience with current tools, Steven Moore, Xinyi Lu 0004, Hyoungwook Jin, Hassan Khosravi, Paul Denny 0001, Christopher Brooks 0001, Xu Wang 0016, Juho Kim 0001, John C. Stamper |
L@S | 10 |
| 2024 | Automated Generation and Tagging of Knowledge Components from Multiple-Choice QuestionsabstractKnowledge Components (KCs) linked to assessments enhance the measurement of student learning, enrich analytics, and facilitate adaptivity. However, generating and linking KCs to assessment items requires significant effort and domain-specific knowledge. To streamline this process for higher-education courses, we employed GPT-4 to generate KCs for multiple-choice questions (MCQs) in Chemistry and E-Learning. We analyzed discrepancies between the KCs generated by the Large Language Model (LLM) and those made by humans through evaluation from three domain experts in each subject area. This evaluation aimed to determine whether, in instances of non-matching KCs, evaluators showed a preference for the LLM-generated KCs over their human-created counterparts. We also developed an ontology induction algorithm to cluster questions that assess similar KCs based on their content. Our most effective LLM strategy accurately matched KCs for 56% of Chemistry and 35% of E-Learning MCQs, with even higher success when considering the top five KC suggestions. Human evaluators favored LLM-generated KCs, choosing them over human-assigned ones approximately two-thirds of the time, a preference that was statistically significant across both domains. Our clustering algorithm successfully grouped questions by their underlying KCs without needing explicit labels or contextual information. This research advances the automation of KC generation and classification for assessment items, alleviating the need for student data or predefined KC labels. Steven Moore, Robin Schmucker, Tom M. Mitchell, John C. Stamper |
L@S | 4 |
| 2023 | Examining the Learning Benefits of Different Types of Prompted Self-explanation in a Decimal Learning Game
Huy Anh Nguyen, Xinying Hou, Hayden Stec, Sarah Di, John C. Stamper, Bruce M. McLaren |
AIED | 5 |
| 2023 | Assessing the Quality of Multiple-Choice Questions Using GPT-4 and Rule-Based Methods
Steven Moore, Huy Anh Nguyen, Tianying Chen 0001, John C. Stamper |
EC-TEL | 4 |
| 2023 | Focal: A Proposed Method of Leveraging LLMs for Automating AssessmentsabstractIn response to the growing need for frequent, high-quality assessments in the expanding field of online learning and the significant time burden their manual creation places on educators, this study proposes Focal, an end-to-end assessment generation pipeline. Focal employs large language models, notably Text-to-Text Transfer Transformers, fine-trained on diverse learning materials, to generate and evaluate pedagogically sound questions and their corresponding answers. The Focal pipeline is designed to integrate with Learning Management Systems, providing educators an automated means of creating assessments that align with their curriculum. This not only eases the task of creating and evaluating assessments but also frees educators to focus on other crucial responsibilities. The system is domain agnostic and its efficacy is continually improved by training and evaluating it using data from multiple subject areas. By automating the traditionally labor-intensive process of assessment production, Focal aims to increase efficiency in online education and enhance the learning experience for students. Peter Meyers, Annette Han, Razik Singh Grewal, Mitali Potnis, John C. Stamper |
ICCE | 5 |
| 2023 | Tracking Knowledge for Learning Japanese as a 2nd Language
Tomoko Okimoto, Matthew W. Johnson 0001, Huy Anh Nguyen, Steven Moore, Michael Eagle, John C. Stamper |
ICCE | 6 |
| 2023 | Crowdsourcing the Evaluation of Multiple-Choice Questions Using Item-Writing Flaws and Bloom's TaxonomyabstractMultiple-choice questions, which are widely used in educational assessments, have the potential to negatively impact student learning and skew analytics when they contain item-writing flaws. Existing methods for evaluating multiple-choice questions in educational contexts tend to focus primarily on machine readability metrics, such as grammar, syntax, and formatting, without considering the intended use of the questions within course materials and their pedagogical implications. In this study, we present the results of crowdsourcing the evaluation of multiple-choice questions based on 15 common item-writing flaws. Through analysis of 80 crowdsourced evaluations on questions from the domains of calculus and chemistry, we found that crowdworkers were able to accurately evaluate the questions, matching 75% of the expert evaluations across multiple questions. They were able to correctly distinguish between two levels of Bloom's Taxonomy for the calculus questions, but were less accurate for chemistry questions. We discuss how to scale this question evaluation process and the implications it has across other domains. This work demonstrates how crowdworkers can be leveraged in the quality evaluation of educational questions, regardless of prior experience or domain knowledge. Steven Moore, Ellen Fang, Huy Anh Nguyen, John C. Stamper |
L@S | 4 |
| 2022 | Reducing Bias in a Misinformation Classification Task with Value-Adaptive Instruction
Nicholas Diana, John C. Stamper |
AIED (1) | 2 |
| 2022 | Debiasing Politically Motivated Reasoning with Value-Adaptive Instruction
Nicholas Diana, John C. Stamper, Kenneth R. Koedinger, Jessica Hammer |
AIED (1) | 2 |
| 2022 | Assessing the Quality of Student-Generated Short Answer Questions Using GPT-3
Steven Moore, Huy Anh Nguyen, Norman L. Bier, Tanvi Domadia, John C. Stamper |
EC-TEL | 5 |
| 2022 | Towards Generalized Methods for Automatic Question Generation in Educational Domains
Huy Anh Nguyen, Shravya Bhat, Steven Moore, Norman L. Bier, John C. Stamper |
EC-TEL | 5 |
| 2022 | Towards Automated Generation and Evaluation of Questions in Educational Domains
Shravya Bhat, Huy Anh Nguyen, Steven Moore, John C. Stamper, Majd F. Sakr, Eric Nyberg |
EDM | 4 |
| 2022 | Learnersourcing: Student-generated Content @ ScaleabstractThe first annual workshop on Learnersourcing: Student-generated Content @ Scale is taking place at Learning @ Scale 2022. This hybrid workshop will expose attendees to the ample opportunities in the learnersourcing space, including instructors, researchers, learning engineers, and many other roles. We believe participants from a wide range of backgrounds and prior knowledge on learnersourcing can both benefit and contribute to this workshop, as learnersourcing draws on work from education, crowdsourcing, learning analytics, data mining, ML/NLP, and many more fields. Additionally, as the learnersourcing process involves many stakeholders (students, instructors, researchers, instructional designers, etc.), multiple viewpoints can help to inform what future student-generated content might be useful, new and better ways to assess the quality of the content and spark potential collaboration efforts between attendees. We ultimately want to show how everyone can make use of learnersourcing and have participants gain hands-on experience using existing tools, create their own learnersourcing activities using them or their own platforms, and take part in discussing the next challenges and opportunities in the learnersourcing space. Our hope is to attract attendees interested in scaling the generation of instructional and assessment content and those interested in the use of online learning platforms. Steven Moore, John C. Stamper, Christopher Brooks 0001, Paul Denny 0001, Hassan Khosravi |
L@S | 2 |
| 2021 | Exploring Metrics for the Analysis of Code Submissions in an Introductory Data Science CourseabstractWhile data science education has gained increased recognition in both academic institutions and industry, there has been a lack of research on automated coding assessment for novice students. Our work presents a first step in this direction, by leveraging the coding metrics from traditional software engineering (Halstead Volume and Cyclomatic Complexity) in combination with those that reflect a data science project’s learning objectives (number of library calls and number of common library calls with the solution code). Through these metrics, we examined the code submissions of 97 students across two semesters of an introductory data science course. Our results indicated that the metrics can identify cases where students had overly complicated codes and would benefit from scaffolding feedback. The number of library calls, in particular, was also a significant predictor of changes in submission score and submission runtime, which highlights the distinctive nature of data science programming. We conclude with suggestions for extending our analyses towards more actionable intervention strategies, for example by tracking the fine-grained submission grading outputs throughout a student’s submission history, to better model and support them in their data science learning process. Huy Anh Nguyen, Michelle Lim, Steven Moore, Eric Nyberg, Majd F. Sakr, John C. Stamper |
LAK | 6 |
| 2021 | Examining the Effects of Student Participation and Performance on the Quality of Learnersourcing Multiple-Choice QuestionsabstractWhile generating multiple-choice questions has been shown to promote deep learning, students often fail to realize this benefit and do not willingly participate in this activity. Additionally, the quality of the student-generated questions may be influenced by both their level of engagement and familiarity with the learning materials. Towards better understanding how students can generate high quality questions, we designed and deployed a multiple-choice question generation activity in seven college-level online chemistry courses. From these courses, we collected data on student interactions and their contribution to the question-generation task. A total of 201 students enrolled in the courses and 57 of them elected to generate a multiple-choice question. Our results indicated that students were able to contribute quality questions, with 67% of them being evaluated by experts as acceptable for use. We further identified several student behaviors in the online courses that are correlated to their participation in the task and the quality of their contribution. Our findings can help teachers and students better understand the benefits of student-generated questions and effectively implement future learnersourcing activities. Steven Moore, Huy Anh Nguyen, John C. Stamper |
L@S | 3 |
| 2020 | Evaluating Crowdsourcing and Topic Modeling in Generating Knowledge Components from Explanations
Steven Moore, Huy Anh Nguyen, John C. Stamper |
AIED (1) | 3 |
| 2020 | Improving Students' Problem-Solving Flexibility in Non-routine Mathematics
Huy Anh Nguyen, John C. Stamper, Bruce M. McLaren |
AIED (2) | 3 |
| 2020 | Towards Value-Adaptive Instruction: A Data-Driven Method for Addressing Bias in Argument Evaluation TasksabstractAs the media landscape is increasingly populated by less than reputable sources of information, educators have turned to argument evaluation training as a potential solution. Unfortunately, the bias literature suggests that our ability to objectively evaluate an argument is, to a large extent, determined by the relationship between our own beliefs and the beliefs latent in the argument we are evaluating. If the argument supports our worldview, we are much more likely to overlook logical errors. Teachers recognize this need to adapt argument evaluation instruction to the specific beliefs of students. For instance, a teacher might intentionally assign a student an argument that the student disagrees with. Unfortunately, this kind of value-adaptive instruction is infrequent due to its unscalability. We propose a novel method for data-driven value-adaptive instruction in instructional technologies. This method can be used to combat bias in real-world contexts and support human reasoning during media consumption. Nicholas Diana, John C. Stamper, Kenneth R. Koedinger |
CHI | 2 |
| 2020 | Moving beyond Test Scores: Analyzing the Effectiveness of a Digital Learning Game through Learning Analytics
Huy Anh Nguyen, Xinying Hou, John C. Stamper, Bruce M. McLaren |
EDM | 3 |
| 2020 | Utilizing Crowdsourcing and Topic Modeling to Generate Knowledge Components for Math and Writing Problems
Steven Moore, Huy Nugyen, John C. Stamper |
ICCE | 3 |
| 2020 | Towards Crowdsourcing the Identification of Knowledge ComponentsabstractAssigning a set of hypothesized knowledge components (KCs) to assessment items within an ed-tech system enables us to better estimate student learning. However, creating and assigning these KCs is a time-consuming process that often requires domain expertise. In this study, we present the results of crowdsourcing KCs for problems in the domain of mathematics and English writing, as a first step in leveraging the crowd to expedite this task. Crowdworkers were presented with a problem and asked to provide the underlying skills required to solve it. Additionally, we investigated the effect of priming crowdworkers with related content before having them generate these KCs. We then analyzed their contributions through qualitative coding and found that across both the math and writing domains roughly 33% of the crowdsourced KCs directly matched those generated by domain experts for the same problems. Steven Moore, Huy Anh Nguyen, John C. Stamper |
L@S | 3 |
| 2019 | Online Assessment of Belief Biases and Their Impact on the Acceptance of Fallacious Reasoning
Nicholas Diana, John C. Stamper, Kenneth R. Koedinger |
AIED (2) | 2 |
| 2019 | Exploring Teachable Humans and Teachable Agents: Human Strategies Versus Agent Policies and the Basis of Expertise
John C. Stamper, Steven Moore |
AIED (2) | 1 |
| 2019 | How Does Order of Gameplay Impact Learning and Enjoyment in a Digital Learning Game?
Yeyu Wang, Huy Anh Nguyen, Erik Harpstead, John C. Stamper, Bruce M. McLaren |
AIED (1) | 4 |
| 2019 | Predicting Bias in the Evaluation of Unlabeled Political Arguments
Nicholas Diana, John C. Stamper, Kenneth R. Koedinger |
CogSci | 2 |
| 2019 | Towards Modeling Students' Problem-solving Skills in Non-routine Mathematics Problems
Huy Anh Nguyen, John C. Stamper, Bruce M. McLaren |
EDM | 2 |
| 2019 | Using Knowledge Component Modeling to Increase Domain Understanding in a Digital Learning Game
Huy Anh Nguyen, Yeyu Wang, John C. Stamper, Bruce M. McLaren |
EDM | 3 |
| 2019 | Early Detection of Wheel Spinning: Comparison across Tutors, Models, Features, and Operationalizations
Chuankai Zhang, Yanzun Huang, Dongyang Lu, Weiqi Fang, John C. Stamper, Stephen Fancsali, Kenneth Holstein, Vincent Aleven |
EDM | 6 |
| 2019 | Decision Support for an Adversarial Game Environment Using Automatic Hint Generation
Steven Moore, John C. Stamper |
ITS | 2 |
| 2018 | An Instructional Factors Analysis of an Online Logical Fallacy Tutoring System
Nicholas Diana, John C. Stamper, Kenneth R. Koedinger |
AIED (1) | 2 |
| 2018 | Predictive Student Modeling for Interventions in Online Classes
Michael Eagle, Ted Carmichael, Jessica Stokes, Mary Jean Blink, John C. Stamper, Jason Levin |
EDM | 5 |
| 2018 | Predicting Individualized Learner Models Across Tutor Lessons
Michael Eagle, Albert T. Corbett, John C. Stamper, Bruce M. McLaren |
EDM | 3 |
| 2018 | Data-driven generation of rubric criteria from an educational programming environmentabstractWe demonstrate that, by using a small set of hand-graded student work, we can automatically generate rubric criteria with a high degree of validity, and that a predictive model incorporating these rubric criteria is more accurate than a previously reported model. We present this method as one approach to addressing the often challenging problem of grading assignments in programming environments. A classic solution is creating unit-tests that the student-generated program must pass, but the rigid, structured nature of unit-tests is suboptimal for assessing the more open-ended assignments students encounter in introductory programming environments like Alice. Furthermore, the creation of unit-tests requires predicting the various ways a student might correctly solve a problem - a challenging and time-intensive process. The current study proposes an alternative, semi-automated method for generating rubric criteria using low-level data from the Alice programming environment. Nicholas Diana, Michael Eagle, John C. Stamper, Shuchi Grover, Marie A. Bienkowski, Satabdi Basu |
LAK | 3 |
| 2017 | Data-Driven Generation of Rubric Parameters from an Educational Programming Environment
Nicholas Diana, Michael Eagle, John C. Stamper, Shuchi Grover, Marie A. Bienkowski, Satabdi Basu |
AIED | 3 |
| 2017 | Teaching Informal Logical Fallacy Identification with a Cognitive Tutor
Nicholas Diana, Michael Eagle, John C. Stamper, Kenneth R. Koedinger |
AIED | 3 |
| 2017 | Exploring Learner Model Differences Between Students
Michael Eagle, Albert T. Corbett, John C. Stamper, Bruce M. McLaren, Ryan Baker 0001, Angela Z. Wagner, Benjamin A. MacLaren, Aaron P. Mitchell |
AIED | 3 |
| 2017 | Automatic Peer Tutor Matching: Data-Driven Methods to Enable New Opportunities for Help
Nicholas Diana, Michael Eagle, John C. Stamper, Shuchi Grover, Marie A. Bienkowski, Satabdi Basu |
EDM | 3 |
| 2017 | Teaching Informal Logical Fallacy Identification with a Cognitive Tutor
Nicholas Diana, John C. Stamper, Kenneth R. Koedinger |
EDM | 2 |
| 2017 | Sharing and Reusing Data and Analytic Methods with LearnSphere
Ran Liu 0008, Kenneth R. Koedinger, John C. Stamper, Philip I. Pavlik Jr. |
EDM | 3 |
| 2017 | An instructor dashboard for real-time analytics in interactive programming assignmentsabstractMany introductory programming environments generate a large amount of log data, but making insights from these data accessible to instructors remains a challenge. This research demonstrates that student outcomes can be accurately predicted from student program states at various time points throughout the course, and integrates the resulting predictive models into an instructor dashboard. The effectiveness of the dashboard is evaluated by measuring how well the dashboard analytics correctly suggest that the instructor help students classified as most in need. Finally, we describe a method of matching low-performing students with high-performing peer tutors, and show that the inclusion of peer tutors not only increases the amount of help given, but the consistency of help availability as well. Nicholas Diana, Michael Eagle, John C. Stamper, Shuchi Grover, Marie A. Bienkowski, Satabdi Basu |
LAK | 3 |
| 2017 | A framework for hypothesis-driven approaches to support data-driven learning analytics in measuring computational thinking in block-based programmingabstractK-12 classrooms use block-based programming environments (BBPEs) for teaching computer science and computational thinking (CT). To support assessment of student learning in BBPEs, we propose a learning analytics framework that combines hypothesis- and data-driven approaches to discern students' programming strategies from BBPE log data. We use a principled approach to design assessment tasks to elicit evidence of specific CT skills. Piloting these tasks in high school classrooms enabled us to analyze student programs and video recordings of students as they built their programs. We discuss a priori patterns derived from this analysis to support data-driven analysis of log data in order to better assess understanding and use of CT in BBPEs. Shuchi Grover, Marie A. Bienkowski, Satabdi Basu, Michael Eagle, Nicholas Diana, John C. Stamper |
LAK | 6 |
| 2017 | Community based educational data repositories and analysis toolsabstractThis workshop will explore community based repositories for educational data and analytic tools that are used to connect researchers and reduce the barriers to data sharing. Leading innovators in the field, as well as attendees, will identify and report on bottlenecks that remain toward our goal of a unified repository. We will discuss these as well as possible solutions. We will present LearnSphere, an NSF funded system that supports collaborating on and sharing a wide variety of educational data, learning analytics methods, and visualizations while maintaining confidentiality. We will then have hands-on sessions in which attendees have the opportunity to apply existing learning analytics workflows to their choice of educational datasets in the repository (using a simple drag-and-drop interface), add their own learning analytics workflows (requires very basic coding experience), or both. Leaders and attendees will then jointly discuss the unique benefits as well as the limitations of these solutions. Our goal is to create building blocks to allow researchers to integrate their data and analysis methods with others, in order to advance the future of learning science. Kenneth R. Koedinger, Ran Liu 0008, John C. Stamper, Candace Thille, Philip I. Pavlik Jr. |
LAK | 3 |
| 2017 | Building the learning analytics curriculum: workshopabstractLearning Analytics courses and degree programs both on-and offline have begun to proliferate over the last three years. As a result of this growth in interest from students, university administrators, researchers and instructors we believe it is a good time to review how these educational efforts are impacting the field, how synergy between instructors might be developed to greater serve the field and what kinds of best practices could be developed. Charles Lang, Stephanie D. Teasley, John C. Stamper |
LAK | 3 |
| 2017 | A Framework for Using Hypothesis-Driven Approaches to Support Data-Driven Learning Analytics in Measuring Computational Thinking in Block-Based Programming EnvironmentsabstractSystematic endeavors to take computer science (CS) and computational thinking (CT) to scale in middle and high school classrooms are underway with curricula that emphasize the enactment of authentic CT skills, especially in the context of programming in block-based programming environments. There is, therefore, a growing need to measure students’ learning of CT in the context of programming and also support all learners through this process of learning computational problem solving. The goal of this research is to explore hypothesis-driven approaches that can be combined with data-driven ones to better interpret student actions and processes in log data captured from block-based programming environments with the goal of measuring and assessing students’ CT skills. Informed by past literature and based on our empirical work examining a dataset from the use of the Fairy Assessment in the Alice programming environment in middle schools, we present a framework that formalizes a process where a hypothesis-driven approach informed by Evidence-Centered Design effectively complements data-driven learning analytics in interpreting students’ programming process and assessing CT in block-based programming environments. We apply the framework to the design of Alice tasks for high school CS to be used for measuring CT during programming. Shuchi Grover, Satabdi Basu, Marie A. Bienkowski, Michael Eagle, Nicholas Diana, John C. Stamper |
ACM Trans. Comput. Educ. | 6 |
| 2016 | Extracting Measures of Active Learning and Student Self-Regulated Learning Strategies from MOOC Data
Nicholas Diana, Michael Eagle, John C. Stamper, Kenneth R. Koedinger |
EDM | 3 |
| 2016 | Beyond Log Files: Using Multi-Modal Data Streams Towards Data-Driven KC Model Improvement
Ran Liu 0008, Jodi L. Davenport, John C. Stamper |
EDM | 3 |
| 2016 | How quickly can wheel spinning be detected?
Noboru Matsuda, Sanjay Chandrasekaran, John C. Stamper |
EDM | 3 |
| 2016 | Estimating Individual Differences for Student Modeling in Intelligent Tutors from Reading and Pretest Data
Michael Eagle, Albert T. Corbett, John C. Stamper, Bruce M. McLaren, Angela Z. Wagner, Benjamin A. MacLaren, Aaron P. Mitchell |
ITS | 3 |
| 2016 | Predicting Individual Differences for Learner Modeling in Intelligent Tutors from Previous Learner ActivitiesabstractThis study examines how accurately individual student differences in learning can be predicted from prior student learning activities. Bayesian Knowledge Tracing (BKT) predicts learner performance well and has often been employed to implement cognitive mastery. Standard BKT individualizes parameter estimates for knowledge components, but not for learners. Studies have shown that individualizing parameters for learners improves the quality of BKT fits and can lead to very different (and potentially better) practice recommendations. These studies typically derive best-fitting individualized learner parameters from learner performance in existing data logs, making the methods difficult to deploy in actual tutor use. In this work, we examine how well BKT parameters in a tutor lesson can be individualized based on learners' prior performance in reading instructional text, taking a pretest, and completing an earlier tutor lesson. We find that best-fitting individual difference estimates do not directly transfer well from one tutor lesson to another, but that predictive models incorporating variables extracted from prior reading, pretest and tutor activities perform well, when compared to a standard BKT model and a model with best-fitting individualized parameter estimates. Michael Eagle, Albert T. Corbett, John C. Stamper, Bruce M. McLaren, Ryan Baker 0001, Angela Z. Wagner, Benjamin A. MacLaren, Aaron P. Mitchell |
UMAP | 3 |
| 2015 | The Future of Practical Applications of EDM at Scale
Ryan Baker 0001, John Carney, Piotr Mitros, Bror Saxberg, John C. Stamper |
EDM | 5 |
| 2015 | Ethics and Privacy in EDM
Dragan Gasevic, Taylor Martin, Zachary A. Pardos, Mykola Pechenizkiy, John C. Stamper, Osmar R. Zaïane |
EDM | 5 |
| 2014 | SCALE: Student Centered Adaptive Learning Engine
Mary Jean Blink, John C. Stamper, Ted Carmichael |
Intelligent Tutoring Systems | 2 |
| 2014 | A Multi-level Complex Adaptive System Approach for Modeling of Schools
Ted Carmichael, Mirsad Hadzikadic, Mary Jean Blink, John C. Stamper |
Intelligent Tutoring Systems | 4 |
| 2013 | Using Data-Driven Discovery of Better Student Models to Improve Student Learning
Kenneth R. Koedinger, John C. Stamper, Elizabeth A. McLaughlin, Tristan Nixon |
AIED | 2 |
| 2013 | Online Education: A Unique Opportunity for Cognitive Scientists to Integrate Research and Practice
Joseph Jay Williams, Alexander Renkl, Kenneth R. Koedinger, John C. Stamper |
CogSci | 4 |
| 2013 | An Algorithm for Reducing the Complexity of Interaction Networks
Matthew W. Johnson 0001, Michael Eagle, John C. Stamper, Tiffany Barnes |
EDM | 3 |
| 2013 | A Comparison of Model Selection Metrics in DataShop
John C. Stamper, Kenneth R. Koedinger, Elizabeth A. McLaughlin |
EDM | 1 |
| 2013 | Towards improving programming habits to create better computer science course outcomesabstractWe examine a large dataset collected by the Marmoset system in a CS2 course. The dataset gives us a richly detailed portrait of student behavior because it combines automatically collected program snapshots with unit tests that can evaluate the correctness of all snapshots. We find that students who start earlier tend to earn better scores, which is consistent with the findings of other researchers. We also detail the overall work habits exhibited by students. Finally, we evaluate how students use release tokens, a novel mechanism that provides feedback to students without giving away the code for the test cases used for grading, and gives students an incentive to start coding earlier. We find that students seem to use their tokens quite effectively to acquire feedback and improve their project score, though we do not find much evidence suggesting that students start coding particularly early. Jaime Spacco, Davide Fossati, John C. Stamper, Kelly Rivers |
ITiCSE | 3 |
| 2013 | CloudCoder: building a community for creating, assigning, evaluating and sharing programming exercises (abstract only)abstractAutomatically-tested online programming exercises can be useful in introductory programming courses as self-tests to accompany readings, for in-class assessment, for skills development, and to provide additional practice for students who need it. CloudCoder (http://cloudcoder.org) is an effort to build a community based on an open-source programming exercise system (currently supporting C, Java, and Python) tightly integrated with a repository of freely-redistributable programming exercises written and used by members of the community. The goal of the project is to make programming exercises easy and free to incorporate into any programming course. David Hovemeyer, Matthew Hertz, Paul Denny 0001, Jaime Spacco, Andrei Papancea, John C. Stamper, Kelly Rivers |
SIGCSE | 6 |
| 2012 | Automated Student Model Improvement
Kenneth R. Koedinger, Elizabeth A. McLaughlin, John C. Stamper |
EDM | 3 |
| 2012 | The Rise of the Super Experiment
John C. Stamper, Derek Lomas, Dixie Ching, Steven Ritter 0001, Kenneth R. Koedinger, Jonathan Steinhart |
EDM | 1 |
| 2012 | Program Representation for Automatic Hint Generation for a Data-Driven Novice Programming Tutor
Wei Jin 0007, Tiffany Barnes, John C. Stamper, Michael Eagle, Matthew W. Johnson 0001, Lorrie Lehmann |
ITS | 3 |
| 2012 | The Effects of Adaptive Sequencing Algorithms on Player Engagement within an Online Game
Derek Lomas, John C. Stamper, Ryan Muller, Kishan Patel, Kenneth R. Koedinger |
ITS | 2 |
| 2012 | Using Time Pressure to Promote Mathematical Fluency
Steven Ritter 0001, Tristan Nixon, Derek Lomas, John C. Stamper, Dixie Ching |
ITS | 4 |
| 2012 | Educational data mining meets learning analyticsabstractW This panel is proposed as a means of promoting mutual learning and continued dialogue between the Educational Data Mining and Learning Analytics communities. EDM has been developing as a community for longer than the LAK conference, so what if anything makes the LAK community different, and where is the common ground? Ryan Baker 0001, Simon Buckingham Shum, Erik Duval, John C. Stamper, David A. Wiley |
LAK | 4 |
| 2011 | Experimental Evaluation of Automatic Hint Generation for a Logic Tutor
John C. Stamper, Michael Eagle, Tiffany Barnes, Marvin J. Croy |
AIED | 1 |
| 2011 | Human-Machine Student Model Discovery and Improvement Using DataShop
John C. Stamper, Kenneth R. Koedinger |
AIED | 1 |
| 2011 | Managing the Educational Dataset Lifecycle with DataShop
John C. Stamper, Kenneth R. Koedinger, Ryan Baker 0001, Alida Skogsholm, Brett Leber, Sandy Demi, Shawnwen Yu, Duncan Spencer |
AIED | 1 |
| 2011 | DataShop: A Data Repository and Analysis Service for the Learning Science Community (Interactive Event)
John C. Stamper, Kenneth R. Koedinger, Ryan Baker 0001, Alida Skogsholm, Brett Leber, Sandy Demi, Shawnwen Yu, Duncan Spencer |
AIED | 1 |
| 2011 | Avoiding Problem Selection Thrashing with Conjunctive Knowledge Tracing
Kenneth R. Koedinger, Philip I. Pavlik Jr., John C. Stamper, Tristan Nixon, Steven Ritter 0001 |
EDM | 3 |
| 2011 | EDM and the 4th Paradigm of Scientific Discovery - Reflections on KDD Cup 2010
John C. Stamper |
EDM | 1 |
| 2010 | A Data Driven Approach to the Discovery of Better Cognitive Models
Kenneth R. Koedinger, John C. Stamper |
EDM | 2 |
| 2010 | Using a Bayesian Knowledge Base for Hint Selection on Domain Specific Problems
John C. Stamper, Tiffany Barnes, Marvin J. Croy |
EDM | 1 |
| 2010 | Enhancing the Automatic Generation of Hints with Expert Seeding
John C. Stamper, Tiffany Barnes, Marvin J. Croy |
Intelligent Tutoring Systems (2) | 1 |
| 2010 | PSLC DataShop: A Data Analysis Service for the Learning Science Community
John C. Stamper, Kenneth R. Koedinger, Ryan Baker 0001, Alida Skogsholm, Brett Leber, Jim Rankin, Sandy Demi |
Intelligent Tutoring Systems (2) | 1 |
| 2009 | Utility in hint generation: Selection of hints from a corpus of student workabstractWe have developed a tool for generating hints within computer-aided instructional tools based on a corpus of student work. This tool allows us to select source problem solutions that match the current user solution and generate hints based on next problem steps that are most likely to lead to a successful solution. However, within such a tool it is possible to generate hints that did not turn out to be useful in the source problem solution. Therefore, we have proposed a metric to measure and integrate a “utility” function to choose source material for hint generation. In this paper we present our metric and an experiment to investigate its use on real data from a logic proof tutorial. John C. Stamper, Tiffany Barnes |
AIED | 1 |
| 2009 | An unsupervised, frequency-based metric for selecting hints in an MDP-based tutor
John C. Stamper, Tiffany Barnes |
EDM | 1 |
| 2008 | The Validity of Providing Automated Hints in an ITS Using a MDP
John C. Stamper, Tiffany Barnes |
AAAI | 1 |
| 2008 | A pilot study on logic proof tutoring using hints generated from historical student data
Tiffany Barnes, John C. Stamper, Lorrie Lehmann, Marvin J. Croy |
EDM | 2 |
| 2008 | Toward Automatic Hint Generation for Logic Proof Tutoring Using Historical Student Data
Tiffany Barnes, John C. Stamper |
Intelligent Tutoring Systems | 2 |
| 2007 | Extracting Student Models for Intelligent Tutoring Systems
John C. Stamper, Tiffany Barnes, Marvin J. Croy |
AAAI | 1 |
| 2007 | Automating the Generation of Student Models for Intelligent Tutoring Systems
John C. Stamper |
AIED | 1 |
| 2005 | Predictive protocol management with contingency planning for wireless sensor networksabstractWireless sensor networks (WSN) are a subset of wireless networking applications focused on enabling sensor and actuator connectivity without the use of wires. Energy consumption among the wireless devices participating in these networks is a major constraint on the deployment for a broad range of applications enabled by WSNs. This paper introduces, for the first time, a novel methodology based on predictive protocol management with contingency planning (PPM and CP). This approach allows efficient update of the WSN operational mode in order to optimize the energy utilization based on the time varying characteristics of the radio-frequency (RF) in which the network operates. Ivan Howitt, John C. Stamper, Anita Raja, Verghese Mappillai |
MASS | 2 |