Samantha Boatright Smith

dblp:397/6063 · DBLP profile ↗
← Back
6ranked-venue papers
2as first author
6since 2021 · last 2026
0009-0004-8182-2424ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 6 · 2 first-author · 6 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021
YearPublicationVenuePosition
2026 The Missing Evaluation Axis: What 10,000 Student Submissions Reveal About AI Tutor Effectiveness
Rose Niousha, Samantha Boatright Smith, Bita Akram, Peter Brusilovsky, Arto Hellas, Juho Leinonen 0001, John DeNero, Narges Norouzi
AIED2
2026 Instructors' Perspectives on LLM-Generated Programming Formative Feedback
abstract
We study instructor perspectives on LLM-generated programming feedback in an introductory Python course. LLM tutors predominantly offered debugging help, while human instructors preferred more diverse feedback types, including conceptual reminders, revisiting the problem, and examples. Cases where LLM tutor feedback diverged from human instructors' intent required major edits with different feedback types, while cases with closer alignment needed only minor changes with similar feedback types. Findings highlight the need for LLM tutors to reflect on instructor intent to ensure pedagogically aligned feedback.
Rose Niousha, Samantha Boatright Smith, Abigail O'Neill, J. D. Zamfirescu-Pereira, John DeNero, Narges Norouzi
SIGCSE (2)2
2026 Misconception-Aware LLM Programming Tutor: Lessons Learned from Student-Tutor Interactions
abstract
Large Language Models (LLMs) are increasingly used as programming tutors, but their feedback is often generic and prone to solution leakage. To address these issues, we present MisconceptionTutor, which grounds feedback in common student misconceptions. Through both pre-deployment analyses and a real-classroom deployment, we find that even simple prompting frameworks can meaningfully steer tutor behavior to be more pedagogically oriented and noticeably more satisfying to students.
Rose Niousha, Samantha Boatright Smith, Abigail O'Neill, J. D. Zamfirescu-Pereira, John DeNero, Narges Norouzi
SIGCSE (2)2
2026 Knowledge Component-Driven Alignment of CS1 Textbooks and Exercises
abstract
We present a reproducible pipeline that aligns CS1 textbook sections with problems from a public dataset via a Knowledge Component (KC) -a single conceptual skill required for problem solving- ontology. It assigns KCs to sections and problems, respects the prerequisite order to avoid inserting problems too early, and generates tips for not-yet-taught concepts. We evaluate three KC assignment strategies: embedding-only, embedding with a Large Language Model (LLM) tie-breaker, and direct LLM assignment. We find direct assignment matches or exceeds human annotators. Our results show that constrained LLMs can enrich CS1 textbooks with curriculum-aware practice problems.
Samantha Boatright Smith, Arun Balajiee Lekshmi Narayanan, Anurata Prabha Hridi, Rafaella Sampaio de Alencar, Bita Akram, Arto Hellas, Juho Leinonen 0001, Peter Brusilovsky, Narges Norouzi
SIGCSE (2)1
2025 From Code to Concepts: Textbook-Driven Knowledge Tracing with LLMs in CS1
abstract
Gauging a student's understanding of course concepts, at an arbitrary point during a course, can be challenging. Standardized exams offer only a snapshot of performance rather than a deep understanding of progress. However, with Large Language Models (LLMs) now deployed at scale in CS1 courses, we can track multiple attempts from each student for every homework problem. This data provides insights into how students learn and deploy concepts over time, presenting a unique opportunity to rethink how we track changes in individual student knowledge. Traditional Knowledge Tracing (KT) methods often lack explainability and are computationally expensive. In contrast, our framework leverages an LLM to identify student progress on labeled, problem-level concepts from a student homework code submission. Our initial results show that the student's knowledge state can be dynamically updated. This knowledge state can then be used to provide more targeted, effective feedback and create tailored study materials.
Abigail O'Neill, Samantha Boatright Smith, Aneesh Durai, John DeNero, J. D. Zamfirescu-Pereira, Narges Norouzi
SIGCSE (2)2
2025 Spotting AI Missteps: Students Take on LLM Errors in CS1
Samantha Boatright Smith, Heather Wei, Abigail O'Neill, Aneesh Durai, John DeNero, J. D. Zamfirescu-Pereira, Narges Norouzi
SIGCSE (2)1