Stephen Garrett

dblp:24/10942 · DBLP profile ↗
← Back
4ranked-venue papers
0as first author
4since 2021 · last 2026
0000-0003-3078-6764ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 4 · 4 since 2021
YearPublicationVenuePosition
2026 Human-AI Interaction for Accessible CS Learning: Co-Designing AI with Blind and Visually Impaired Learners
abstract
Generative AI is increasingly used in learning environments, but most systems focus on generating responses rather than supporting interaction. This limitation is especially important for blind and visually impaired (BVI) learners, who rely on non-visual ways to navigate and understand programming tasks. We present findings from a co-design study with BVI high school students exploring expectations for AI assistants in expressive computer science learning. Participants described how AI could support accessible interaction, guide learning, and empower learner agency. We derive two design principles for inclusive AI assistants: (1) situated multimodal interaction and (2) scaffolded iterative interaction. These principles shift the focus from adapting outputs (e.g., audio) to designing interactions that support how learners navigate and engage in the CS learning context. Our work highlights the importance of interaction design in accessible AI and the value of involving BVI learners in the design of AI-powered educational technologies.
Shi Ding, Jason Smith 0005, Kevin Gautier, Stephen Garrett, Brian Magerko, Jason Freeman 0001, Bryan Pardo, Stephanie Ludi, Taneisha Lee, Tom McKlin
IDC4
2025 Using Co-Design to Investigate Affordances of an Expressive CS Learning Environment for Students who are BVI
abstract
Expressive computer science (CS) learning environments teach coding through the creation of an artifact, such as audio or video output.EarSketch is an expressive CS learning environment designed to teach computing through music production, mixing and arranging sounds using code.In this paper, we explore the accessibility challenges of using EarSketch for learners who are Blind and Visually Impaired (BVI).We present key findings from co-design studies with teachers and students at an institution specializing in BVI education, focused on gathering both groups' unique perspectives about EarSketch's ability to support teachers' curricula, students' workflows using the system with accessibility software, and challenges faced by users who are BVI.
Jason Smith 0005, Annie Chu, Noel Alben, Shi Ding, Kevin Gautier, Stephen Garrett, Brian Magerko, Jason Freeman 0001, Bryan Pardo, Stephanie Ludi, Taneisha Lee, Tom McKlin
ASSETS6
2024 Redesigning EarSketch for Inclusive CS Education: A Participatory Design Approach
abstract
This study conducts a novel approach to redesign EarSketch, an expressive computer science (CS) learning environment that integrates music composition into computing education, with a specific focus on inclusivity for blind and visually impaired (BVI) learners. This approach centers on the participation of teachers, students, and the community as co-designers, leveraging their insights and experiences to enhance the program’s accessibility and effectiveness. By actively involving the stakeholders in the development process, the study aims to address the unique educational challenges and needs of learners who are visually impaired more effectively. The participatory design approach is expected to not only maintain the intrinsic appeal of EarSketch but also to expand its accessibility, ensuring that it becomes a more inclusive tool in computer science education. The ultimate goal is to establish a more adaptable and inclusive educational paradigm within STEAM, particularly in computing education and music, that is responsive to the diverse needs of all students, including those with visual impairments. The contributions of this paper are design recommendations based on our data that can be applied to the design of EarSketch and other expressive CS environments for BVI learners.
Shi Ding, Jason Smith 0005, Stephen Garrett, Brian Magerko
IDC3
2024 Developing Computational Thinking in Middle School Music Technology Classrooms
abstract
To engage diverse populations of students who may not self-select into computing courses, a curriculum for a middle school music technology + computer science course that addresses learning standards for both subjects was developed and deployed. Students who engage with the curriculum learn modern music production techniques and computational thinking concepts. This is through a mix of traditional approaches to music technology education (digital audio workstations) and computational approaches via a culturally relevant learning platform that introduces students to coding through music production and remixing. This poster reflects on the last two years of curriculum design and deployment, teacher training, and student and educator engagement and feedback to provide insight into the teaching (and learning) of computational thinking in the music technology classroom.
Lauren McCall, Brittney Allen, Jason Freeman 0001, Stephen Garrett, Sabrina Grossman, Jed Paz, Doug Edwards, Tom McKlin, Taneisha Lee
SIGCSE (2)4