Victor Nikhil Antony

dblp:341/9295 · DBLP profile ↗
← Back
10ranked-venue papers
8as first author
10since 2021 · last 2026
0000-0003-4722-2041ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 9 · 7 first-author · 9 since 2021Artificial intelligence and machine learning · 8 · 7 first-author · 8 since 2021
YearPublicationVenuePosition
2026 ELLA: Generative AI-Powered Social Robots for Early Language Development at Home
abstract
Early language development shapes children’s later literacy and learning, yet many families have limited access to scalable, high-quality support at home. Recent advances in generative AI make it possible for social robots to move beyond scripted interactions and engage children in adaptive, conversational activities, but it remains unclear how to design such systems for pre-schoolers and how children engage with them over time in the home. We present ELLA (Early Language Learning Agent), an autonomous, LLM-powered social robot that supports early language development through interactive storytelling, parent-selected language targets, and scaffolded dialogue. Using a multi-phased, human-centered process, we interviewed parents (n=7) and educators (n=5) and iteratively refined ELLA through twelve in-home design workshops. We then deployed ELLA with ten children for eight days. We report design insights from in-home workshops, characterize children’s engagement and behaviors during deployment, and distill design implications for generative AI–powered social robots supporting early language learning at home.
Victor Nikhil Antony, Shiye Cao, Shuning Wang, Chien-Ming Huang 0001
IDC1
2026 Lantern: A Minimalist Robotic Object Platform
abstract
Robotic objects are simple actuated systems that subtly blend into human environments. We design and introduce Lantern, a minimalist robotic object platform to enable building simple robotic artifacts. We conducted in-depth design and engineering iterations of Lantern’s mechatronic architecture to meet specific design goals while maintaining a low build cost (~40 USD). As an extendable, open-source platform, Lantern aims to enable exploration of a range of HRI scenarios by leveraging human tendency to assign social meaning to simple forms. To evaluate Lantern’s potential for HRI, we conducted a series of explorations: 1) a co-design workshop, 2) a sensory room case study, 3) distribution to external HRI labs, 4) integration into a graduate-level HRI course, and 5) public exhibitions with older adults and children. Our findings show that Lantern effectively evokes engagement, can support versatile applications ranging from emotion regulation to focused work, and serves as a viable platform for lowering barriers to HRI as a field.
Victor Nikhil Antony, Zhili Gong 0002, Clara Jeon, Chien-Ming Huang 0001
HRI1
2026 Plant-Inspired Robot Design Metaphors for Ambient HRI
abstract
Plants offer a paradoxical model for interaction: they are ambient, low-demand presences that nonetheless shape atmosphere, routines, and relationships through temporal rhythms and subtle expressions. In contrast, most human–robot interaction (HRI) has been grounded in anthropomorphic and zoomorphic paradigms, producing overt, high-demand forms of engagement. Using a Research through Design (RtD) methodology, we explore plants as metaphoric inspiration for HRI; we conducted iterative cycles of ideation, prototyping, and reflection to investigate what design primitives emerge from plant metaphors and morphologies, and how these primitives can be combined into expressive robotic forms. We present a suite of speculative, open-source prototypes that help probe plant-inspired presence, temporality, form, and gestures. We deepened our learnings from design and prototyping through prototype-centered workshops that explored people’s perceptions and imaginaries of plant-inspired robots. This work contributes: (1) Set of plant-inspired robotic artifacts; (2) Designerly insights on how people perceive plant-inspired robots; and (3) Design consideration to inform how to use plant metaphors to reshape HRI.
Victor Nikhil Antony, Adithya R. N, Sarah Derrick, Zhili Gong 0002, Peter M. Donley, Chien-Ming Huang 0001
HRI1
2025 Voice Assistants for Health Self-Management: Designing for and with Older Adults
Amama Mahmood, Shiye Cao, Maia Stiber, Victor Nikhil Antony, Chien-Ming Huang 0001
CHI4
2025 Minimal Robotic Objects for Well-Being
abstract
Minimal robotic objects have potential for fostering healthy habits through situated and accessible human-robot interactions. I hypothesize that minimal robots can integrate more seamlessly into daily routines and support well-being habits by leveraging the benefits of embodiment without compromising accessibility. Three simple robots, Poppy, Calico, and Lantern, serve as the foundation for my exploration into how simple robotic objects can reinforce positive daily habits (i.e., exercise, walking and meditation). Through iterative design, system engineering efforts, field deployments, and user feedback, I aim to develop effective and accessible robotic objects for enhancing long-term engagement and adherence to well-being routines.
Victor Nikhil Antony
HRI1
2025 The Design of On-Body Robots for Older Adults
abstract
Wearable technology has significantly improved the quality of life for older adults, and the emergence of on-body, movable robots presents new opportunities to further enhance well-being. Yet, the interaction design for these robots remains under-explored, particularly from the perspective of older adults. We present findings from a two-phase co-design process involving 13 older adults to uncover design principles for on-body robots for this population. We identify a rich spectrum of potential applications and characterize a design space to inform how on-body robots should be built for older adults. Our findings highlight the importance of considering factors like co-presence, embodiment, and multi-modal communication. Our work offers design insights to facilitate the integration of on-body robots into daily life and underscores the value of involving older adults in the co-design process to promote usability and acceptance of emerging wearable robotic technologies.
Victor Nikhil Antony, Clara Jeon, Ge Gao 0001, Huaishu Peng, Anastasia K. Ostrowski, Chien-Ming Huang 0001
HRI1
2025 Xpress: A System for Dynamic, Context-Aware Robot Facial Expressions Using Language Models
abstract
Facial expressions are vital in human communication and significantly influence outcomes in human-robot interaction (HRI), such as likeability, trust, and companionship. However, current methods for generating robotic facial expressions are often labor-intensive, lack adaptability across contexts and platforms, and have limited expressive ranges-leading to repetitive behaviors that reduce interaction quality, particularly in long-term scenarios. We introduce Xpress, a system that leverages language models (LMs) to dynamically generate context-aware facial expressions for robots through a three-phase process: encoding temporal flow, conditioning expressions on context, and generating facial expression code. We demonstrated Xpress as a proof-of-concept through two user studies$(n=15\times 2)$and a case study with children and parents$(n=13)$, in storytelling and conversational scenarios to assess the system's context-awareness, expressiveness, and dynamism. Results demonstrate Xpress's ability to dynamically produce expressive and contextually appropriate facial expressions, highlighting its versatility and potential in HRI applications.
Victor Nikhil Antony, Maia Stiber, Chien-Ming Huang 0001
HRI1
2024 Alchemist: LLM-Aided End-User Development of Robot Applications
abstract
Large Language Models (LLMs) have the potential to catalyze a paradigm shift in end-user robot programming---moving from the conventional process of user specifying programming logic to an iterative, collaborative process in which the user specifies desired program outcomes while LLM produces detailed specifications. We introduce a novel integrated development system, Alchemist, that leverages LLMs to empower end-users in creating, testing, and running robot programs using natural language inputs, aiming to reduce the required knowledge for developing robot applications. We present a detailed examination of our system design and provide an exploratory study involving true end-users to assess capabilities, usability, and limitations of our system. Through the design, development, and evaluation of our system, we derive a set of lessons learned from the use of LLMs in robot programming. We discuss how LLMs may be the next frontier for democratizing end-user development of robot applications.
Ulas Berk Karli, Juo-Tung Chen, Victor Nikhil Antony, Chien-Ming Huang 0001
HRI3
2024 ID.8: Co-Creating Visual Stories with Generative AI
abstract
Storytelling is an integral part of human culture and significantly impacts cognitive and socio-emotional development and connection. Despite the importance of interactive visual storytelling, the process of creating such content requires specialized skills and is labor-intensive. This article introduces ID.8, an open-source system designed for the co-creation of visual stories with generative AI. We focus on enabling an inclusive storytelling experience by simplifying the content creation process and allowing for customization. Our user evaluation confirms a generally positive user experience in domains such as enjoyment and exploration while highlighting areas for improvement, particularly in immersiveness, alignment, and partnership between the user and the AI system. Overall, our findings indicate promising possibilities for empowering people to create visual stories with generative AI. This work contributes a novel content authoring system, ID.8, and insights into the challenges and potential of using generative AI for multimedia content creation.
Victor Nikhil Antony, Chien-Ming Huang 0001
ACM Trans. Interact. Intell. Syst.1
2023 Co-Designing with Older Adults, for Older Adults: Robots to Promote Physical Activity
abstract
Lack of physical activity has severe negative health consequences for older adults and limits their ability to live independently. Robots have been proposed to help engage older adults in physical activity (PA), albeit with limited success. There is a lack of robust understanding of older adults' needs and wants from robots designed to engage them in PA. In this paper, we report on the findings of a co-design process where older adults, physical therapy experts, and engineers designed robots to promote PA in older adults. We found a variety of motivators for and barriers against PA in older adults; we, then, conceptualized a broad spectrum of possible robotic support and found that robots can play various roles to help older adults engage in PA. This exploratory study elucidated several overarching themes and emphasized the need for personalization and adaptability. This work highlights key design features that researchers and engineers should consider when developing robots to engage older adults in PA, and underscores the importance of involving various stakeholders in the design and development of assistive robots.
Victor Nikhil Antony, Sue Min Cho, Chien-Ming Huang 0001
HRI1