Oghenemaro Anuyah

dblp:205/5318 · DBLP profile ↗
← Back
12ranked-venue papers
3as first author
8since 2021 · last 2026
0000-0002-5773-8239ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 9 · 3 first-author · 6 since 2021Artificial intelligence and machine learning · 2 · 1 since 2021Software engineering, systems software and programming languages · 1 · 1 since 2021Databases, data management, data science and information retrieval · 1Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
YearPublicationVenuePosition
2026 Exploring Cross-Cultural Perspectives on AI Education: Insights from Teachers in Nigeria and the USA
abstract
With artificial intelligence (AI) becoming more present in ed- ucation globally, it is essential to consider how cultural con- texts shape teachers’ perspectives, an understanding that sup- ports more inclusive and sustainable learning systems. This study draws on the African philosophy of Ubuntu to frame our cross-cultural investigation of how children conceptu- alize AI through the lens of their teachers. We conducted semi-structured interviews with twelve middle school teach- ers in Nigeria and the United States, asking them to interpret AI-themed essays written by students. These teacher reflec- tions revealed differing educational priorities, cultural val- ues, and infrastructural realities: U.S. educators’ interpreta- tions centered on personal development and future careers, while Nigerian teachers highlighted students’ focus on fam- ily, community well-being, and practical societal challenges. Nigerian participants also pointed to the need for improved infrastructure (e.g., electricity, internet), broader AI literacy, and education policies that reflect local needs. Our findings il- lustrate how culturally grounded worldviews, such as Ubuntu, shape interpretations of AI and its role in society, and sug- gest that AI education is never culturally neutral. We argue that AI literacy initiatives must be designed not only to teach technical skills but also to support educational sustainability, defined here as inclusive, resilient, and culturally responsive learning systems capable of evolving within diverse contexts. We offer actionable recommendations for the HCI commu- nity to co-design AI education tools that foreground collec- tive well-being, foster global digital citizenship, and reduce epistemic exclusion in the development of future technolo- gies.
Cornelius Adejoro, Oghenemaro Anuyah, Karla A. Badillo-Urquiola, Tom Yeh
AAAI2
2026 Designing Staged Evaluation Workflows for LLMs: Integrating Domain Experts, Lay Users, and Model-Generated Evaluation Criteria
abstract
Large Language Models (LLMs) are increasingly utilized for domain-specific tasks, yet evaluating their outputs remains challenging. A common strategy is to apply evaluation criteria to assess alignment with domain-specific standards, yet little is understood about how criteria differ across sources or where each type is most useful in the evaluation process. This study investigates criteria developed by domain experts, lay users, and LLMs to identify their complementary roles within an evaluation workflow. Results show that experts produce fact-based criteria with long-term value, lay users emphasize usability with a shorter-term focus, and LLMs target procedural checks for immediate task requirements. We also examine how criteria evolve between a priori and a posteriori phases, noting drift across stages as well as convergence in the a posteriori phase. Based on our observations, we propose design guidelines for a staged evaluation workflow combining the complementary strengths of these sources to balance quality, cost, and scalability.
Annalisa Szymanski, Simret Araya Gebreegziabher, Oghenemaro Anuyah, Ronald A. Metoyer, Toby Jia-Jun Li
CHI3
2026 Key Considerations for Domain Expert Involvement in LLM Design and Evaluation: An Ethnographic Study
abstract
Large Language Models (LLMs) are increasingly developed for use in complex professional domains, yet little is known about how teams design and evaluate these systems in practice. This paper examines the challenges and trade-offs in LLM development through a 12-week ethnographic study of a team building a pedagogical chatbot. The researcher observed design and evaluation activities and conducted interviews with both developers and domain experts. Analysis revealed four key practices: creating workarounds for data collection, turning to augmentation when expert input was limited, co-developing evaluation criteria with experts, and adopting hybrid expert–developer–LLM evaluation strategies. These practices show how teams made strategic decisions under constraints and demonstrate the central role of domain expertise in shaping the system. Challenges included expert motivation and trust, difficulties structuring participatory design, and questions around ownership and integration of expert knowledge. We propose design opportunities for future LLM development workflows that emphasize AI literacy, transparent consent, and frameworks recognizing evolving expert roles.
Annalisa Szymanski, Oghenemaro Anuyah, Toby Jia-Jun Li, Ronald A. Metoyer
IUI2
2025 'We aren't very sophisticated': An Ethnographic Study of Knowledge Management in Community Social Services
abstract
Navigating the complexities of knowledge management (KM) and Knowledge Transfer (KT) in community social services is a challenging task, as workers must handle a fast-paced, resource-constrained environment while supporting the urgent and multifaceted needs of vulnerable populations. Despite research into the use of technology in non-profit and community settings, little attention has been given to how community service workers (CSWs) capture, share, and manage knowledge in practice. This study addresses this gap by conducting a three-month ethnographic study of two community organizations in South Bend, Indiana, complemented by semi-structured interviews, revealing the informal, ad-hoc KM methods CSWs use to manage information flows. Using a human-socio-technical KM framework, we compare these practices with the more structured KM systems found in large corporations, identifying key differences in formality and technological integration. Our findings highlight the need for accessible, sustainable KM solutions that fit the informal knowledge-sharing practices of CSWs while enhancing knowledge retention, knowledge transfer, and collaboration. This work contributes to HCI and CSCW by providing design considerations for developing technology that better supports KM in community social services.
Oghenemaro Anuyah, Karla A. Badillo-Urquiola, Ronald A. Metoyer
Proc. ACM Hum. Comput. Interact.1
2025 Online Safety for All: Sociocultural Insights from a Systematic Review of Youth Online Safety in the Global South
abstract
Youth online safety research in HCI has historically centered on perspectives from the Global North, often overlooking the unique particularities and cultural contexts of regions in the Global South. This paper presents a systematic review of 66 youth online safety studies published between 2014 and 2024, specifically focusing on regions in the Global South. Our findings reveal a concentrated research focus in Asian countries and predominance of quantitative methods. We also found limited research on marginalized youth populations and a primary focus on risks related to cyberbullying. Our analysis underscores the critical role of cultural factors in shaping online safety, highlighting the need for educational approaches that integrate social dynamics and awareness. We propose methodological recommendations and a future research agenda that encourages the adoption of situated, culturally sensitive methodologies and youth-centered approaches to researching youth online safety regions in the Global South. This paper advocates for greater inclusivity in youth online safety research, emphasizing the importance of addressing varied sociocultural contexts to better understand and meet the online safety needs of youth in the Global South.
Ozioma Collins Oguine, Oghenemaro Anuyah, Zainab Agha, Iris Melgarez, Adriana Alvarado Garcia, Karla A. Badillo-Urquiola
Proc. ACM Hum. Comput. Interact.2
2024 Integrating Expertise in LLMs: Crafting a Customized Nutrition Assistant with Refined Template Instructions
abstract
Large Language Models (LLMs) have the potential to contribute to the fields of nutrition and dietetics in generating food product explanations that facilitate informed food selections. However, the extent to which these models offer effective and accurate information remains unverified. In collaboration with registered dietitians (RDs), we evaluate the strengths and weaknesses of LLMs in providing accurate and personalized nutrition information. Through a mixed-methods approach, RDs validated GPT-4 outputs at various levels of prompt specificity, which led to the development of design guidelines used to prompt LLMs for nutrition information. We tested these guidelines by creating a GPT prototype, The Food Product Nutrition Assistant, tailored for food product explanations. This prototype was refined and evaluated in focus groups with RDs. We find that the implementation of these dietitian-reviewed template instructions enhance the generation of detailed food product descriptions and tailored nutrition information.
Annalisa Szymanski, Brianna L. Wimer, Oghenemaro Anuyah, Heather A. Eicher-Miller, Ronald A. Metoyer
CHI3
2023 Characterizing the Technology Needs of Vulnerable Populations for Participation in Research and Design by Adopting Maslow's Hierarchy of Needs
abstract
While various frameworks and heuristics exist within the HCI community to guide research and design for vulnerable populations, most are centered on the researcher’s involvement. In this work, we developed a conceptual framework for supporting the participation of vulnerable populations in the research and design of technologies. Building upon Maslow’s hierarchy of needs, we synthesized 84 research articles that focus on vulnerable populations and technology to develop our framework. This framework conceptualizes both the barriers, such as lack of technology access and digital literacy, and assets, like social relationships, that impact effective participation in research and design. Using our framework can guide researchers in identifying and fulfilling the technology-related needs of vulnerable populations, leading to more empowering research participation for these groups. The framework’s guiding questions offer researchers the opportunity to reflect on their approach prior to and during their collaboration with vulnerable populations in technology research and design.
Oghenemaro Anuyah, Karla A. Badillo-Urquiola, Ronald A. Metoyer
CHI1
2022 Generating and Visualizing Trace Link Explanations
abstract
Recent breakthroughs in deep-learning (DL) approaches have resulted in the dynamic generation of trace links that are far more accurate than was previously possible. However, DL-generated links lack clear explanations, and therefore non-experts in the domain can find it difficult to understand the underlying semantics of the link, making it hard for them to evaluate the link's correctness or suitability for a specific software engineering task. In this paper we present a novel NLP pipeline for generating and visualizing trace link explanations. Our approach identifies domain-specific concepts, retrieves a corpus of concept-related sentences, mines concept definitions and usage examples, and identifies relations between cross-artifact concepts in order to explain the links. It applies a post-processing step to prioritize the most likely acronyms and definitions and to eliminate non-relevant ones. We evaluate our approach using project artifacts from three different domains of interstellar telescopes, positive train control, and electronic healthcare systems, and then report coverage, correctness, and potential utility of the generated definitions. We design and utilize an explanation interface which leverages concept definitions and relations to visualize and explain trace link rationales, and we report results from a user study that was conducted to evaluate the effectiveness of the explanation interface. Results show that the explanations presented in the interface helped non-experts to understand the underlying semantics of a trace link and improved their ability to vet the correctness of the link.
Yalin Liu, Jinfeng Lin, Oghenemaro Anuyah, Ronald A. Metoyer, Jane Cleland-Huang
ICSE3
2020 KidSpell: A Child-Oriented, Rule-Based, Phonetic Spellchecker
abstract
For help with their spelling errors, children often turn to spellcheckers integrated in software applications like word processors and search engines. However, existing spellcheckers are usually tuned to the needs of traditional users (i.e., adults) and generally prove unsatisfactory for children. Motivated by this issue, we introduce KidSpell, an English spellchecker oriented to the spelling needs of children. KidSpell applies (i) an encoding strategy for mapping both misspelled words and spelling suggestions to their phonetic keys and (ii) a selection process that prioritizes candidate spelling suggestions that closely align with the misspelled word based on their respective keys. To assess the effectiveness of, we compare the model’s performance against several popular, mainstream spellcheckers in a number of offline experiments using existing and novel datasets. The results of these experiments show that KidSpell outperforms existing spellcheckers, as it accurately prioritizes relevant spelling corrections when handling misspellings generated by children in both essay writing and online search tasks. As a byproduct of our study, we create two new datasets comprised of spelling errors generated by children from hand-written essays and web search inquiries, which we make available to the research community.
Brody Downs, Oghenemaro Anuyah, Aprajita Shukla, Jerry Alan Fails, Maria Soledad Pera, Katherine Landau Wright, Casey Kennington
LREC2
2019 Query Formulation Assistance for Kids: What is Available, When to Help & What Kids Want
abstract
Children use popular web search tools, which are generally designed for adult users. Because children have different developmental needs than adults, these tools may not always adequately support their search for information. Moreover, even though search tools offer support to help in query formulation, these too are aimed at adults and may hinder children rather than help them. This calls for the examination of existing technologies in this area, to better understand what remains to be done when it comes to facilitating query-formulation tasks for young users. In this paper, we investigate interaction elements of query formulation--including query suggestion algorithms--for children. The primary goals of our research efforts are to: (i) examine existing plug-ins and interfaces that explicitly aid children's query formulation; (ii) investigate children's interactions with suggestions offered by a general-purpose query suggestion strategy vs. a counterpart designed with children in mind; and (iii) identify, via participatory design sessions, their preferences when it comes to tools / strategies that can help children find information and guide them through the query formulation process. Our analysis shows that existing tools do not meet children's needs and expectations; the outcomes of our work can guide researchers and developers as they implement query formulation strategies for children.
Jerry Alan Fails, Maria Soledad Pera, Oghenemaro Anuyah, Casey Kennington, Katherine Landau Wright, William Bigirimana
IDC3
2018 Investigating query formulation assistance for children
abstract
Popular tools used to search for online resources are tuned to satisfy a broad category of users---primarily adults. Because children have specific needs, these tools may not always be successful in offering the right level of support in their quest for information. While search tools often provide query assistance, children still face many difficulties expressing their information needs in the form of a query. In this paper, we share results from our ongoing research work focused on understanding children's interactions with query suggestions and their preferences with respect to suggestions offered by a general-purpose strategy versus a counterpart designed exclusively for children. Our goal is to inform researchers and developers about when it is necessary to turn to technologies tailored exclusively for children and to further outline needs that should be addressed when it comes to designing query-formulation-related technology for children.
Oghenemaro Anuyah, Jerry Alan Fails, Maria Soledad Pera
IDC1
2018 Looking for the Movie Seven or Sven from the Movie Frozen?: A Multi-perspective Strategy for Recommending Queries for Children
abstract
Popular search engines are usually tuned to satisfy the information needs of a general audience. As a result, non-traditional, yet active groups of users, such as children, experience challenges composing queries that can lead them to the retrieval of adequate results. To aid young users in formulating keyword queries that can facilitate their information-seeking process, we introduce ReQuIK, a multi-perspective query suggestion system for children. ReQuIK informs its suggestion process by applying (i) a strategy based on search intent to capture the purpose of a query, (ii) a ranking strategy based on a wide and deep neural network that considers both raw text and traits commonly associated with kid-related queries, (iii) a filtering strategy based on the readability levels of documents potentially retrieved by a query to favor suggestions that trigger the retrieval of documents matching children»s reading skills, and (iv) a content-similarity strategy to ensure diversity among suggestions. For assessing the quality of the system, we conducted initial offline and online experiments based on 591 queries written by 97 children, ages 6 to 13. The results of this assessment verified the correctness of ReQuIK»s recommendation strategy, the fact that it provides suggestions that appeal to children and ReQuIK»s ability to recommend queries that lead to the retrieval of materials with readability levels that correlate with children»s reading skills.
Ion Madrazo Azpiazu, Nevena Dragovic, Oghenemaro Anuyah, Maria Soledad Pera
CHIIR3