Ítalo Santos

dblp:203/0063 · DBLP profile ↗
← Back
11ranked-venue papers
6as first author
10since 2021 · last 2025
0000-0002-7545-6104ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Software engineering, systems software and programming languages · 7 · 3 first-author · 6 since 2021Human-computer interaction and ubiquitous computing · 4 · 3 first-author · 4 since 2021Artificial intelligence and machine learning · 1 · 1 first-authorDatabases, data management, data science and information retrieval · 1 · 1 first-author
YearPublicationVenuePosition
2025 Ossdoorway: A Gamified Environment to Scaffold Student Contributions to Open Source Software
abstract
Software engineering courses enable practical learning through assignments requiring contributions to open source software (OSS), allowing students to experience real-world projects, collaborate with global communities, and develop skills and competencies required to succeed in the tech industry. Learning software engineering through open source contribution integrates theory with hands-on practice, as students tackle real challenges in collaborative environments. However, students often struggle to contribute to OSS projects and do not understand the contribution process. Research has demonstrated that strategically incorporating game elements can promote student learning and engagement. This paper proposes and evaluates OSSDoorway, a tool designed to guide students contributing to OSS projects. We recruited 29 students and administered a selfefficacy questionnaire before and after their use of OSSDoorway, along with qualitative feedback to assess challenges, interface features, and suggestions for improvement. The results show that OSSDoorway boosts students' self-efficacy and provides a structured, gamified learning experience. Clear instructions, real-time feedback, and the quest-based system helped students navigate tasks like using GitHub features to submit pull requests and collaborating with the community. Our findings suggest that providing students with a supportive gamified environment that uses feedback and structured quests can help them navigate the OSS contribution process.
Ítalo Santos, Kátia Romero Felizardo, Anita Sarma, Igor Steinmacher, Marco Aurélio Gerosa
CSEE&T1
2025 Diversity in Software Engineering Education: Exploring Motivations, Influences, and Role Models Among Undergraduate Students
abstract
Software engineering (SE) faces significant diversity challenges in both academia and industry, with underrepresented students encountering hostile environments, limited representation, and systemic biases that hinder their academic and professional success. Despite significant research on the exclusion experienced by students from underrepresented groups in SE education, there is limited understanding of the specific motivations, influences, and role models that drive underrepresented students to pursue and persist in the field. This study explores the motivations and influences shaping the career aspirations of students from underrepresented groups in SE, and it investigates how role models and mentorship impact their decisions to stay in the field. We conducted a cross-sectional survey with undergraduate SE students and related fields, focusing on their motivations, influences, and the impact of mentorship and role models on their career paths. We identified eight motivations for pursuing SE, with career advancement, technological enthusiasm, and personal growth being the most common. Family members, tech influencers, teachers, and friends were key influences, though 64 % of students reported no specific individual influence. Role models, particularly tech influencers and family members play a critical role in sustaining interest in the field, especially for underrepresented groups. This study provides insights into the varied motivations and influences that guide underrepresented students' decisions to pursue SE. It emphasizes the importance of role models and highlights the need for intersectional approaches to better support diversity in the field.
Ronnie E. S. Santos, Ítalo Santos, Robson Santos, Cleyton V. C. de Magalhães
CSEE&T2
2025 Hidden Figures in Software Engineering: A Replication Study Exploring Undergraduate Software Students' Awareness of Distinguished Scientists from Underrepresented Groups
abstract
Technology is a cornerstone of modern life, yet the software engineering field struggles to reflect the diversity of contemporary society. This lack of diversity and inclusivity within the software industry can be traced back to limited representation in software engineering academic settings, where students from underrepresented groups are often stigmatized despite the field's rich history of contributions from scientists from diverse backgrounds. Over the years, studies have revealed that women, LGBTQIA+ individuals, and Black students frequently encounter unwelcoming environments in software engineering programs. However, similar to other fields, increasing awareness of notable individuals from marginalized backgrounds could inspire students and foster a more inclusive environment. This study reports the findings from a replicated global survey with undergraduate software engineering students, exploring their knowledge of distinguished scientists from underrepresented groups. These findings show that students have limited awareness of these figures and their contributions, highlighting the need to improve diversity awareness and develop educational practices that celebrate the achievements of historically marginalized groups in software engineering.
Ronnie E. S. Santos, Ítalo Santos, Robson Santos, Cleyton V. C. de Magalhães
SANER2
2025 Testing the Untestable? An Empirical Study on the Testing Process of LLM-Powered Software Systems
abstract
Background: Software systems powered by large language models are becoming a routine part of everyday technologies, supporting applications across a wide range of domains. In software engineering, many studies have focused on how LLMs support tasks such as code generation, debugging, and documentation. However, there has been limited focus on how full systems that integrate LLMs are tested during development. Aims: This study explores how LLM-powered systems are tested in the context of real-world application development. Method: We conducted an exploratory case study using 99 individual reports written by students who built and deployed LLM-powered applications as part of a university course. Each report was independently analyzed using thematic analysis, supported by a structured coding process. Results: Testing strategies combined manual and automated methods to evaluate both system logic and model behavior. Common practices included exploratory testing, unit testing, and prompt iteration. Reported challenges included integration failures, unpredictable outputs, prompt sensitivity, hallucinations, and uncertainty about correctness. Conclusions: Testing LLM-powered systems required adaptations to traditional verification methods, blending source-level reasoning with behavior-aware evaluations. These findings provide evidence on the practical context of testing generative components in software systems.
Cleyton V. C. de Magalhães, Ítalo Santos, Brody Stuart-Verner, Ronnie E. S. Santos
SCAM2
2025 Software solutions for newcomers' onboarding in software projects: A systematic literature review
Ítalo Santos, Kátia Romero Felizardo, Igor Steinmacher, Marco Aurélio Gerosa
Inf. Softw. Technol.1
2024 Are We Testing or Being Tested? Exploring the Practical Applications of Large Language Models in Software Testing
abstract
A Large Language Model (LLM) represents a cutting-edge artificial intelligence model that generates content, including grammatical sentences, human-like paragraphs, and syntactically code snippets. LLMs can play a pivotal role in soft-ware development, including software testing. LLMs go beyond traditional roles such as requirement analysis and documentation and can support test case generation, making them valuable tools that significantly enhance testing practices within the field. Hence, we explore the practical application of LLMs in software testing within an industrial setting, focusing on their current use by professional testers. In this context, rather than relying on existing data, we conducted a cross-sectional survey and collected data within real working contexts-specifically, engaging with practitioners in industrial settings. We applied quantitative and qualitative techniques to analyze and synthesize our collected data. Our findings demonstrate that LLMs effectively enhance testing documents and significantly assist testing professionals in programming tasks like debugging and test case automation. LLMs can support individuals engaged in manual testing who need to code. However, it is crucial to emphasize that, at this early stage, software testing professionals should use LLMs with caution while well-defined methods and guidelines are being built for the secure adoption of these tools.
Robson Santos, Ítalo Santos, Cleyton V. C. de Magalhães, Ronnie E. S. Santos
ICST2
2024 Empowering Diversity: Leveraging Cognitive Styles to Support Newcomers in Open Source Projects
abstract
Newcomers are vital for many Open Source Software (OSS) communities’ sustainability and development. However, newcomers face significant barriers, leading to a dropout rate as high as $\mathbf{8 2 \%}$. These barriers disproportionately affect underrepresented groups, heightening diversity imbalances in OSS projects. Research indicates that gender biases in OSS tools and infrastructure, originating from cognitive diversity, contribute to these barriers. In this paper, we propose to investigate the GitHub platform to enhance the tools and infrastructure by creating usable interfaces and empowering newcomers fairly and equitably, focusing on cognitive diversity to promote a more inclusive OSS community.
Ítalo Santos
VL/HCC1
2024 Game Elements to Engage Students Learning the Open Source Software Contribution Process
abstract
Contributing to OSS projects can help students to enhance their skills and expand their professional networks. However, novice contributors often feel discouraged due to various barriers. Gamification techniques hold the potential to foster engagement and facilitate the learning process. Nevertheless, it is unknown which game elements are effective in this context. This study explores students’ perceptions of gamification elements to inform the design of a gamified learning environment. We surveyed 115 students and segmented the analysis from three perspectives: (1) cognitive styles, (2) gender, and (3) ethnicity (Hispanic/LatinX and Non-Hispanic/LatinX). The results showed that Quest, Point, Stats, and Badge are favored elements, while competition and pressure-related are less preferred. Across cognitive styles (persona), gender, and ethnicity, we could not observe any statistical differences, except for Tim’s GenderMag persona, which demonstrated a higher preference for storytelling. Conversely, Hispanic/LatinX participants showed a preference for the Choice element. These results can guide tool builders in designing effective gamified learning environments focused on the OSS contributions process.
Ítalo Santos, Kátia Romero Felizardo, Marco Aurélio Gerosa, Igor Steinmacher
VL/HCC1
2023 Tag that issue: applying API-domain labels in issue tracking systems
Fabio Santos, Joseph Vargovich, Bianca Trinkenreich, Ítalo Santos, Jacob Penney, Ricardo Britto 0001, João Felipe Pimentel, Igor Scaliante Wiese, Igor Steinmacher, Anita Sarma, Marco Aurélio Gerosa
Empir. Softw. Eng.4
2022 Hits and Misses: Newcomers' ability to identify Skills needed for OSS tasks
abstract
Participation in Open Source Software (OSS) projects offers real software development experience for students and other newcomers seeking to develop their skills. However, onboarding to an OSS project brings various challenges, including finding a suitable task among various open issues. Selecting an appropriate starter task requires newcomers to identify the skills needed to solve a project issue and avoiding tasks too far from their skill set. However, little is known about how effective newcomers are in identifying the skills needed to resolve an issue. We asked 154 undergrad students to evaluate issues from OSS projects and infer the skills needed to contribute. Students reported a total of 94 skills, which we classified into 10 categories. We compared the students' answers to those collected from 6 professional developers. In general, students misidentified and missed several skills (f-measure=0.37). Students had results closer to professional developers for skills related to database, operating infrastructure, programming concepts, and programming language, and they had worse results in identifying skills related to debugging and program comprehension. Our results can help educators who seek to use OSS as part of their courses and OSS communities that want to label newcomer-friendly issues to facilitate onboarding of new contributors.
Ítalo Santos, Igor Scaliante Wiese, Igor Steinmacher, Anita Sarma, Marco Aurélio Gerosa
SANER1
2020 A survey on the practices of mobile application testing
abstract
Context: Mobile devices have become increasingly popular, and mobile applications should guarantee a very high level of reliability and quality. Mobile application testing needs to consider several unique requirements that distinguish it from conventional software testing. Objective: Our study aims to establish an overview of the testing practices conducted in mobile companies, to identify weaknesses that can be improved to make the testing activity more effective. Method: The survey questions were carefully designed using the Goal/Question/Metric method to provide relevant information to the questions raised in our study. Results and Conclusions: Our study outlines that native applications are more common. The testing level more performed is the system test and the positions that perform testing levels and objectives are described. Practices related to testing technique selection in the context of mobile applications are highlighted. In the context of this study, Cucumber and Selenium are the testing tools most used to automate testing activity. Some mobile testing characteristics were outlined to understand how the testing in mobile applications run on different devices, how testers deal with the diversity of operating systems that are constantly updated and whether tests are unified to testing a mobile app that runs in different platforms. Furthermore, we report the main challenges faced by testers during the validation of the mobile app.
Ítalo Santos, Júlio César C. Filho, Simone do Rócio Senger de Souza
CLEI1