Carolina Nobre

dblp:218/5337 · DBLP profile ↗
← Back
21ranked-venue papers
6as first author
17since 2021 · last 2026
0000-0002-2892-0509ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 14 · 3 first-author · 13 since 2021Graphics, computer vision, multimedia, augmented reality and games · 7 · 3 first-author · 4 since 2021
YearPublicationVenuePosition
2026 Reflexis: Supporting Reflexivity and Rigor in Collaborative Qualitative Analysis though Design for Deliberation
abstract
Reflexive Thematic Analysis (RTA) is a critical method for generating deep interpretive insights. Yet its core tenets, including researcher reflexivity, tangible analytical evolution, and productive disagreement, are often poorly supported by software tools that prioritize speed and consensus over interpretive depth. To address this gap, we introduce Reflexis, a collaborative workspace that centers these practices. It supports reflexivity by integrating in-situ reflection prompts, makes code evolution transparent and tangible, and scaffolds collaborative interpretation by turning differences into productive, positionality-aware dialogue. Results from our paired-analyst study (N = 12) indicate that Reflexis encouraged participants toward more granular reflection and reframed disagreements as productive conversations. The evaluation also surfaced key design tensions, including a desire for higher-level, networked memos and more user control over the timing of proactive alerts. Reflexis contributes a design framework for tools that prioritize rigor and transparency to support deep, collaborative interpretation in an age of automation.
Runlong Ye 0002, Oliver Huang, Patrick Yung Kang Lee, Michael Liut, Carolina Nobre, Ha-Kyung Kong
CHI5
2026 Code as Anchor, Memory and Metaphor as Support: Learner Experiences with Multi-View Visualizations
abstract
Motivation: Program visualizations are widely used to support novice programmers, yet students often ignore or resist well-designed visual scaffolds. Research on multiple external representations (MERs) suggests cognitive design principles for coordinating views, but says little about what determines whether learners actually engage with the representations available to them.
Naaz Sibia, Jessica Wen, Amber Richardson, Yashika Jain, Khushi Malik, Bogdan Simion, Carolina Nobre, Angela M. Zavaleta Bernuy, Andrew Petersen 0001, Michael Liut
ICER (1)7
2026 From Toil to Thought: Designing for Strategic Exploration and Responsible AI in Systematic Literature Reviews
abstract
Systematic Literature Reviews (SLRs) are fundamental to scientific progress, yet the process is hindered by a fragmented tool ecosystem that imposes a high cognitive load. This friction suppresses the iterative, exploratory nature of scholarly work. To investigate these challenges, we conducted an exploratory design study with 20 experienced researchers. This study identified key friction points: 1) the high cognitive load of managing iterative query refinement across multiple databases, 2) the overwhelming scale and pace of publication of modern literature, and 3) the tension between automation and scholarly agency.
Runlong Ye 0002, Naaz Sibia, Angela M. Zavaleta Bernuy, Tingting Zhu 0006, Carolina Nobre, Viktoria Pammer-Schindler, Michael Liut
IUI5
2026 Narrative Scaffolding: A Narrative-First Framework for Data-Driven Sensemaking
abstract
When exploring data, analysts construct narratives about what the data means by asking questions, generating visualizations, reflecting on patterns, and revising their interpretations as new insights emerge. Yet existing analysis tools treat narrative as an afterthought, breaking the link between reasoning, reflection, and the evolving story from exploration. Consequently, analysts lose the ability to see how their reasoning evolves, making it harder to reflect systematically or build coherent explanations. To address this gap, we propose Narrative Scaffolding (NS), a framework for narrative-driven exploration that positions narrative construction as the primary interface for exploration and reasoning. We implemented this framework in a system that externalizes iterative reasoning through narrative-first entry, semantically aligned view generation, and reflection support via insight provenance and inquiry tracking. In a within-subject study (N = 20), we demonstrated that narrative scaffolding facilitates broader exploration, deeper reflection, and more defensible narratives. An evaluation with visualization literacy experts (N = 6) confirmed that the system produced outputs aligned with narrative intent and facilitated intentional exploration.
Oliver Huang, Muhammad Fatir, Tianyu Luo, Sangho Suh, Hariharan Subramonyam, Carolina Nobre
IUI6
2026 Do You "Trust" This Visualization? An Inventory to Measure Trust in Visualizations
abstract
Trust plays a critical role in visual data communication and decision-making, yet existing visualization research employs varied trust measures, making it challenging to compare and synthesize findings across studies. In this work, we first took a bottom-up, data-driven approach to understand what visualization readers mean when they say they "trust" a visualization. We compiled and adapted a broad set of trust-related statements from existing inventories and collected responses to visualizations with varying degrees of trustworthiness. Through exploratory factor analysis, we derived an operational definition of trust in visualizations. Our findings indicate that people perceive a trustworthy visualization as one that presents credible information and is comprehensible and usable. Building on this insight, we developed an eight-item inventory: four core items measuring trust in visualizations and four optional items controlling for individual differences in baseline trust tendency. We established the inventory's internal consistency reliability using McDonald's omega, confirmed its content validity by demonstrating alignment with theoretically-grounded trust dimensions, and validated its criterion validity through two trust games with real-world stakes. Finally, we illustrate how this standardized inventory can be applied across diverse visualization research contexts. Utilizing our inventory, future research can examine how design choices, tasks, and domains influence trust, and how to foster appropriate trusting behavior in human-data interactions.
Huichen Will Wang, Kylie R. Lin, Andrew Cohen, Ryan Kennedy, Zach Zwald, Carolina Nobre, Cindy Xiong Bearfield
IEEE Trans. Vis. Comput. Graph.6
2025 Crowdsourced Think-Aloud Studies
Zach Cutler, Lane Harrison, Carolina Nobre, Alexander Lex
CHI3
2025 Beyond Time and Accuracy: Strategies in Visual Problem-Solving
Eric Mörth, Zona Kostic, Nils Gehlenborg, Hanspeter Pfister, Johanna Beyer, Carolina Nobre
CHI6
2025 Reducing Isolation through Peer-Modeled Posts
abstract
Creating a supportive community in introductory programming courses is vital to student success, yet forums meant to facilitate this can cause stress due to social comparison. According to social identity theory, students are more likely to engage and feel a sense of belonging when they perceive connections with their peers. This study investigates whether peer-modeled posts that simulate students exhibiting desirable engagement behavior can reduce feelings of isolation and foster social connection among students. We introduced curated posts modeling expected student behavior -- covering content, providing emotional support, and offering study tips -- into Q&A forums for two introductory computing courses. These posts were inserted using different student accounts. Surveys and forum data were analyzed to measure the impact on students' feelings of isolation. Students responded positively to the seeded posts, reporting a significant reduction in feelings of isolation. Notably, women reported feeling less isolated after seeing the posts more than men, and many students reported feeling relieved that other students had the same worries and concerns as them. Seeding peer-modeled posts can significantly reduce student isolation and foster a greater sense of belonging in competitive academic contexts. However, future work may explore alternative delivery mechanisms, such as instructor posts framed as ''questions from last year,'' to determine if they can achieve similar effects.
Naaz Sibia, Angela M. Zavaleta Bernuy, Amber Richardson, Khushi Malik, Prajna Pendharkar, Carolina Nobre, Michael Liut, Andrew Petersen 0001
SIGCSE (2)6
2025 The State of the Art in User-Adaptive Visualizations
abstract
Abstract Research shows that user traits can modulate the use of visualization systems and have a measurable influence on users' accuracy, speed, and attention when performing visual analysis. This highlights the importance of user‐adaptive visualization that can modify themselves to the characteristics and preferences of the user. However, there are very few such visualization systems, as creating them requires broad knowledge from various sub‐domains of the visualization community. A user‐adaptive system must consider which user traits they adapt to, their adaptation logic and the types of interventions they support. In this STAR, we survey a broad space of existing literature and consolidate them to structure the process of creating user‐adaptive visualizations into five components: Capture Ⓐ Input from the user and any relevant peripheral information. Perform computational Ⓑ User Modelling with this input to construct a Ⓒ User Representation . Employ Ⓓ Adaptation Assignment logic to identify when and how to introduce Ⓔ Interventions . Our novel taxonomy provides a road map for work in this area, describing the rich space of current approaches and highlighting open areas for future work.
Fernando J. Yanez, Cristina Conati, Alvitta Ottley, Carolina Nobre
Comput. Graph. Forum4
2024 What's the Rush?: Alternative Values in Navigation Technologies for Urban Placemaking
abstract
In the design of contemporary mapping technologies, effective navigation has become synonymous with the quickest route, limiting the extent to which people engage with the places they move in and around. This paper unsettles the prevalent focus on efficiency and explores opportunities to support placemaking during everyday practices of navigation. Drawing on 16 interviews and using the Value Sensitive Design framework, we identify seven alternative values, beyond efficiency, that hold significance for people navigating the city. Through a series of two design workshops, we further examine how and when these values come to matter during navigation. Our findings suggest four ways in which the prevalent design standards of navigational apps work against these values, and highlight their potential contribution to placemaking during technology mediated navigation. In doing so, this paper contributes to placemaking research and ongoing questions of efficiency and optimization within HCI.
Taneea S. Agrawaal, Aarjav Chauhan, Carolina Nobre, Robert Soden
CHI3
2024 Reading Between the Pixels: Investigating the Barriers to Visualization Literacy
abstract
In our current visual-centric digital age, the capability to interpret, understand, and produce visual representations of data —termed visualization literacy— is paramount. However, not everyone is adept at navigating this visual terrain. This paper explores the barriers that individuals who misread a visualization encounter, aiming to understand their specific mental gaps.
Carolina Nobre, Kehang Zhu, Eric Mörth, Hanspeter Pfister, Johanna Beyer
CHI1
2024 Exploring the Effects of Grouping by Programming Experience in Q&A Forums
abstract
Motivation: Q&A forums are a critical resource for supporting students in large educational environments, yet students often perceive these forums as stressful and report discomfort in participating visibly, especially in classes that are large and have students with varying levels of prior programming experience (PE). Method: We divided students in a CS1 Q&A forum into smaller, homogenous groups based on their PE. We use a mixed-methods approach to compare data from this experience to data from a setting where all students shared a single, large Q&A forum (a “mixed” setting). We quantitatively analyze measures of student engagement and use an open-ended qualitative approach to examine responses about student experience on the forums. This approach helps us identify the motivation behind student decisions to participate in visible or non-visible ways and to evaluate their alignment with theoretical frameworks. Results: In the mixed setting, students frequently use anonymity, with students without PE using anonymity more than students with PE and women using anonymity more than men. In contrast, in the homogenous groups, novices used anonymity less than novices in the mixed setting, while the students in higher-experience groups tended to use it more. We also observe a reduced anonymity usage among women in the homogenous experience groups, suggesting that PE plays a critical role in the observed gender disparities in forum participation. The qualitative analysis provides additional evidence that social status issues and confidence may explain these behavioral patterns. Conclusion: This study highlights the potential benefits and consequences of grouping students by experience. Homogenous PE groups foster increased student comfort and engagement within the Q&A forum for students with less experience, but students with more experience are exposed to more perceived status threats. We discuss how these results align with the theories we used to design the homogenous group setting. This exploration contributes to a deeper understanding of the underlying dynamics shaping student behavior in online learning communities. Educators and platform designers can use these lessons to more effectively create inclusive environments that accommodate diverse student needs and preferences.
Naaz Sibia, Angela M. Zavaleta Bernuy, Tiana V. Simovic, Chloe Huang, Yinyue Tan, Eunchae Seong, Carolina Nobre, Daniel Zingaro, Michael Liut, Andrew Petersen 0001
ICER (1)7
2024 Vistrust: a Multidimensional Framework and Empirical Study of Trust in Data Visualizations
abstract
Trust is an essential aspect of data visualization, as it plays a crucial role in the interpretation and decision-making processes of users. While research in social sciences outlines the multi-dimensional factors that can play a role in trust formation, most data visualization trust researchers employ a single-item scale to measure trust. We address this gap by proposing a comprehensive, multidimensional conceptualization and operationalization of trust in visualization. We do this by applying general theories of trust from social sciences, as well as synthesizing and extending earlier work and factors identified by studies in the visualization field. We apply a two-dimensional approach to trust in visualization, to distinguish between cognitive and affective elements, as well as between visualization and data-specific trust antecedents. We use our framework to design and run a large crowd-sourced study to quantify the role of visual complexity in establishing trust in science visualizations. Our study provides empirical evidence for several aspects of our proposed theoretical framework, most notably the impact of cognition, affective responses, and individual differences when establishing trust in visualizations.
Hamza Elhamdadi, Adam Stefkovics, Johanna Beyer, Eric Mörth, Hanspeter Pfister, Cindy Xiong Bearfield, Carolina Nobre
IEEE Trans. Vis. Comput. Graph.7
2022 The Pattern is in the Details: An Evaluation of Interaction Techniques for Locating, Searching, and Contextualizing Details in Multivariate Matrix Visualizations
abstract
Matrix visualizations are widely used to display large-scale network, tabular, set, or sequential data. They typically only encode a single value per cell, e.g., through color. However, this can greatly limit the visualizations’ utility when exploring multivariate data, where each cell represents a data point with multiple values (referred to as details). Three well-established interaction approaches can be applicable in multivariate matrix visualizations (or MMV): focus+context, pan&zoom, and overview+detail. However, there is little empirical knowledge of how these approaches compare in exploring MMV. We report on two studies comparing them for locating, searching, and contextualizing details in MMV. We first compared four focus+context techniques and found that the fisheye lens overall outperformed the others. We then compared the fisheye lens, to pan&zoom and overview+detail. We found that pan&zoom was faster in locating and searching details, and as good as overview+detail in contextualizing details.
Yalong Yang 0001, Wenyu Xia, Fritz Lekschas, Carolina Nobre, Robert Krüger, Hanspeter Pfister
CHI4
2021 Parsing and Summarizing Infographics with Synthetically Trained Icon Detection
abstract
Widely used in news, business, and educational media, infographics are handcrafted to effectively communicate messages about complex and often abstract topics including `ways to conserve the environment' and `coronavirus prevention'. The computational understanding of infographics required for future applications like automatic captioning, summarization, search, and question-answering, will depend on being able to parse the visual and textual elements contained within. However, being composed of stylistically and semantically diverse visual and textual elements, infographics pose challenges for current A.I. systems. While automatic text extraction works reasonably well on infographics, standard object detection algorithms fail to identify the stand-alone visual elements in infographics that we refer to as `icons'. In this paper, we propose a novel approach to train an object detector using synthetically-generated data, and show that it succeeds at generalizing to detecting icons within in-the-wild infographics. We further pair our icon detection approach with an icon classifier and a state-of-the-art text detector to demonstrate three demo applications: topic prediction, multi-modal summarization, and multi-modal search. Parsing the visual and textual elements within infographics provides us with the first steps towards automatic infographic understanding.
Spandan Madan, Zoya Bylinskii, Carolina Nobre, Matthew Tancik, Adrià Recasens, Kimberli Zhong, Sami Alsheikh, Aude Oliva, Frédo Durand, Hanspeter Pfister
PacificVis3
2021 Towards an Understanding of Situated AR Visualization for Basketball Free-Throw Training
abstract
We present an observational study to compare co-located and situated real-time visualizations in basketball free-throw training. Our goal is to understand the advantages and concerns of applying immersive visualization to real-world skill-based sports training and to provide insights for designing AR sports training systems. We design both a situated 3D visualization on a head-mounted display and a 2D visualization on a co-located display to provide immediate visual feedback on a player’s shot performance. Using a within-subject study design with experienced basketball shooters, we characterize user goals, report on qualitative training experiences, and compare the quantitative training results. Our results show that real-time visual feedback helps athletes refine subsequent shots. Shooters in our study achieve greater angle consistency with our visual feedback. Furthermore, AR visualization promotes an increased focus on body form in athletes. Finally, we present suggestions for the design of future sports AR studies.
Tica Lin, Rishi Singh, Yalong Yang 0001, Carolina Nobre, Johanna Beyer, Maurice A. Smith, Hanspeter Pfister
CHI4
2021 reVISit: Looking Under the Hood of Interactive Visualization Studies
abstract
Quantifying user performance with metrics such as time and accuracy does not show the whole picture when researchers evaluate complex, interactive visualization tools. In such systems, performance is often influenced by different analysis strategies that statistical analysis methods cannot account for. To remedy this lack of nuance, we propose a novel analysis methodology for evaluating complex interactive visualizations at scale. We implement our analysis methods in reVISit, which enables analysts to explore participant interaction performance metrics and responses in the context of users’ analysis strategies. Replays of participant sessions can aid in identifying usability problems during pilot studies and make individual analysis processes salient. To demonstrate the applicability of reVISit to visualization studies, we analyze participant data from two published crowdsourced studies. Our findings show that reVISit can be used to reveal and describe novel interaction patterns, to analyze performance differences between different analysis strategies, and to validate or challenge design decisions.
Carolina Nobre, Dylan Wootton, Zach Cutler, Lane Harrison, Hanspeter Pfister, Alexander Lex
CHI1
2020 Evaluating Multivariate Network Visualization Techniques Using a Validated Design and Crowdsourcing Approach
abstract
Visualizing multivariate networks is challenging because of the trade-offs necessary for effectively encoding network topology and encoding the attributes associated with nodes and edges. A large number of multivariate network visualization techniques exist, yet there is little empirical guidance on their respective strengths and weaknesses. In this paper, we describe a crowdsourced experiment, comparing node-link diagrams with on-node encoding and adjacency matrices with juxtaposed tables. We find that node-link diagrams are best suited for tasks that require close integration between the network topology and a few attributes. Adjacency matrices perform well for tasks related to clusters and when many attributes need to be considered. We also reflect on our method of using validated designs for empirically evaluating complex, interactive visualizations in a crowdsourced setting. We highlight the importance of training, compensation, and provenance tracking.
Carolina Nobre, Dylan Wootton, Lane Harrison, Alexander Lex
CHI1
2019 The State of the Art in Visualizing Multivariate Networks
abstract
Abstract Multivariate networks are made up of nodes and their relationships (links), but also data about those nodes and links as attributes. Most real‐world networks are associated with several attributes, and many analysis tasks depend on analyzing both, relationships and attributes. Visualization of multivariate networks, however, is challenging, especially when both the topology of the network and the attributes need to be considered concurrently. In this state‐of‐the‐art report, we analyze current practices and classify techniques along four axes: layouts, view operations, layout operations, and data operations. We also provide an analysis of tasks specific to multivariate networks and give recommendations for which technique to use in which scenario. Finally, we survey application areas and evaluation methodologies.
Carolina Nobre, Miriah D. Meyer, Marc Streit, Alexander Lex
Comput. Graph. Forum1
2019 Lineage: Visualizing Multivariate Clinical Data in Genealogy Graphs
abstract
The majority of diseases that are a significant challenge for public and individual heath are caused by a combination of hereditary and environmental factors. In this paper we introduce Lineage, a novel visual analysis tool designed to support domain experts who study such multifactorial diseases in the context of genealogies. Incorporating familial relationships between cases with other data can provide insights into shared genomic variants and shared environmental exposures that may be implicated in such diseases. We introduce a data and task abstraction, and argue that the problem of analyzing such diseases based on genealogical, clinical, and genetic data can be mapped to a multivariate graph visualization problem. The main contribution of our design study is a novel visual representation for tree-like, multivariate graphs, which we apply to genealogies and clinical data about the individuals in these families. We introduce data-driven aggregation methods to scale to multiple families. By designing the genealogy graph layout to align with a tabular view, we are able to incorporate extensive, multivariate attributes in the analysis of the genealogy without cluttering the graph. We validate our designs by conducting case studies with our domain collaborators.
Carolina Nobre, Nils Gehlenborg, Hilary Coon, Alexander Lex
IEEE Trans. Vis. Comput. Graph.1
2019 Juniper: A Tree+Table Approach to Multivariate Graph Visualization
abstract
Analyzing large, multivariate graphs is an important problem in many domains, yet such graphs are challenging to visualize. In this paper, we introduce a novel, scalable, tree+table multivariate graph visualization technique, which makes many tasks related to multivariate graph analysis easier to achieve. The core principle we follow is to selectively query for nodes or subgraphs of interest and visualize these subgraphs as a spanning tree of the graph. The tree is laid out linearly, which enables us to juxtapose the nodes with a table visualization where diverse attributes can be shown. We also use this table as an adjacency matrix, so that the resulting technique is a hybrid node-link/adjacency matrix technique. We implement this concept in Juniper and complement it with a set of interaction techniques that enable analysts to dynamically grow, restructure, and aggregate the tree, as well as change the layout or show paths between nodes. We demonstrate the utility of our tool in usage scenarios for different multivariate networks: a bipartite network of scholars, papers, and citation metrics and a multitype network of story characters, places, books, etc.
Carolina Nobre, Marc Streit, Alexander Lex
IEEE Trans. Vis. Comput. Graph.1