EDBT 2026 Demo / reviewers in the wild / expert
Chris Bryan
dblp:139/2338 · also Christopher Bryan
· DBLP profile ↗
31ranked-venue papers
4as first author
19since 2021 · last 2026
0000-0003-2430-815XORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Graphics, computer vision, multimedia, augmented reality and games · 24 · 3 first-author · 16 since 2021Human-computer interaction and ubiquitous computing · 4 · 1 first-author · 1 since 2021Artificial intelligence and machine learning · 3 · 1 first-author · 2 since 2021Security and privacy · 1Software engineering, systems software and programming languages · 1Databases, data management, data science and information retrieval · 1 · 1 first-authorApplied, interdisciplinary, general and emerging computing · 1 · 1 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Engagement vs. Understanding: Comparing Immersive Virtual Reality and Desktop Displays for Climate Data VisualizationabstractAbstract Immersive virtual reality (IVR) is increasingly used for scientific data visualization, with the expectation that greater immersion will enhance both engagement and understanding. However, prior research suggests a potential trade‐off: IVR can heighten affective responses while impairing cognitive learning due to increased cognitive load. To examine this tension in abstract scientific visualization, we conducted a between‐subjects study (N=84) comparing head‐mounted display (HMD) VR with traditional desktop displays as participants explored three climate datasets on an interactive 3D globe. We measured cognitive and affective learning outcomes after each exploration trial and at a two‐week follow‐up. We additionally logged patterns of visualization exploration during trials, and measured user experience post‐study and at two‐week follow‐up. Results reveal systematic divergences: desktop displays led to significantly higher recall accuracy and promoted more systematic exploration patterns, while HMD‐based VR produced stronger short‐term increases in climate concern and higher satisfaction ratings. Critically, affective changes largely reverted to baseline at follow‐up regardless of modality. We further identify five distinct exploration strategies that emerge differentially across modalities and relate directly to learning outcomes. Overall, our findings highlight how modality choice should align with visualization goals, and offer actionable insights into designing effective scientific visualizations that balance cognitive and affective learning objectives. All data and materials are available at: https://osf.io/24w7s/ . Anjana Arunkumar, Chris Bryan |
Comput. Graph. Forum | 3 |
| 2026 | INFICOND: Investigating Interactive No-code Fine-tuning with Concept-based Knowledge DistillationabstractAbstract Knowledge distillation is a widely used technique whereby knowledge from large pre‐trained models is transferred into smaller student models. However, this process is non‐trivial and traditionally requires technical and theoretical expertise in AI/ML. We investigate a visualization‐driven strategy for making this process more accessible and intuitive via developing I n F i C on D, a novel tool that leverages visual concepts to scaffold the knowledge distillation process and support subsequent no‐code fine‐tuning of student models. I n F i C on D's backend pipeline extracts text‐aligned visual concepts and constructs highly interpretable student models; its frontend supports interactively fine‐tuning these student models by directly manipulating concept influences. Empirical evaluations help validate that I n F i C on D effectively supports knowledge distillation and subsequent fine‐tuning workflows. We additionally discuss insights and lessons learned about how human‐in‐the‐loop and visualization‐driven approaches like I n F i C on D can support accessible and adaptable AI explainability and model distillation. Jinbin Huang, Liang Gou, Liu Ren 0001, Chris Bryan |
Comput. Graph. Forum | 5 |
| 2026 | The Hue-Man Factor: An Empirical Evaluation of Visualization Perception and Accessibility Across Color Vision ProfilesabstractColor is a powerful tool in data visualization, but for individuals with color vision deficiencies (CVD), hue can become a barrier rather than an aid. In this paper, we examine how real-world visualizations are perceived across vision profiles through three complementary studies. Study 1 assessed how normal vision participants rated 46 visualizations shown in original and simulated red/green colorblind versions. Study 2 collected matched responses from participants with diagnosed CVD. Study 3 involved in-depth interviews exploring how users interpret, adapt to, and evaluate inaccessible designs. Across studies, we find that simulations capture directional perceptual shifts but fail to reflect the interpretive breakdowns and emotional work described by real CVD users. Factor analysis reveals two dominant perceptual dimensions: functional utility and affective experience. While normal vision participants prioritize functional clarity, CVD users rely more on structural cues and emotional resonance, particularly when color is unreliable. Qualitative insights show that perceptual breakdowns occur not only in high-interference charts but also when redundant encoding or layout scaffolding is missing. We synthesize these findings and offer empirically grounded design recommendations to guide inclusive visualization practices. Our results argue that accessibility must go beyond color correction, embracing structural clarity, redundancy, and real-user validation to ensure inclusive visual communication. Zhuojun Jiang, Anjana Arunkumar, Chris Bryan |
IEEE Trans. Vis. Comput. Graph. | 3 |
| 2025 | Lost in Translation: How Does Bilingualism Shape Reader Preferences for Annotated Charts?
Anjana Arunkumar, Lace M. K. Padilla, Chris Bryan |
CHI | 3 |
| 2025 | Linking student psychological orientation, engagement, and learning in college-level introductory data science
Kristine Zheng, Erik Brockbank, Shawn T. Schwartz, David Yeager, Chris Bryan, Carol S. Dweck, Judith E. Fan |
CogSci | 5 |
| 2025 | Modeling and Measuring the Chart Communication Recall ProcessabstractAbstract Understanding memory in the context of data visualizations is paramount for effective design. While immediate clarity in a visualization is crucial, retention of its information determines its long‐term impact. While extensive research has underscored the elements enhancing visualization memorability, a limited body of work has delved into modeling the recall process. This study investigates the temporal dynamics of visualization recall, focusing on factors influencing recollection, shifts in recall veracity, and the role of participant demographics. Using data from an empirical study (n = 104), we propose a novel approach combining temporal clustering and handcrafted features to model recall over time. A long short‐term memory (LSTM) model with attention mechanisms predicts recall patterns, revealing alignment with informativeness scores and participant characteristics. Our findings show that perceived informativeness dictates recall focus, with more informative visualizations eliciting narrative‐driven insights and less informative ones prompting aesthetic‐driven responses. Recall accuracy diminishes over time, particularly for unfamiliar visualizations, with age and education significantly shaping recall emphases. These insights advance our understanding of visualization recall, offering practical guidance for designing visualizations that enhance retention and comprehension. All data and materials are available at: https://osf.io/ghe2j/ . Anjana Arunkumar, Lace M. K. Padilla, Chris Bryan |
Comput. Graph. Forum | 3 |
| 2025 | Mind Drifts, Data Shifts: Utilizing Mind Wandering to Track the Evolution of User Experience with Data VisualizationsabstractUser experience in data visualization is typically assessed through post-viewing self-reports, but these overlook the dynamic cognitive processes during interaction. This study explores the use of mind wandering- a phenomenon where attention spontaneously shifts from a primary task to internal, task-related thoughts or unrelated distractions- as a dynamic measure during visualization exploration. Participants reported mind wandering while viewing visualizations from a pre-labeled visualization database and then provided quantitative ratings of trust, engagement, and design quality, along with qualitative descriptions and short-term/long-term recall assessments. Results show that mind wandering negatively affects short-term visualization recall and various post-viewing measures, particularly for visualizations with little text annotation. Further, the type of mind wandering impacts engagement and emotional response. Mind wandering also functions as an intermediate process linking visualization design elements to post-viewing measures, influencing how viewers engage with and interpret visual information over time. Overall, this research underscores the importance of incorporating mind wandering as a dynamic measure in visualization design and evaluation, offering novel avenues for enhancing user engagement and comprehension. Anjana Arunkumar, Lace M. K. Padilla, Chris Bryan |
IEEE Trans. Vis. Comput. Graph. | 3 |
| 2025 | PromptAid: Visual Prompt Exploration, Perturbation, Testing and Iteration for Large Language ModelsabstractLarge language models (LLMs) have gained widespread popularity due to their ability to perform ad-hoc natural language processing (NLP) tasks with simple natural language prompts. Part of the appeal for LLMs is their approachability to the general public, including individuals with little technical expertise in NLP. However, prompts can vary significantly in terms of their linguistic structure, context, and other semantics, and modifying one or more of these aspects can result in significant differences in task performance. Non-expert users may find it challenging to identify the changes needed to improve a prompt, especially when they lack domain-specific knowledge and appropriate feedback. To address this challenge, we present PromptAid, a visual analytics system designed to interactively create, refine, and test prompts through exploration, perturbation, testing, and iteration. PromptAid uses coordinated visualizations which allow users to improve prompts via three strategies: keyword perturbations, paraphrasing perturbations, and obtaining the best set of in-context few-shot examples. PromptAid was designed through a pre-study involving NLP experts, and evaluated via a robust mixed-methods user study. Our findings indicate that PromptAid helps users to iterate over prompts with less cognitive overhead, generate diverse prompts with the help of recommendations, and analyze the performance of the generated prompts while surpassing existing state-of-the-art prompting interfaces in performance. Aditi Mishra, Bretho Danzy, Utkarsh Soni, Anjana Arunkumar, Jinbin Huang, Bum Chul Kwon, Chris Bryan |
IEEE Trans. Vis. Comput. Graph. | 7 |
| 2025 | Defogger: A Visual Analysis Approach for Data Exploration of Sensitive Data Protected by Differential PrivacyabstractDifferential privacy ensures the security of individual privacy but poses challenges to data exploration processes because the limited privacy budget incapacitates the flexibility of exploration and the noisy feedback of data requests leads to confusing uncertainty. In this study, we take the lead in describing corresponding exploration scenarios, including underlying requirements and available exploration strategies. To facilitate practical applications, we propose a visual analysis approach to the formulation of exploration strategies. Our approach applies a reinforcement learning model to provide diverse suggestions for exploration strategies according to the exploration intent of users. A novel visual design for representing uncertainty in correlation patterns is integrated into our prototype system to support the proposed approach. Finally, we implemented a user study and two case studies. The results of these studies verified that our approach can help develop strategies that satisfy the exploration intent of users. Xumeng Wang, Shuangcheng Jiao, Chris Bryan |
IEEE Trans. Vis. Comput. Graph. | 3 |
| 2024 | Image or Information? Examining the Nature and Impact of Visualization Perceptual ClassificationabstractHow do people internalize visualizations: as images or information? In this study, we investigate the nature of internalization for visualizations (i.e., how the mind encodes visualizations in memory) and how memory encoding affects its retrieval. This exploratory work examines the influence of various design elements on a user's perception of a chart. Specifically, which design elements lead to perceptions of visualization as an image (aims to provide visual references, evoke emotions, express creativity, and inspire philosophic thought) or as information (aims to present complex data, information, or ideas concisely and promote analytical thinking)? Understanding how design elements contribute to viewers perceiving a visualization more as an image or information will help designers decide which elements to include to achieve their communication goals. For this study, we annotated 500 visualizations and analyzed the responses of 250 online participants, who rated the visualizations on a bilinear scale as 'image' or 'information.' We then conducted an in-person study ( n = 101) using a free recall task to examine how the image/information ratings and design elements impacted memory. The results revealed several interesting findings: Image-rated visualizations were perceived as more aesthetically 'appealing,' 'enjoyable,' and 'pleasing.' Information-rated visualizations were perceived as less 'difficult to understand' and more aesthetically 'likable' and 'nice,' though participants expressed higher 'positive' sentiment when viewing image-rated visualizations and felt less 'guided to a conclusion.' The presence of axes and text annotations heavily influenced the likelihood of participants rating the visualization as 'information.' We also found different patterns among participants that were older. Importantly, we show that visualizations internalized as 'images' are less effective in conveying trends and messages, though they elicit a more positive emotional judgment, while 'informative' visualizations exhibit annotation focused recall and elicit a more positive design judgment. We discuss the implications of this dissociation between aesthetic pleasure and perceived ease of use in visualization design. Anjana Arunkumar, Lace M. K. Padilla, Gi-Yeul Bae, Chris Bryan |
IEEE Trans. Vis. Comput. Graph. | 4 |
| 2023 | Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop WorkflowabstractRecent research has shown that language models exploit 'artifacts' in benchmarks to solve tasks, rather than truly learning them, leading to inflated model performance.In pursuit of creating better benchmarks, we propose VAIDA, a novel benchmark creation paradigm for NLP, that focuses on guiding crowdworkers, an under-explored facet of addressing benchmark idiosyncrasies.VAIDA facilitates sample correction by providing real-time visual feedback and recommendations to improve sample quality.Our approach is domain, model, task, and metric agnostic, and constitutes a paradigm shift for robust, validated, and dynamic benchmark creation via human-and-metric-in-theloop workflows.We evaluate via expert review and a user study with NASA TLX.We find that VAIDA decreases effort, frustration, mental, and temporal demands of crowdworkers and analysts, simultaneously increasing the performance of both user groups with a 45.8% decrease in the level of artifacts in created samples.As a by-product of our user study, we observe that created samples are adversarial across models, leading to decreases of 31.3% (BERT), 22.5% (RoBERTa), 14.98% (GPT-3 fewshot) in performance.1 Anjana Arunkumar, Swaroop Mishra, Bhavdeep Singh Sachdeva, Chitta Baral, Chris Bryan |
EACL | 5 |
| 2023 | Measuring and Comparing Collaborative Visualization Behaviors in Desktop and Augmented Reality EnvironmentsabstractAugmented reality (AR) provides a significant opportunity to improve collaboration between co-located team members jointly analyzing data visualizations, but existing rigorous studies are lacking. We present a novel method for qualitatively encoding the positions of co-located users collaborating with head-mounted displays (HMDs) to assist in reliably analyzing collaboration styles and behaviors. We then perform a user study on the collaborative behaviors of multiple, co-located synchronously collaborating users in AR to demonstrate this method in practice and contribute to the shortfall of such studies in the existing literature. Pairs of users performed analysis tasks on several data visualizations using both AR and traditional desktop displays. To provide a robust evaluation, we collected several types of data, including software logging of participant positioning, qualitative analysis of video recordings of participant sessions, and pre- and post-study questionnaires including the NASA TLX survey. Our results suggest that the independent viewports of AR headsets reduce the need to verbally communicate about navigating around the visualization and encourage face-to-face and non-verbal communication. Our novel positional encoding method also revealed the overlap of task and communication spaces vary based on the needs of the collaborators. Michael Kintscher, Jinbin Huang, Anjana Arunkumar, Ashish Amresh, Chris Bryan |
VRST | 5 |
| 2023 | LINGO : Visually Debiasing Natural Language Instructions to Support Task DiversityabstractAbstract Cross‐task generalization is a significant outcome that defines mastery in natural language understanding. Humans show a remarkable aptitude for this, and can solve many different types of tasks, given definitions in the form of textual instructions and a small set of examples. Recent work with pre‐trained language models mimics this learning style: users can define and exemplify a task for the model to attempt as a series of natural language prompts or instructions. While prompting approaches have led to higher cross‐task generalization compared to traditional supervised learning, analyzing ‘bias’ in the task instructions given to the model is a difficult problem, and has thus been relatively unexplored. For instance, are we truly modeling a task, or are we modeling a user's instructions? To help investigate this, we develop LINGO, a novel visual analytics interface that supports an effective, task‐driven workflow to (1) help identify bias in natural language task instructions, (2) alter (or create) task instructions to reduce bias, and (3) evaluate pre‐trained model performance on debiased task instructions. To robustly evaluate LINGO, we conduct a user study with both novice and expert instruction creators, over a dataset of 1,616 linguistic tasks and their natural language instructions, spanning 55 different languages. For both user groups, LINGO promotes the creation of more difficult tasks for pre‐trained models, that contain higher linguistic diversity and lower instruction bias. We additionally discuss how the insights learned in developing and evaluating LINGO can aid in the design of future dashboards that aim to minimize the effort involved in prompt creation across multiple domains. A. Arunkumar, Rakhi Agrawal, Sriram Chandrasekaran, Chris Bryan |
Comput. Graph. Forum | 5 |
| 2023 | PMU Tracker: A Visualization Platform for Epicentric Event Propagation Analysis in the Power GridabstractThe electrical power grid is a critical infrastructure, with disruptions in transmission having severe repercussions on daily activities, across multiple sectors. To identify, prevent, and mitigate such events, power grids are being refurbished as 'smart' systems that include the widespread deployment of GPS-enabled phasor measurement units (PMUs). PMUs provide fast, precise, and time-synchronized measurements of voltage and current, enabling real-time wide-area monitoring and control. However, the potential benefits of PMUs, for analyzing grid events like abnormal power oscillations and load fluctuations, are hindered by the fact that these sensors produce large, concurrent volumes of noisy data. In this paper, we describe working with power grid engineers to investigate how this problem can be addressed from a visual analytics perspective. As a result, we have developed PMU Tracker, an event localization tool that supports power grid operators in visually analyzing and identifying power grid events and tracking their propagation through the power grid's network. As a part of the PMU Tracker interface, we develop a novel visualization technique which we term an epicentric cluster dendrogram, which allows operators to analyze the effects of an event as it propagates outwards from a source location. We robustly validate PMU Tracker with: (1) a usage scenario demonstrating how PMU Tracker can be used to analyze anomalous grid events, and (2) case studies with power grid operators using a real-world interconnection dataset. Our results indicate that PMU Tracker effectively supports the analysis of power grid events; we also demonstrate and discuss how PMU Tracker's visual analytics approach can be generalized to other domains composed of time-varying networks with epicentric event characteristics. Anjana Arunkumar, Andrea Pinceti, Lalitha Sankar, Chris Bryan |
IEEE Trans. Vis. Comput. Graph. | 4 |
| 2023 | ConceptExplainer: Interactive Explanation for Deep Neural Networks from a Concept PerspectiveabstractTraditional deep learning interpretability methods which are suitable for model users cannot explain network behaviors at the global level and are inflexible at providing fine-grained explanations. As a solution, concept-based explanations are gaining attention due to their human intuitiveness and their flexibility to describe both global and local model behaviors. Concepts are groups of similarly meaningful pixels that express a notion, embedded within the network's latent space and have commonly been hand-generated, but have recently been discovered by automated approaches. Unfortunately, the magnitude and diversity of discovered concepts makes it difficult to navigate and make sense of the concept space. Visual analytics can serve a valuable role in bridging these gaps by enabling structured navigation and exploration of the concept space to provide concept-based insights of model behavior to users. To this end, we design, develop, and validate ConceptExplainer, a visual analytics system that enables people to interactively probe and explore the concept space to explain model behavior at the instance/class/global level. The system was developed via iterative prototyping to address a number of design challenges that model users face in interpreting the behavior of deep learning models. Via a rigorous user study, we validate how ConceptExplainer supports these challenges. Likewise, we conduct a series of usage scenarios to demonstrate how the system supports the interactive analysis of model behavior across a variety of tasks and explanation granularities, such as identifying concepts that are important to classification, identifying bias in training data, and understanding how concepts can be shared across diverse and seemingly dissimilar classes. Jinbin Huang, Aditi Mishra, Bum Chul Kwon, Chris Bryan |
IEEE Trans. Vis. Comput. Graph. | 4 |
| 2023 | ChartStory: Automated Partitioning, Layout, and Captioning of Charts into Comic-Style NarrativesabstractVisual data storytelling is gaining importance as a means of presenting data-driven information or analysis results, especially to the general public. This has resulted in design principles being proposed for data-driven storytelling, and new authoring tools being created to aid such storytelling. However, data analysts typically lack sufficient background in design and storytelling to make effective use of these principles and authoring tools. To assist this process, we present ChartStory for crafting data stories from a collection of user-created charts, using a style akin to comic panels to imply the underlying sequence and logic of data-driven narratives. Our approach is to operationalize established design principles into an advanced pipeline that characterizes charts by their properties and similarities to each other, and recommends ways to partition, layout, and caption story pieces to serve a narrative. ChartStory also augments this pipeline with intuitive user interactions for visual refinement of generated data comics. We extensively and holistically evaluate ChartStory via a trio of studies. We first assess how the tool supports data comic creation in comparison to a manual baseline tool. Data comics from this study are subsequently compared and evaluated to ChartStory's automated recommendations by a team of narrative visualization practitioners. This is followed by a pair of interview studies with data scientists using their own datasets and charts who provide an additional assessment of the system. We find that ChartStory provides cogent recommendations for narrative generation, resulting in data comics that compare favorably to manually-created ones. Jian Zhao 0010, Shenyu Xu, Senthil K. Chandrasegaran, Chris Bryan, Fan Du, Aditi Mishra, Yiran Li 0002, Kwan-Liu Ma |
IEEE Trans. Vis. Comput. Graph. | 4 |
| 2022 | News Kaleidoscope: Visual Investigation of Coverage Diversity in News Event ReportingabstractWhen a newsworthy event occurs, media articles that report on the event can vary widely-a concept known as coverage diversity. To help investigate coverage diversity in event reporting, we de-velop a visual analytics system called News Kaleidoscope. News Kaleidoscope combines several backend language processing techniques with a coordinated visualization interface. Notably, News Kaleidoscope is tailored for visualization non-experts, and adopts an analytic workflow based around subselection analysis, whereby second-level features of articles are extracted to provide a more detailed and nuanced analysis of coverage diversity. To robustly evaluate News Kaleidoscope, we conduct a trio of user studies. (1) A study with news experts assesses the insights promoted for our targeted journalism-savvy users. (2) A follow-up study with news novices assesses the overall system and the specific insights pro-moted for journalism-agnostic users. (3) Based on identified system limitations in these two studies, we refine News Kaleidoscope's design and conduct a third study to validate these improvements. Results indicate that, for both news novice and experts, News Kalei-doscope supports an effective, task-driven workflow for analyzing the diversity of news coverage about events, though journalism expertise has a significant influence on the user's insights and take-aways. Our insights developing and evaluating News Kaleidoscope can aid future tools that combine visualization with natural language processing to analyze coverage diversity in news event reporting. Aditi Mishra, Shashank Ginjpalli, Chris Bryan |
PacificVis | 3 |
| 2022 | Why? Why not? When? Visual Explanations of Agent Behaviour in Reinforcement LearningabstractReinforcement learning (RL) is used in many domains, including autonomous driving, robotics, stock trading, and video games. Unfortunately, the black box nature of RL agents, combined with legal and ethical considerations, makes it increasingly important that humans (including those are who not experts in RL) understand the reasoning behind the actions taken by an RL agent, particularly in safety-critical domains. To help address this challenge, we introduce PolicyExplainer, a visual analytics interface which lets the user directly query an autonomous agent. PolicyExplainer visualizes the states, policy, and expected future rewards for an agent, and supports asking and answering questions such as: “Why take this action? Why not take this other action? When is this action taken?” PolicyExplainer is designed based upon a domain analysis with RL researchers, and is evaluated via qualitative and quantitative assessments on a trio of domains: taxi navigation, a stack bot domain, and drug recommendation for HIV patients. We find that PolicyExplainer's visual approach promotes trust and understanding of agent decisions better than a state-of-the-art text-based explanation approach. Interviews with domain practitioners provide further validation for PolicyExplainer as applied to safety-critical domains. Our results help demonstrate how visualization-based approaches can be leveraged to decode the behavior of autonomous RL agents, particularly for RL non-experts. Aditi Mishra, Utkarsh Soni, Jinbin Huang, Chris Bryan |
PacificVis | 4 |
| 2022 | Umbra: A Visual Analysis Approach for Defense Construction Against Inference Attacks on Sensitive InformationabstractCollecting and analyzing anonymous personal information is required as a part of data analysis processes, such as medical diagnosis and restaurant recommendation. Such data should ostensibly be stored so that specific individual information cannot be disclosed. Unfortunately, inference attacks-integrating background knowledge and intelligent models-hinder classic sanitization techniques like syntactic anonymity and differential privacy from exhaustively protecting sensitive information. As a solution, we introduce a three-stage approach empowered within a visual interface, which depicts underlying inference behaviors via a Bayesian Network and supports a customized defense against inference attacks from unknown adversaries. In particular, our approach visually explains the process details of the underlying privacy preserving models, allowing users to verify if the results sufficiently satisfy the requirements of privacy preservation. We demonstrate the effectiveness of our approach through two case studies and expert reviews. Xumeng Wang, Chris Bryan, Yiran Li 0002, Rusheng Pan, Wei Chen 0001, Kwan-Liu Ma |
IEEE Trans. Vis. Comput. Graph. | 2 |
| 2020 | Analyzing gaze behavior for text-embellished narrative visualizations under different task scenariosabstractWe conduct an eye tracking study to investigate perception text-embellished narrative visualizations under different task conditions. Study stimuli are data visualizations embellished with text-based elements: annotations, captions, labels, and descriptive text. We consider three common viewing tasks that occur when these types of graphics are viewed: (1) simple observation, (2) active search to answer a query, and (3) information memorization for later recall. The overarching goal is to understand, at a perceptual level, if and how task affects how these visualizations are interacted with. By analyzing collected gaze data and conducting advanced semantic scanpath analysis, we find, at a high level, diverse patterns of gaze behavior: simple observation and information memorization lead to similar optical viewing strategies, while active search significantly diverges, both in regards to which areas of the visualization are focused upon and how often embellishments are interacted with. We discuss study outcomes in the context of embellishing visualizations with text for various usage scenarios. Chris Bryan, Aditi Mishra, Hidekazu Shidara, Kwan-Liu Ma |
Vis. Informatics | 1 |
| 2019 | TalkTraces: Real-Time Capture and Visualization of Verbal Content in MeetingsabstractGroup Support Systems provide ways to review and edit shared content during meetings, but typically require participants to explicitly generate the content. Recent advances in speech-to-text conversion and language processing now make it possible to automatically record and review spoken information. We present the iterative design and evaluation of TalkTraces, a real-time visualization that helps teams identify themes in their discussions and obtain a sense of agenda items covered. We use topic modeling to identify themes within the discussions and word embeddings to compute the discussion "relatedness" to items in the meeting agenda. We evaluate TalkTraces iteratively: we first conduct a comparative between-groups study between two teams using TalkTraces and two teams using traditional notes, over four sessions. We translate the findings into changes in the interface, further evaluated by one team over four sessions. Based on our findings, we discuss design implications for real-time displays of discussion content. Senthil K. Chandrasegaran, Chris Bryan, Hidekazu Shidara, Tung-Yen Chuang, Kwan-Liu Ma |
CHI | 2 |
| 2019 | GraphProtector: A Visual Interface for Employing and Assessing Multiple Privacy Preserving Graph AlgorithmsabstractAnalyzing social networks reveals the relationships between individuals and groups in the data. However, such analysis can also lead to privacy exposure (whether intentionally or inadvertently): leaking the real-world identity of ostensibly anonymous individuals. Most sanitization strategies modify the graph's structure based on hypothesized tactics that an adversary would employ. While combining multiple anonymization schemes provides a more comprehensive privacy protection, deciding the appropriate set of techniques-along with evaluating how applying the strategies will affect the utility of the anonymized results-remains a significant challenge. To address this problem, we introduce GraphProtector, a visual interface that guides a user through a privacy preservation pipeline. GraphProtector enables multiple privacy protection schemes which can be simultaneously combined together as a hybrid approach. To demonstrate the effectiveness of GraphProtector, we report several case studies and feedback collected from interviews with expert users in various scenarios. Xumeng Wang, Wei Chen 0001, Jia-Kai Chou, Chris Bryan, Huihua Guan, Rusheng Pan, Kwan-Liu Ma |
IEEE Trans. Vis. Comput. Graph. | 4 |
| 2018 | An Empirical Study on Perceptually Masking Privacy in Graph VisualizationsabstractResearchers such as sociologists create visualizations of multivariate node-link diagrams to present findings about the relationships in communities. Unfortunately, such visualizations can inadvertently expose the ostensibly private identities of the persons that make up the dataset. By purposely violating graph readability metrics for a small region of the graph, we conjecture that local, exposed privacy leaks may be perceptually masked from easy recognition. In particular, we consider three commonly known metrics-edge crossing, node clustering, and node-edge overlapping-as a strategy to hide leaks. We evaluate the effectiveness of violating these metrics by conducting a user study that measures subject performance at visually searching for and identifying a privacy leak. Results show that when more masking operations are applied, participants needed more time to locate the privacy leak, though exhaustive, brute force search can eventually find it. We suggest future directions on how perceptual masking can be a viable strategy, primarily where modifying the underlying network structure is unfeasible. Jia-Kai Chou, Chris Bryan, Kwan-Liu Ma |
VizSEC | 2 |
| 2018 | Chart Constellations: Effective Chart Summarization for Collaborative and Multi-User AnalysesabstractAbstract Many data problems in the real world are complex and require multiple analysts working together to uncover embedded insights by creating chart‐driven data stories. How, as a subsequent analysis step, do we interpret and learn from these collections of charts? We present Chart Constellations, a system to interactively support a single analyst in the review and analysis of data stories created by other collaborative analysts. Instead of iterating through the individual charts for each data story, the analyst can project, cluster, filter, and connect results from all users in a meta‐visualization approach. Constellations supports deriving summary insights about prior investigations and supports the exploration of new, unexplored regions in the dataset. To evaluate our system, we conduct a user study comparing it against data science notebooks. Results suggest that Constellations promotes the discovery of both broad and high‐level insights, including theme and trend analysis, subjective evaluation, and hypothesis generation. Shenyu Xu, Chris Bryan, Jianping Kelvin Li, Jian Zhao 0010, Kwan-Liu Ma |
Comput. Graph. Forum | 2 |
| 2018 | MeetingVis: Visual Narratives to Assist in Recalling Meeting Context and ContentabstractIn team-based workplaces, reviewing and reflecting on the content from a previously held meeting can lead to better planning and preparation. However, ineffective meeting summaries can impair this process, especially when participants have difficulty remembering what was said and what its context was. To assist with this process, we introduce MeetingVis, a visual narrative-based approach to meeting summarization. MeetingVis is composed of two primary components: (1) a data pipeline that processes the spoken audio from a group discussion, and (2) a visual-based interface that efficiently displays the summarized content. To design MeetingVis, we create a taxonomy of relevant meeting data points, identifying salient elements to promote recall and reflection. These are mapped to an augmented storyline visualization, which combines the display of participant activities, topic evolutions, and task assignments. For evaluation, we conduct a qualitative user study with five groups. Feedback from the study indicates that MeetingVis effectively triggers the recall of subtle details from prior meetings: all study participants were able to remember new details, points, and tasks compared to an unaided, memory-only baseline. This visual-based approaches can also potentially enhance the productivity of both individuals and the whole team. Yang Shi 0007, Chris Bryan, Sridatt Bhamidipati, Ying Zhao 0001, Yaoxue Zhang, Kwan-Liu Ma |
IEEE Trans. Vis. Comput. Graph. | 2 |
| 2017 | Privacy preserving visualization for social network data with ontology informationabstractAnalyzing social network data helps sociologists understand the behaviors of individuals and groups as well as the relationships between them. With additional ontology information, the semantics behind the network structure can be further explored. Unfortunately, creating network visualizations with these datasets for presentation can inadvertently expose the private and sensitive information of individuals that reside in the data. To deal with this problem, we generalize conventional data anonymization models (originally designed for relational data) and formally apply them in the context of privacy preserving ontological network visualization. We use these models to identify the privacy leaks that exist in a visualization, provide graph modification actions that remove and/or perceptually minimize the effect of the identified leaks, and discuss strategies for what types of privacy actions to choose depending on the context of the leaks. We implement an ontological visualization interface with associated privacy preserving operations, and demonstrate with two case studies using real-world datasets to show that our approach can identify and solve potential privacy issues while balancing overall graph readability and utility. Jia-Kai Chou, Chris Bryan, Kwan-Liu Ma |
PacificVis | 2 |
| 2017 | Functional Requirements-Based Automated Testing for AvionicsabstractWe propose and demonstrate a method for the reduction of testing effort in safety-critical software development using DO-178 guidance. We achieve this through the application of Bounded Model Checking (BMC) to formal low-level requirements, in order to generate tests automatically that are good enough to replace existing labor-intensive test writing procedures while maintaining independence from implementation artefacts. Given that manual processes are often empirical and subjective, we begin by formally defining a metric, which extends recognized best practice from code coverage analysis strategies to generate tests that adequately cover the requirements. We then implement it in an automated requirements testing procedure and apply it in a case study with industrial partners. In review, the toolchain developed here is demonstrated to significantly reduce the human effort for the qualification of software products under DO-178 guidance. Youcheng Sun, Martin Brain, Daniel Kroening, Andrew Hawthorn, Thomas Wilson, Florian Schanda, Francisco Javier Guzman Jimenez, Simon Daniel, Chris Bryan, Ian Broster |
ICECCS | 9 |
| 2017 | Navigable Videos for Presenting Scientific Data on Affordable Head-Mounted DisplaysabstractImmersive, stereoscopic visualization enables scientists to better analyze structural and physical phenomena compared to traditional display mediums. Unfortunately, current head-mounted displays (HMDs) with the high rendering quality necessary for these complex datasets are prohibitively expensive, especially in educational settings where their high cost makes it impractical to buy several devices. To address this problem, we develop two tools: (1) An authoring tool allows domain scientists to generate a set of connected, 360° video paths for traversing between dimensional keyframes in the dataset. (2) A corresponding navigational interface is a video selection and playback tool that can be paired with a low-cost HMD to enable an interactive, non-linear, storytelling experience. We demonstrate the authoring tool's utility by conducting several case studies and assess the navigational interface with a usability study. Results show the potential of our approach in effectively expanding the accessibility of high-quality, immersive visualization to a wider audience using affordable HMDs. Jacqueline Chu, Chris Bryan, Min Shih, Leonardo Ferrer, Kwan-Liu Ma |
MMSys | 2 |
| 2017 | Synteny Explorer: An Interactive Visualization Application for Teaching Genome EvolutionabstractRapid advances in biology demand new tools for more active research dissemination and engaged teaching. This paper presents Synteny Explorer, an interactive visualization application designed to let college students explore genome evolution of mammalian species. The tool visualizes synteny blocks: segments of homologous DNA shared between various extant species that can be traced back or reconstructed in extinct, ancestral species. We take a karyogram-based approach to create an interactive synteny visualization, leading to a more appealing and engaging design for undergraduate-level genome evolution education. For validation, we conduct three user studies: two focused studies on color and animation design choices and a larger study that performs overall system usability testing while comparing our karyogram-based designs with two more common genome mapping representations in an educational context. While existing views communicate the same information, study participants found the interactive, karyogram-based views much easier and likable to use. We additionally discuss feedback from biology and genomics faculty, who judge Synteny Explorer's fitness for use in classrooms. Chris Bryan, Gregory Guterman, Kwan-Liu Ma, Harris A. Lewin, Denis M. Larkin, Jaebum Kim, Jian Ma 0004, Marta Farre |
IEEE Trans. Vis. Comput. Graph. | 1 |
| 2017 | Temporal Summary Images: An Approach to Narrative Visualization via Interactive Annotation Generation and PlacementabstractVisualization is a powerful technique for analysis and communication of complex, multidimensional, and time-varying data. However, it can be difficult to manually synthesize a coherent narrative in a chart or graph due to the quantity of visualized attributes, a variety of salient features, and the awareness required to interpret points of interest (POls). We present Temporal Summary Images (TSIs) as an approach for both exploring this data and creating stories from it. As a visualization, a TSI is composed of three common components: (1) a temporal layout, (2) comic strip-style data snapshots, and (3) textual annotations. To augment user analysis and exploration, we have developed a number of interactive techniques that recommend relevant data features and design choices, including an automatic annotations workflow. As the analysis and visual design processes converge, the resultant image becomes appropriate for data storytelling. For validation, we use a prototype implementation for TSIs to conduct two case studies with large-scale, scientific simulation datasets. Chris Bryan, Kwan-Liu Ma, Jonathan Woodring |
IEEE Trans. Vis. Comput. Graph. | 1 |
| 2013 | An interactive visualization interface for studying egocentric, categorical, contact diary datasetsabstractContact diaries are interpersonal communication logs which are obtained in sociological and epidemiological studies. These logs can be used to study the social patterns of communities over a period of time. A dataset composed of diaries maps well to a set of one-tiered, categorical, independent and egocentric networks. This paper presents an interface for visualization and analysis of contact diaries datasets using an interactive radial mapping scheme, with case studies illustrating a standard workflow using the application. We facilitate individual diary analysis, multi-dataset comparison, and an overlay interface for investigating a set of many diaries in a singular space. With this interface, network researchers can utilize visualization to enhance their analysis of contact diaries. Chris Bryan, Kwan-Liu Ma, Yang-chih Fu |
ASONAM | 1 |