Yang Ouyang

dblp:219/0672 · DBLP profile ↗
← Back
16ranked-venue papers
7as first author
16since 2021 · last 2026
0009-0000-5841-7659ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 8 · 4 first-author · 8 since 2021Graphics, computer vision, multimedia, augmented reality and games · 7 · 3 first-author · 7 since 2021Artificial intelligence and machine learning · 3 · 2 first-author · 3 since 2021
YearPublicationVenuePosition
2026 MediMate: Co-Crafting Patient-Centered Medical Explanations Using LLMs as a Rehearsal Partner
abstract
Effective patient-provider communication is often hindered by disparities in medical knowledge and the use of technical jargon. Although analogies and metaphors can help bridge this gap, physicians struggle to generate them under clinical time pressure, highlighting a need for supportive design. Through formative interviews with patients and physicians, we identified requirements for explanatory tools that are clear, accurate, and context-sensitive. In response, we designed MediMate, an interactive system that allows physicians to rehearse and iteratively refine patient-friendly explanations using LLM-generated analogies in a low-stakes setting. The interface of MediMate is designed to scaffold the creative process, helping physicians balance clarity with medical accuracy. In a user study involving both physicians and patients, we found that explanations developed with MediMate enhanced communication efficiency by providing such scaffolding. Physicians reported increased self-efficacy and perceived value in using the system as a practice tool for developing their communication skills. Our work demonstrates how interactive AI-powered tools can support clinical communication rehearsal and offers insights for the design of future clinical decision-support and educational tools.
Shizhen Zhang, Dongjun Chen, Yang Ouyang, Yuheng Shao, Chang Jiang 0001, Hanlu Li, Quan Li 0002
DIS4
2026 SpikingIR: A Novel Converted Spiking Neural Network for Efficient Image Restoration
abstract
Image restoration has made great progress with the rise of deep learning, but its energy consumption limits its real-world applications. Spiking Neural Networks (SNNs) are seen as energy-efficient alternatives to Artificial Neural Networks (ANNs). Applying SNNs to image restoration (IR) remains challenging, primarily due to the limited information capacity of spike-based signals. This limitation leads to quantization errors and information loss, while IR tasks are highly sensitive to output precision and error. Thus, the restoration performance suffers significantly. To address this challenge, we propose SpikingIR, an ANN-to-SNN conversion framework for IR that reduces information loss and quantization error. SpikingIR mainly consists of two components: Convolutional Pixel Mapping (CPM) and Membrane Potential Reuse Neuron (MPRN), which are designed to alleviate quantization errors and information loss in the output and intermediate layers, respectively. Specifically, CPM maps discrete outputs into a continuous space, better aligning with pixel-level details. From the perspective of information entropy, we show that outputs of CPM contain more information than the original outputs. MPRN introduces a post-processing step with relaxed firing conditions to extract residual membrane potential, reducing information waste. Furthermore, we fine-tune the converted model to jointly optimize both accuracy and energy efficiency. Experimental results demonstrate that SpikingIR achieves performance comparable to ANN counterparts across various IR benchmarks while reducing energy consumption by up to 50%.
Yang Ouyang, Xiaotong Luo, Yanyun Qu
AAAI1
2026 CommSense: Facilitating Bias-Aware and Reflective Navigation of Online Comments for Rational Judgment
abstract
Online comments significantly influence users’ judgments, yet their presentation, often determined by platform algorithms, can introduce biases, such as anchoring effects, which distort reasoning. While existing research emphasizes mitigating individual cognitive biases, the evolution of user judgments during comment engagement remains overlooked. This study investigates how presentation cues impact reasoning and explores interface design strategies to mitigate bias. Through a preliminary experiment (N=18) and a co-design workshop, we identified key challenges users face across a four-stage process and distilled four design requirements: pre-engagement framing, interactive organization, reflective prompts, and synthesis support. Based on these insights, we developed CommSense, an on-the-fly plugin that enhances user engagement with online comments by providing visual overviews and lightweight prompts to guide reasoning. A between-subject evaluation (N=24) demonstrates that CommSense improves bias awareness and reflective thinking, helping users produce more comprehensive, evidence-based rationales while maintaining high usability.
Yang Ouyang, Ruichuan Wang, Hailiang Zhu, Yuheng Shao, Xiaoyu Gu, Quan Li 0002
CHI1
2026 CaseMaster: Designing and Evaluating a Probe for Oral Case Presentation Training with LLM Assistance
abstract
Preparing an oral case presentation (OCP) is a crucial skill for medical students, requiring clear communication of patient information, clinical findings, and treatment plans. However, inconsistent student participation and limited guidance can make this task challenging. While Large Language Models (LLMs) can provide structured content to streamline the process, their role in facilitating skill development and supporting medical education integration remains underexplored. To address this, we conducted a formative study with six medical educators and developed CaseMaster, an interactive probe that leverages LLM-generated content tailored to medical education to help users enhance their OCP skills. The controlled study suggests CaseMaster has the potential to both improve presentation quality and reduce workload compared to traditional methods, an implication reinforced by expert feedback. We propose guidelines for educators to develop adaptive, user-centered training methods using LLMs, while considering the implications of integrating advanced technologies into medical education.
Yang Ouyang, Yuansong Xu, Chang Jiang 0001, Quan Li 0002
CHI1
2026 WordCraft: Scaffolding the Keyword Method for L2 Vocabulary Learning with Multimodal LLMs
abstract
Applying the keyword method for vocabulary memorization remains a significant challenge for L1 Chinese–L2 English learners. They frequently struggle to generate phonologically appropriate keywords, construct coherent associations, and create vivid mental imagery to aid long-term retention. Existing approaches, including fully automated keyword generation and outcome-oriented mnemonic aids, either compromise learner engagement or lack adequate process-oriented guidance. To address these limitations, we conducted a formative study with L1 Chinese-L2 English learners and educators (N=18), which revealed key difficulties and requirements in applying the keyword method to vocabulary learning. Building on these insights, we introduce WordCraft, a learner-centered interactive tool powered by Multimodal Large Language Models (MLLMs). WordCraft scaffolds the keyword method by guiding learners through keyword selection, association construction, and image formation, thereby enhancing the effectiveness of vocabulary memorization. Two user studies demonstrate that WordCraft not only preserves the generation effect but also achieves high levels of effectiveness and usability.
Yuheng Shao, Chaoran Wu, Yang Ouyang, Qinyi Tao, Quan Li 0002
CHI6
2026 "Do I Trust the AI?" Towards Trustworthy AI-Assisted Diagnosis: Understanding User Perception in LLM-Supported Clinical Reasoning
abstract
Large language models (LLMs) have shown considerable potential in supporting medical diagnosis. However, their effective integration into clinical workflows is hindered by physicians’ difficulties in perceiving and trusting LLM capabilities, which often results in miscalibrated trust. Existing model evaluations primarily emphasize standardized benchmarks and predefined tasks, offering limited insights into clinical reasoning practices. Moreover, research on human–AI collaboration has rarely examined physicians’ perceptions of LLMs’ clinical reasoning capability. In this work, we investigate how physicians perceive LLMs’ capabilities in the clinical reasoning process. We designed clinical cases, collected the corresponding analyses, and obtained evaluations from physicians (N=37) to quantitatively represent their perceived LLM diagnostic capabilities. By comparing the perceived evaluations with benchmark performance, our study highlights the aspects of clinical reasoning that physicians value and underscores the limitations of benchmark-based evaluation. We further discuss the implications of opportunities for enhancing trustworthy collaboration between physicians and LLMs in LLM-supported clinical reasoning.
Yuansong Xu, Haokai Wang, Yang Ouyang, Hanlu Li, Wenzhe Zhou, Chang Jiang 0001, Quan Li 0002
CHI5
2025 Min-K%++: Improved Baseline for Pre-Training Data Detection from Large Language Models
abstract
The problem of pre-training data detection for large language models (LLMs) has received growing attention due to its implications in critical issues like copyright violation and test data contamination. Despite improved performance, existing methods (including the state-of-the-art, Min-K%) are mostly developed upon simple heuristics and lack solid, reasonable foundations. In this work, we propose a novel and theoretically motivated methodology for pre-training data detection, named Min-K%++. Specifically, we present a key insight that training samples tend to be local maxima of the modeled distribution along each input dimension through maximum likelihood training, which in turn allow us to insightfully translate the problem into identification of local maxima. Then, we design our method accordingly that works under the discrete distribution modeled by LLMs, whose core idea is to determine whether the input forms a mode or has relatively high probability under the conditional categorical distribution. Empirically, the proposed method achieves new SOTA performance across multiple settings (evaluated with 5 families of 10 models and 2 benchmarks). On the WikiMIA benchmark, Min-K%++ outperforms the runner-up by 6.2% to 10.5% in detection AUROC averaged over five models. On the more challenging MIMIR benchmark, it consistently improves upon reference-free methods while performing on par with reference-based method that requires an extra reference model.
Jingyang Zhang, Jingwei Sun 0002, Eric C. Yeats, Yang Ouyang, Martin Kuo, Hao (Frank) Yang, Hai Li 0001
ICLR4
2025 Layer-Level Self-Exposure and Patch: Affirmative Token Mitigation for Jailbreak Attack Defense
abstract
Yang Ouyang, Hengrui Gu, Shuhang Lin, Wenyue Hua, Jie Peng, Bhavya Kailkhura, Meijun Gao, Tianlong Chen, Kaixiong Zhou. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2025.
Yang Ouyang, Hengrui Gu 0002, Shuhang Lin, Wenyue Hua, Jie Peng 0002, Bhavya Kailkhura, Meijun Gao, Tianlong Chen 0001, Kaixiong Zhou
NAACL (Long Papers)1
2025 PaperBridge: Crafting Research Narratives through Human-AI Co-Exploration
abstract
Researchers frequently need to synthesize their own publications into coherent narratives that demonstrate their scholarly contributions.To suit diverse communication contexts, exploring alternative ways to organize one's work while maintaining coherence is particularly challenging, especially in interdisciplinary fields like HCI where individual researchers' publications may span diverse domains and methodologies.In this paper, we present PaperBridge, a human-AI co-exploration system informed by a formative study and content analysis.PaperBridge assists researchers in exploring diverse perspectives for organizing their publications into coherent narratives.At its core is a bi-directional analysis engine powered by large language models, supporting iterative exploration through both top-down user intent (e.g., determining organization structure) and bottom-up refinement on narrative components (e.g., thematic paper groupings).Our user study (N=12) demonstrated PaperBridge's usability and effectiveness in facilitating the exploration of alternative research narratives.Our findings also provided empirical insights into how interactive systems can scaffold academic communication tasks.
Runhua Zhang 0001, Yang Ouyang, Leixian Shen, Yuying Tang, Xiaojuan Ma, Huamin Qu
UIST2
2025 KMTLabeler: An Interactive Knowledge-Assisted Labeling Tool for Medical Text Classification
abstract
The process of labeling medical text plays a crucial role in medical research. Nonetheless, creating accurately labeled medical texts of high quality is often a time-consuming task that requires specialized domain knowledge. Traditional methods for generating labeled data typically rely on rigid rule-based approaches, which may not adapt well to new tasks. While recent machine learning (ML) methodologies have mitigated the manual labeling efforts, configuring models to align with specific research requirements can be challenging for labelers without technical expertise. Moreover, automated labeling techniques, such as transfer learning, face difficulties in in directly incorporating expert input, whereas semi-automated methods, like data programming, allow knowledge integration through rules or knowledge bases but may lack continuous result refinement throughout the entire labeling process. In this study, we present a collaborative human-ML teaming workflow that seamlessly integrates visual cluster analysis and active learning to assist domain experts in labeling medical text with high efficiency. Additionally, we introduce an innovative neural network model called the embedding network, which incorporates expert insights to generate task-specific embeddings for medical texts. We integrate the workflow and embedding network into a visual analytics tool named KMTLabeler, equipped with coordinated multi-level views and interactions. Two illustrative case studies, along with a controlled user study, provide substantial evidence of the effectiveness of KMTLabeler in creating an efficient labeling environment for medical text classification.
He Wang 0053, Yang Ouyang, Chang Jiang 0001, Lixia Jin, Yuanwu Cao, Quan Li 0002
IEEE Trans. Vis. Comput. Graph.2
2024 NotePlayer: Engaging Computational Notebooks for Dynamic Presentation of Analytical Processes
abstract
Diverse presentation formats play a pivotal role in effectively conveying code and analytical processes during data analysis. One increasingly popular format is tutorial videos, particularly those based on Jupyter notebooks, which offer an intuitive interpretation of code and vivid explanations of analytical procedures. However, creating such videos requires a diverse skill set and significant manual effort, posing a barrier for many analysts. To bridge this gap, we introduce an innovative tool called NotePlayer, which connects notebook cells to video segments and incorporates a computational engine with language models to streamline video creation and editing. Our aim is to make the process more accessible and efficient for analysts. To inform the design of NotePlayer, we conducted a formative study and performed content analysis on a corpus of 38 Jupyter tutorial videos. This helped us identify key patterns and challenges encountered in existing tutorial videos, guiding the development of NotePlayer. Through a combination of a usage scenario and a user study, we validated the effectiveness of NotePlayer. The results show that the tool streamlines the video creation and facilitates the communication process for data analysts.
Yang Ouyang, Leixian Shen, Yun Wang 0012, Quan Li 0002
UIST1
2024 A Two-Phase Visualization System for Continuous Human-AI Collaboration in Sequelae Analysis and Modeling
abstract
In healthcare, AI techniques are widely used for tasks like risk assessment and anomaly detection. Despite AI’s potential as a valuable assistant, its role in complex medical data analysis often over-simplifies human-AI collaboration dynamics. To address this, we collaborated with a local hospital, engaging six physicians and one data scientist in a formative study. From this collaboration, we propose a framework integrating two-phase interactive visualization systems: one for Human-Led, AI-Assisted Retrospective Analysis and another for AI-Mediated, Human-Reviewed Iterative Modeling. This framework aims to enhance understanding and discussion around effective human-AI collaboration in healthcare.
Yang Ouyang, Chenyang Zhang 0002, He Wang 0053, Tianle Ma, Chang Jiang 0001, Yuheng Yan, Zuoqin Yan, Xiaojuan Ma, Chuhan Shi, Quan Li 0002
IEEE VIS1
2024 FSLens: A Visual Analytics Approach to Evaluating and Optimizing the Spatial Layout of Fire Stations
abstract
The provision of fire services plays a vital role in ensuring the safety of residents' lives and property. The spatial layout of fire stations is closely linked to the efficiency of fire rescue operations. Traditional approaches have primarily relied on mathematical planning models to generate appropriate layouts by summarizing relevant evaluation criteria. However, this optimization process presents significant challenges due to the extensive decision space, inherent conflicts among criteria, and decision-makers' preferences. To address these challenges, we propose FSLens, an interactive visual analytics system that enables in-depth evaluation and rational optimization of fire station layout. Our approach integrates fire records and correlation features to reveal fire occurrence patterns and influencing factors using spatiotemporal sequence forecasting. We design an interactive visualization method to explore areas within the city that are potentially under-resourced for fire service based on the fire distribution and existing fire station layout. Moreover, we develop a collaborative human-computer multi-criteria decision model that generates multiple candidate solutions for optimizing firefighting resources within these areas. We simulate and compare the impact of different solutions on the original layout through well-designed visualizations, providing decision-makers with the most satisfactory solution. We demonstrate the effectiveness of our approach through one case study with real-world datasets. The feedback from domain experts indicates that our system helps them to better identify and improve potential gaps in the current fire station layout.
He Wang 0053, Yang Ouyang, Naiyu Wang, Quan Li 0002
IEEE Trans. Vis. Comput. Graph.3
2024 Leveraging Historical Medical Records as a Proxy via Multimodal Modeling and Visualization to Enrich Medical Diagnostic Learning
abstract
Simulation-based Medical Education (SBME) has been developed as a cost-effective means of enhancing the diagnostic skills of novice physicians and interns, thereby mitigating the need for resource-intensive mentor-apprentice training. However, feedback provided in most SBME is often directed towards improving the operational proficiency of learners, rather than providing summative medical diagnoses that result from experience and time. Additionally, the multimodal nature of medical data during diagnosis poses significant challenges for interns and novice physicians, including the tendency to overlook or over-rely on data from certain modalities, and difficulties in comprehending potential associations between modalities. To address these challenges, we present DiagnosisAssistant, a visual analytics system that leverages historical medical records as a proxy for multimodal modeling and visualization to enhance the learning experience of interns and novice physicians. The system employs elaborately designed visualizations to explore different modality data, offer diagnostic interpretive hints based on the constructed model, and enable comparative analyses of specific patients. Our approach is validated through two case studies and expert interviews, demonstrating its effectiveness in enhancing medical training.
Yang Ouyang, He Wang 0053, Chenyang Zhang 0002, Furui Cheng, Chang Jiang 0001, Lixia Jin, Yuanwu Cao, Quan Li 0002
IEEE Trans. Vis. Comput. Graph.1
2024 Towards Better Modeling With Missing Data: A Contrastive Learning-Based Visual Analytics Perspective
abstract
Missing data can pose a challenge for machine learning (ML) modeling. To address this, current approaches are categorized into feature imputation and label prediction and are primarily focused on handling missing data to enhance ML performance. These approaches rely on the observed data to estimate the missing values and therefore encounter three main shortcomings in imputation, including the need for different imputation methods for various missing data mechanisms, heavy dependence on the assumption of data distribution, and potential introduction of bias. This study proposes a Contrastive Learning (CL) framework to model observed data with missing values, where the ML model learns the similarity between an incomplete sample and its complete counterpart and the dissimilarity between other samples. Our proposed approach demonstrates the advantages of CL without requiring any imputation. To enhance interpretability, we introduce CIVis, a visual analytics system that incorporates interpretable techniques to visualize the learning process and diagnose the model status. Users can leverage their domain knowledge through interactive sampling to identify negative and positive pairs in CL. The output of CIVis is an optimized model that takes specified features and predicts downstream tasks. We provide two usage scenarios in regression and classification tasks and conduct quantitative experiments, expert interviews, and a qualitative user study to demonstrate the effectiveness of our approach. In short, this study offers a valuable contribution to addressing the challenges associated with ML modeling in the presence of missing data by providing a practical solution that achieves high predictive accuracy and model interpretability.
Laixin Xie, Yang Ouyang, Ziming Wu, Quan Li 0002
IEEE Trans. Vis. Comput. Graph.2
2023 RISeer: Inspecting the Status and Dynamics of Regional Industrial Structure via Visual Analytics
abstract
Restructuring the regional industrial structure (RIS) has the potential to halt economic recession and achieve revitalization. Understanding the current status and dynamics of RIS will greatly assist in studying and evaluating the current industrial structure. Previous studies have focused on qualitative and quantitative research to rationalize RIS from a macroscopic perspective. Although recent studies have traced information at the industrial enterprise level to complement existing research from a micro perspective, the ambiguity of the underlying variables contributing to the industrial sector and its composition, the dynamic nature, and the large number of multivariant features of RIS records have obscured a deep and fine-grained understanding of RIS. To this end, we propose an interactive visualization system, RISeer, which is based on interpretable machine learning models and enhanced visualizations designed to identify the evolutionary patterns of the RIS and facilitate inter-regional inspection and comparison. Two case studies confirm the effectiveness of our approach, and feedback from experts indicates that RISeer helps them to gain a fine-grained understanding of the dynamics and evolution of the RIS.
Yang Ouyang, Haipeng Zhang 0004, Suting Hong, Quan Li 0002
IEEE Trans. Vis. Comput. Graph.2