a) Fast Tracking Speed (b) Slow Tracking Speed Figure 1: ForcePinch is an object manipulation method that allows users to control the tracking speed of a mid-air pointer by modulating pinch force during object manipulation.(a) A light pinch results in fast tracking, supporting broad and rapid movements.(b) A heavy pinch produces slow tracking, allowing for fine-grained precision.

Upon completing the design and training phases, deploying a deep learning model to specific hardware becomes necessary prior to its implementation in practical applications. To enhance the performance of the model, the developers must optimize it to decrease inference latency. Auto-scheduling, an automated approach that generates optimization schemes, offers a feasible option for large-scale auto-deployment. Nevertheless, the low-level code generated by auto-scheduling closely resembles hardware coding and may present challenges for human comprehension, thereby hindering future manual optimization efforts. In this study, we introduce ASight, a visual analytics system to assist engineers in identifying performance bottlenecks, comprehending the auto-generated low-level code, and obtaining insights from auto-scheduling optimizations. We develop a subgraph matching algorithm capable of identifying graph isomorphism among Intermediate Representations to track performance bottlenecks from low-level metrics to high-level computational graphs. To address the substantial profiling metrics involved in auto-scheduling and derive optimization design principles by summarizing commonalities among auto-scheduling optimizations, we propose an enhanced visualization for the large search space of auto-scheduling. We validate the effectiveness of ASight through two case studies, one focused on a local machine and the other on a data center, along with a quantitative experiment exploring optimization design principles.

Gaze interaction presents a promising avenue in Virtual Reality (VR) due to its intuitive and efficient user experience. Yet, the depth control inherent in our visual system remains underutilized in current methods. In this study, we introduce FocusFlow, a hands-free interaction method that capitalizes on human visual depth perception within the 3D scenes of Virtual Reality. We first develop a binocular visual depth detection algorithm to understand eye input characteristics. We then propose a layer-based user interface and introduce the concept of “Virtual Window” that offers an intuitive and robust gaze-depth VR interaction, despite the constraints of visual depth accuracy and precision spatially at further distances. Finally, to help novice users actively manipulate their visual depth, we propose two learning strategies that use different visual cues to help users master visual depth control. Our user studies on 24 participants demonstrate the usability of our proposed virtual window concept as a gaze-depth interaction method. In addition, our findings reveal that the user experience can be enhanced through an effective learning process with adaptive visual cues, helping users to develop muscle memory for this brand-new input mechanism. We conclude the paper by discussing potential future research topics of gaze-depth interaction.

In healthcare, AI techniques are widely used for tasks like risk assessment and anomaly detection. Despite AI’s potential as a valuable assistant, its role in complex medical data analysis often over-simplifies human-AI collaboration dynamics. To address this, we collaborated with a local hospital, engaging six physicians and one data scientist in a formative study. From this collaboration, we propose a framework integrating two-phase interactive visualization systems: one for Human-Led, AI-Assisted Retrospective Analysis and another for AI-Mediated, Human-Reviewed Iterative Modeling. This framework aims to enhance understanding and discussion around effective human-AI collaboration in healthcare.

Simulation-based Medical Education (SBME) has been developed as a cost-effective means of enhancing the diagnostic skills of novice physicians and interns, thereby mitigating the need for resource-intensive mentor-apprentice training. However, feedback provided in most SBME is often directed towards improving the operational proficiency of learners, rather than providing summative medical diagnoses that result from experience and time. Additionally, the multimodal nature of medical data during diagnosis poses significant challenges for interns and novice physicians, including the tendency to overlook or over-rely on data from certain modalities, and difficulties in comprehending potential associations between modalities. To address these challenges, we present DiagnosisAssistant, a visual analytics system that leverages historical medical records as a proxy for multimodal modeling and visualization to enhance the learning experience of interns and novice physicians. The system employs elaborately designed visualizations to explore different modality data, offer diagnostic interpretive hints based on the constructed model, and enable comparative analyses of specific patients. Our approach is validated through two case studies and expert interviews, demonstrating its effectiveness in enhancing medical training.

Promotions are commonly used by e-commerce merchants to boost sales. The efficacy of different promotion strategies can help sellers adapt their offering to customer demand in order to survive and thrive. Current approaches to designing promotion strategies are either based on econometrics, which may not scale to large amounts of sales data, or are spontaneous and provide little explanation of sales volume. Moreover, accurately measuring the effects of promotion designs and making bootstrappable adjustments accordingly remains a challenge due to the incompleteness and complexity of the information describing promotion strategies and their market environments. We present PromotionLens, a visual analytics system for exploring, comparing, and modeling the impact of various promotion strategies. Our approach combines representative multivariant time-series forecasting models and well-designed visualizations to demonstrate and explain the impact of sales and promotional factors, and to support "what-if" analysis of promotions. Two case studies, expert feedback, and a qualitative user study demonstrate the efficacy of PromotionLens.

Chest X-ray is an important imaging method for the diagnosis of chest diseases. Chest radiograph diagnostic quality assessment is vital for the diagnosis of the disease because unqualified radiographs have negative impacts on doctors' diagnosis and thus increase the burden on patients due to the re-acquirement of the radiographs. So far no algorithms and public data sets have been developed for chest radiograph diagnostic quality assessment. Towards effective chest X-ray diagnostic quality assessment, we analyze the image characteristics of four main chest radiograph diagnostic quality issues, i.e. Scapula Overlapping Lung, Artifact, Lung Field Loss, and Clavicle Unflatness. Our experiments show that general image classification methods are not competent for the task because the detailed information used for quality assessment by radiologists cannot be fully exploited by deep CNNs and image-level annotations. Then we propose to leverage a multi-label semantic segmentation framework to find the problematic regions, and then classify the quality issues based on the results of segmentation. However, subsequent classification is often negatively affected by certain small segmentation errors. Therefore, we propose to estimate a distance map that measures the distance from a pixel to its nearest segment, and use it to force the prediction of semantic segmentation more holistic and suitable for classification. Extensive experiments validate the effectiveness of our semantic-segmentation-based solution for chest X-ray diagnostic quality assessment. However, general segmentation-based algorithms requires fine pixel-wise annotations in the era of deep learning. In order to reduce reliance on fine annotations and further validate how important pixel-wise annotations are, weak supervision for segmentation is applied, and demonstrates its ability close to that of full supervision. Finally, we present ChestX-rayQuality, a chest radiograph data set, which comprises 480 frontal-view chest radiographs with semantic segmentation annotations and four labels of quality issue. Also, other 1212 chest radiographs with limited annotations are imported to validate our algorithms and arguments on larger data set. These two data set will be made publicly available.