EDBT 2026 Demo / reviewers in the wild / expert
Won Hwa Kim
dblp:12/10278
· DBLP profile ↗
53ranked-venue papers
8as first author
42since 2021 · last 2026
—ORCID · conflict
Domains — the database's venue-derived domains; a paper can count in several
Graphics, computer vision, multimedia, augmented reality and games · 39 · 7 first-author · 29 since 2021Applied, interdisciplinary, general and emerging computing · 27 · 1 first-author · 24 since 2021Artificial intelligence and machine learning · 24 · 7 first-author · 16 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | HiMix : Hierarchical Visual-Textual Mixing Network for Lesion SegmentationabstractLesion segmentation is an essential task in medical imaging to support diagnosis and assessment of pathologies. While deep learning models have shown success in various domains, their reliance on large-scale annotated datasets limits applicability in the medical domain due to labeling cost. To address this issue, recent studies in medical image segmentation have utilized clinical texts as complementary semantic cues without additional annotations. However, most existing methods utilize a single textual embedding and fail to capture hierarchical interactions between language and visual features, which limits their ability to leverage fine-grained cues essential for precise and detailed segmentation. In this regime, we propose Hierarchical Visual-Textual Mixing Network (HiMix), a novel multi-modal segmentation framework that mixes multi-scale image and text representations throughout the mask decoding process. HiMix progressively injects hierarchical text embedding, from high-level semantics to fine-grained spatial details, into corresponding image decoder layers to bridge the modality gap and enhance visual feature refinement at multiple levels of abstraction. Experiments on the QaTa-COV19, MosMed-Data+ and Kvasir-SEG datasets demonstrate that HiMix consistently outperforms uni-modal and multi-modal methods. Furthermore, HiMix exhibits strong generalization to unstructured textual formats, highlighting its practical applicability in real-world clinical scenarios. Soojin Hwang, Jaeyoon Sim, Won Hwa Kim |
WACV | 3 |
| 2025 | Improving Sound Source Localization with Joint Slot Attention on Image and AudioabstractSound source localization (SSL) is the task of locating the source of sound within an image. Due to the lack of localization labels, the de facto standard in SSL has been to represent an image and audio as a single embedding vector each, and use them to learn SSL via contrastive learning. To this end, previous work samples one of local image features as the image embedding and aggregates all local audio features to obtain the audio embedding, which is far from optimal due to the presence of noise and background irrelevant to the actual target in the input. We present a novel SSL method that addresses this chronic issue by joint slot attention on image and audio. To be specific, two slots competitively attend image and audio features to decompose them into target and off-target representations, and only target representations of image and audio are used for contrastive learning. Also, we introduce cross-modal attention matching to further align local features of image and audio. Our method achieved the best in almost all settings on three public benchmarks for SSL, and substantially outperformed all the prior work in cross-modal retrieval. Inho Kim, Youngkil Song, Jicheol Park, Won Hwa Kim, Suha Kwak |
CVPR | 4 |
| 2025 | Conditional Diffusion with Ordinal Regression: Longitudinal Data Generation for Neurodegenerative Disease StudiesabstractModeling the progression of neurodegenerative diseases such as Alzheimer’s disease (AD) is crucial for early detection and prevention given their irreversible nature. However, the scarcity of longitudinal data and complex disease dynamics make the analysis highly challenging. Moreover, longitudinal samples often contain irregular and large intervals between subject visits, which underscore the necessity for advanced data generation techniques that can accurately simulate disease progression over time. In this regime, we propose a novel conditional generative model for synthesizing longitudinal sequences and present its application to neurodegenerative disease data generation conditioned on multiple time-dependent ordinal factors, such as age and disease severity. Our method sequentially generates continuous data by bridging gaps between sparse data points with a diffusion model, ensuring a realistic representation of disease progression. The synthetic data are curated to integrate both cohort-level and individual-specific characteristics, where the cohort-level representations are modeled with an ordinal regression to capture longitudinally monotonic behavior. Extensive experiments on four AD biomarkers validate the superiority of our method over nine baseline approaches, highlighting its potential to be applied to a variety of longitudinal data generation. Hyuna Cho, Ziquan Wei, Seungjoo Lee, Tingting Dan, Guorong Wu 0001, Won Hwa Kim |
ICLR | 6 |
| 2025 | HGM³: Hierarchical Generative Masked Motion Modeling with Hard Token MiningabstractText-to-motion generation has significant potential in a wide range of applications including animation, robotics, and AR/VR. While recent works on masked motion models are promising, the task remains challenging due to the inherent ambiguity in text and the complexity of human motion dynamics. To overcome the issues, we propose a novel text-to-motion generation framework that integrates two key components: Hard Token Mining (HTM) and a Hierarchical Generative Masked Motion Model (HGM³). Our HTM identifies and masks challenging regions in motion sequences and directs the model to focus on hard-to-learn components for efficacy. Concurrently, the hierarchical model uses a semantic graph to represent sentences at different granularity, allowing the model to learn contextually feasible motions. By leveraging a shared-weight masked motion model, it reconstructs the same sequence under different conditioning levels and facilitates comprehensive learning of complex motion patterns. During inference, the model progressively generates motions by incrementally building up coarse-to-fine details. Extensive experiments on benchmark datasets, including HumanML3D and KIT-ML, demonstrate that our method outperforms existing methods in both qualitative and quantitative measures for generating context-aware motions. Minjae Jeong, Yechan Hwang, Jaejin Lee, Sungyoon Jung, Won Hwa Kim |
ICLR | 5 |
| 2025 | MNM: Multi-level Neuroimaging Meta-analysis with Hyperbolic Brain-Text Representations
Seunghun Baek, Jaejin Lee, Jaeyoon Sim, Minjae Jeong, Won Hwa Kim |
MICCAI (1) | 5 |
| 2025 | Adaptive Adversarial Data Augmentation with Trajectory Constraint for Alzheimer's Disease Conversion Prediction
Hyuna Cho, Hayoung Ahn, Guorong Wu 0001, Won Hwa Kim |
MICCAI (7) | 4 |
| 2025 | MindLink: Subject-Agnostic Cross-Subject Brain Decoding Framework
Sungyoon Jung, Won Hwa Kim |
MICCAI (12) | 3 |
| 2025 | DISCLOSE the Neurodegeneration Dynamics: Individualized ODE Discovery for Alzheimer's Disease Precision Medicine
Wooseok Jung, Joonhyuk Park, Won Hwa Kim |
MICCAI (15) | 3 |
| 2025 | Improved Tumor Segmentation Using Selective Synthetic Augmentation for Enhanced Surgical Planning in Breast MRI
Miguel Luna, John Baek, Won Hwa Kim, Wan Gyu Son, Kwang Min Lee, Hye Jung Kim, Jaeil Kim |
MICCAI (11) | 3 |
| 2025 | Conditional Graph Diffusion with Topological Constraints for Brain Network Generation
Joonhyuk Park, Guorong Wu 0001, Won Hwa Kim |
MICCAI (12) | 4 |
| 2025 | Explore In-Context Message Passing Operator for Graph Neural Networks in A Mean Field GameabstractIn typical graph neural networks (GNNs), feature representation learning naturally evolves through iteratively updating node features and exchanging information based on graph topology. In this context, we conceptualize that the learning process in GNNs is a mean-field game (MFG), where each graph node is an agent, interacting with its topologically connected neighbors.
However, current GNNs often employ the identical MFG strategy across different graph datasets, regardless of whether the graph exhibits homophilic or heterophilic characteristics.
To address this challenge, we propose to formulate the learning mechanism into a variational framework of the MFG inverse problem, introducing an in-context selective message passing paradigm for each agent, which promotes the best overall outcome for the graph. Specifically, we seek for the application-adaptive transportation function (controlling information exchange throughout the graph) and reaction function (controlling feature representation learning on each agent), \textit{on the fly}, which allows us to uncover the most suitable selective mechanism of message passing by solving an MFG variational problem through the lens of Hamiltonian flows.
Taken together, our variational framework unifies existing GNN models into various mean-field games with distinct equilibrium states, each characterized by the learned in-context message passing operators. Furthermore, we present an agnostic end-to-end deep model, coined \textit{Game-of-GNN}, to jointly identify the message passing mechanism and fine-tune the GNN hyper-parameters on top of the elucidated message passing operators. \textit{Game-of-GNN} has achieved SOTA performance on diverse graph data, including popular benchmark datasets and human connectomes. More importantly, the mathematical insight of MFG framework provides a new window to understand the foundational principles of graph learning as an interactive dynamical system, which allows us to reshape the idea of designing next-generation GNN models. Tingting Dan, Xinwei Huang, Won Hwa Kim, Guorong Wu 0001 |
NeurIPS | 3 |
| 2025 | Topology-aware Graph Diffusion Model with Persistent HomologyabstractGenerating realistic graphs faces challenges in estimating accurate distribution of graphs in an embedding space while preserving structural characteristics. However, existing graph generation methods primarily focus on approximating the joint distribution of nodes and edges, often overlooking topological properties such as connected components and loops, hindering accurate representation of global structures. To address this issue, we propose a Topology-Aware diffusion-based Graph Generation (TAGG), which aims to sample synthetic graphs that closely resemble the structural characteristics of the original graph based on persistent homology. Specifically, we suggest two core components: 1) Persistence Diagram Matching (PDM) loss which ensures high topological fidelity of generated graphs, and 2) topology-aware attention module (TAM) which induces the denoising network to capture the homological characteristics of the original graphs. Extensive experiments on conventional graph benchmarks demonstrate the effectiveness of our approach demonstrating high generation performance across various metrics, while achieving closer alignment with the distribution of topological features observed in the original graphs. Furthermore, application to real brain network data showcases its potential for complex and real graph applications. Joonhyuk Park, Yujee Song, Guorong Wu 0001, Won Hwa Kim |
NeurIPS | 5 |
| 2024 | Learning to Approximate Adaptive Kernel Convolution on GraphsabstractVarious Graph Neural Networks (GNN) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers increases. The issue stems from the intrinsic formulation of conventional graph convolution where the nodal features are aggregated from a direct neighborhood per layer across the entire nodes in the graph. As setting different number of hidden layers per node is infeasible, recent works leverage a diffusion kernel to redefine the graph structure and incorporate information from farther nodes. Unfortunately, such approaches suffer from heavy diagonalization of a graph Laplacian or learning a large transform matrix. In this regards, we propose a diffusion learning framework where the range of feature aggregation is controlled by the scale of a diffusion kernel. For efficient computation, we derive closed-form derivatives of approximations of the graph convolution with respect to the scale, so that node-wise range can be adaptively learned.With a downstream classifier, the entire framework is made trainable in an end-to-end manner. Our model is tested on various standard datasets for node-wise classification for the state-of-the-art performance, and it is also validated on a real-world brain network data for graph classifications to demonstrate its practicality for Alzheimer classification. Jaeyoon Sim, Sooyeon Jeon, Injun Choi, Guorong Wu 0001, Won Hwa Kim |
AAAI | 5 |
| 2024 | CNG-SFDA: Clean-and-Noisy Region Guided Online-Offline Source-Free Domain Adaptation
Hyeonwoo Cho, Chanmin Park, Dong-Hee Kim, Won Hwa Kim |
ACCV (8) | 5 |
| 2024 | Decoupled Marked Temporal Point Process using Neural Ordinary Differential EquationsabstractA Marked Temporal Point Process (MTPP) is a stochastic process whose realization is a set of event-time data. MTPP is often used to understand complex dynamics of asynchronous temporal events such as money transaction, social media, healthcare, etc. Recent studies have utilized deep neural networks to capture complex temporal dependencies of events and generate embedding that aptly represent the observed events. While most previous studies focus on the inter-event dependencies and their representations, how individual events influence the overall dynamics over time has been under-explored. In this regime, we propose a Decoupled MTPP framework that disentangles characterization of a stochastic process into a set of evolving influences from different events. Our approach employs Neural Ordinary Differential Equations (Neural ODEs) to learn flexible continuous dynamics of these influences while simultaneously addressing multiple inference problems, such as density estimation and survival rate computation. We emphasize the significance of disentangling the influences by comparing our framework with state-of-the-art methods on real-life datasets, and provide analysis on the model behavior for potential applications. Yujee Song, Donghyun Lee 0006, Won Hwa Kim |
ICLR | 4 |
| 2024 | Neurodegenerative Brain Network Classification via Adaptive Diffusion with Temporal RegularizationabstractAnalysis of neurodegenerative diseases on brain connectomes is important in facilitating early diagnosis and predicting its onset. However, investigation of the progressive and irreversible dynamics of these diseases remains underexplored in cross-sectional studies as its diagnostic groups are considered independent. Also, as in many real-world graphs, brain networks exhibit intricate structures with both homophily and heterophily. To address these challenges, we propose Adaptive Graph diffusion network with Temporal regularization (AGT). AGT introduces node-wise convolution to adaptively capture low (i.e., homophily) and high-frequency (i.e., heterophily) characteristics within an optimally tailored range for each node. Moreover, AGT captures sequential variations within progressive diagnostic groups with a novel temporal regularization, considering the relative feature distance between the groups in the latent space. As a result, our proposed model yields interpretable results at both node-level and group-level. The superiority of our method is validated on two neurodegenerative disease benchmarks for graph classification: Alzheimer’s Disease Neuroimaging Initiative (ADNI) and Parkinson’s Progression Markers Initiative (PPMI) datasets. Hyuna Cho, Jaeyoon Sim, Guorong Wu 0001, Won Hwa Kim |
ICML | 4 |
| 2024 | Exploring the Enigma of Neural Dynamics Through A Scattering-Transform Mixer Landscape for Riemannian ManifoldabstractThe human brain is a complex inter-wired system that emerges spontaneous functional fluctuations. In spite of tremendous success in the experimental neuroscience field, a system-level understanding of how brain anatomy supports various neural activities remains elusive. Capitalizing on the unprecedented amount of neuroimaging data, we present a physics-informed deep model to uncover the coupling mechanism between brain structure and function through the lens of data geometry that is rooted in the widespread wiring topology of connections between distant brain regions. Since deciphering the puzzle of self-organized patterns in functional fluctuations is the gateway to understanding the emergence of cognition and behavior, we devise a geometric deep model to uncover manifold mapping functions that characterize the intrinsic feature representations of evolving functional fluctuations on the Riemannian manifold. In lieu of learning unconstrained mapping functions, we introduce a set of graph-harmonic scattering transforms to impose the brain-wide geometry on top of manifold mapping functions, which allows us to cast the manifold-based deep learning into a reminiscent of *MLP-Mixer* architecture (in computer vision) for Riemannian manifold. As a proof-of-concept approach, we explore a neural-manifold perspective to understand the relationship between (static) brain structure and (dynamic) function, challenging the prevailing notion in cognitive neuroscience by proposing that neural activities are essentially excited by brain-wide oscillation waves living on the geometry of human connectomes, instead of being confined to focal areas. Tingting Dan, Ziquan Wei, Won Hwa Kim, Guorong Wu 0001 |
ICML | 3 |
| 2024 | OCL: Ordinal Contrastive Learning for Imputating Features with Progressive Labels
Seunghun Baek, Jaeyoon Sim, Guorong Wu 0001, Won Hwa Kim |
MICCAI (2) | 4 |
| 2024 | Uncovering Cortical Pathways of Prion-Like Pathology Spreading in Alzheimer's Disease by Neural Optimal Mass Transport
Yanquan Huang, Tingting Dan, Won Hwa Kim, Guorong Wu 0001 |
MICCAI (2) | 3 |
| 2024 | Multi-order Simplex-Based Graph Neural Network for Brain Network Analysis
Yechan Hwang, Soojin Hwang, Guorong Wu 0001, Won Hwa Kim |
MICCAI (5) | 4 |
| 2024 | Uncertainty-Aware Diffusion-Based Adversarial Attack for Realistic Colonoscopy Image Synthesis
Minjae Jeong, Hyuna Cho, Sungyoon Jung, Won Hwa Kim |
MICCAI (9) | 4 |
| 2024 | Multi-modal Graph Neural Network with Transformer-Guided Adaptive Diffusion for Preclinical Alzheimer Classification
Jaeyoon Sim, Guorong Wu 0001, Won Hwa Kim |
MICCAI (5) | 4 |
| 2024 | Interactive Network Perturbation between Teacher and Students for Semi-Supervised Semantic SegmentationabstractThe current golden standard of semi-supervised semantic segmentation is to generate and exploit pseudo-supervision on unlabeled images. This approach is however susceptible to the quality of pseudo-supervision—training often becomes unstable particularly at early stages and biased to incorrect supervision. To address these issues, we propose a new semi-supervised learning framework, dubbed Guided Pseudo Supervision (GPS). GPS comprises three networks, i.e., a teacher and two separate students. The teacher is first trained with a small set of labeled data and provides stable initial pseudo-supervision on the unlabeled data to the students. The students interactively train each other under the supervision of the teacher, and once they are sufficiently trained, they offer feedback supervision to the teacher so that the teacher improves in subsequent iterations. This strategy enables more stable and faster convergence than previous works, and consequently, GPS achieved state-of-the-art performance on Pascal VOC 2012 and Cityscapes datasets in various experiment settings. Hyuna Cho, Injun Choi, Suha Kwak, Won Hwa Kim |
WACV | 4 |
| 2024 | TauFlowNet: Revealing latent propagation mechanism of tau aggregates using deep neural transport equations
Tingting Dan, Mustafa Dere, Won Hwa Kim, Minjeong Kim 0001, Guorong Wu 0001 |
Medical Image Anal. | 3 |
| 2024 | Developing Explainable Deep Model for Discovering Novel Control Mechanism of Neuro-DynamicsabstractHuman brain is a complex system composed of many components that interact with each other. A well-designed computational model, usually in the format of partial differential equations (PDEs), is vital to understand the working mechanisms that can explain dynamic and self-organized behaviors. However, the model formulation and parameters are often tuned empirically based on the predefined domain-specific knowledge, which lags behind the emerging paradigm of discovering novel mechanisms from the unprecedented amount of spatiotemporal data. To address this limitation, we sought to link the power of deep neural networks and physics principles of complex systems, which allows us to design explainable deep models for uncovering the mechanistic role of how human brain (the most sophisticated complex system) maintains controllable functions while interacting with external stimulations. In the spirit of optimal control, we present a unified framework to design an explainable deep model that describes the dynamic behaviors of underlying neurobiological processes, allowing us to understand the latent control mechanism at a system level. We have uncovered the pathophysiological mechanism of Alzheimer's disease to the extent of controllability of disease progression, where the dissected system-level understanding enables higher prediction accuracy for disease progression and better explainability for disease etiology than conventional (black box) deep models. Tingting Dan, Minjeong Kim 0001, Won Hwa Kim, Guorong Wu 0001 |
IEEE Trans. Medical Imaging | 3 |
| 2023 | Devil's on the Edges: Selective Quad Attention for Scene Graph GenerationabstractScene graph generation aims to construct a semantic graph structure from an image such that its nodes and edges respectively represent objects and their relationships. One of the major challenges for the task lies in the presence of distracting objects and relationships in images; contextual reasoning is strongly distracted by irrelevant objects or backgrounds and, more importantly, a vast number of irrelevant candidate relations. To tackle the issue, we propose the Selective Quad Attention Network (SQUAT) that learns to select relevant object pairs and disambiguate them via diverse contextual interactions. SQUAT consists of two main components: edge selection and quad attention. The edge selection module selects relevant object pairs, i.e., edges in the scene graph, which helps contextual reasoning, and the quad attention module then updates the edge features using both edge-to-node and edge-to-edge cross-attentions to capture contextual information between objects and object pairs. Experiments demonstrate the strong performance and robustness of SQUAT, achieving the state of the art on the Visual Genome and Open Images v6 benchmarks. Deunsol Jung, Won Hwa Kim, Minsu Cho |
CVPR | 3 |
| 2023 | Learning to Boost Training by Periodic Nowcasting Near Future WeightsabstractRecent complicated problems require large-scale datasets and complex model architectures, however, it is difficult to train such large networks due to high computational issues. Significant efforts have been made to make the training more efficient such as momentum, learning rate scheduling, weight regularization, and meta-learning. Based on our observations on 1) high correlation between past eights and future weights, 2) conditions for beneficial weight prediction, and 3) feasibility of weight prediction, we propose a more general framework by intermittently skipping a handful of epochs by periodically forecasting near future weights, i.e., a Weight Nowcaster Network (WNN). As an add-on module, WNN predicts the future weights to make the learning process faster regardless of tasks and architectures. Experimental results show that WNN can significantly save actual time cost for training with an additional marginal time to train WNN. We validate the generalization capability of WNN under various tasks, and demonstrate that it works well even for unseen tasks. The code and pre-trained model are available at https://github.com/jjh6297/WNN. Jinhyeok Jang, Woo-han Yun, Won Hwa Kim, Youngwoo Yoon, Jaehong Kim 0001, Jaeyeon Lee 0001, ByungOk Han |
ICML | 3 |
| 2023 | Anti-adversarial Consistency Regularization for Data Augmentation: Applications to Robust Medical Image Segmentation
Hyuna Cho, Yubin Han, Won Hwa Kim |
MICCAI (4) | 3 |
| 2023 | Mixing Temporal Graphs with MLP for Longitudinal Brain Connectome Analysis
Hyuna Cho, Guorong Wu 0001, Won Hwa Kim |
MICCAI (2) | 3 |
| 2023 | Enhance Early Diagnosis Accuracy of Alzheimer's Disease by Elucidating Interactions Between Amyloid Cascade and Tau Propagation
Tingting Dan, Minjeong Kim 0001, Won Hwa Kim, Guorong Wu 0001 |
MICCAI (3) | 3 |
| 2023 | TauFlowNet: Uncovering Propagation Mechanism of Tau Aggregates by Neural Transport Equation
Tingting Dan, Minjeong Kim 0001, Won Hwa Kim, Guorong Wu 0001 |
MICCAI (3) | 3 |
| 2023 | Uncovering Structural-Functional Coupling Alterations for Neurodegenerative Diseases
Tingting Dan, Minjeong Kim 0001, Won Hwa Kim, Guorong Wu 0001 |
MICCAI (3) | 3 |
| 2023 | RESToring Clarity: Unpaired Retina Image Enhancement Using Scattering Transform
Ellen Jieun Oh, Yechan Hwang, Yubin Han, Taegeun Choi, Geunyoung Lee, Won Hwa Kim |
MICCAI (10) | 6 |
| 2023 | Convolving Directed Graph Edges via Hodge Laplacian for Brain Network Analysis
Joonhyuk Park, Yechan Hwang, Minjeong Kim 0001, Moo K. Chung, Guorong Wu 0001, Won Hwa Kim |
MICCAI (5) | 6 |
| 2023 | Multi-resolution Spectral Coherence for Graph Generation with Score-based DiffusionabstractSuccessful graph generation depends on the accurate estimation of the joint distribution of graph components such as nodes and edges from training data. While recent deep neural networks have demonstrated sampling of realistic graphs together with diffusion models, however, they still suffer from oversmoothing problems which are inherited from conventional graph convolution and thus high-frequency characteristics of nodes and edges become intractable. To overcome such issues and generate graphs with high fidelity, this paper introduces a novel approach that captures the dependency between nodes and edges at multiple resolutions in the spectral space. By modeling the joint distribution of node and edge signals in a shared graph wavelet space, together with a score-based diffusion model, we propose a Wavelet Graph Diffusion Model (Wave-GD) which lets us sample synthetic graphs with real-like frequency characteristics of nodes and edges. Experimental results on four representative benchmark datasets validate the superiority of the Wave-GD over existing approaches, highlighting its potential for a wide range of applications that involve graph data. Hyuna Cho, Minjae Jeong, Sooyeon Jeon, Sungsoo Ahn, Won Hwa Kim |
NeurIPS | 5 |
| 2023 | Re-Think and Re-Design Graph Neural Networks in Spaces of Continuous Graph Diffusion FunctionalsabstractGraphs are ubiquitous in various domains, such as social networks and biological systems. Despite the great successes of graph neural networks (GNNs) in modeling and analyzing complex graph data, the inductive bias of locality assumption, which involves exchanging information only within neighboring connected nodes, restricts GNNs in capturing long-range dependencies and global patterns in graphs. Inspired by the classic Brachistochrone problem, we seek how to devise a new inductive bias for cutting-edge graph application and present a general framework through the lens of variational analysis. The backbone of our framework is a two-way mapping between the discrete GNN model and continuous diffusion functional, which allows us to design application-specific objective function in the continuous domain and engineer discrete deep model with mathematical guarantees. First, we address over-smoothing in current GNNs. Specifically, our inference reveals that the existing layer-by-layer models of graph embedding learning are equivalent to a ${\ell _2}$-norm integral functional of graph gradients, which is the underlying cause of the over-smoothing problem. Similar to edge-preserving filters in image denoising, we introduce the total variation (TV) to promote alignment of the graph diffusion pattern with the global information present in community topologies. On top of this, we devise a new selective mechanism for inductive bias that can be easily integrated into existing GNNs and effectively address the trade-off between model depth and over-smoothing. Second, we devise a novel generative adversarial network (GAN) to predict the spreading flows in the graph through a neural transport equation. To avoid the potential issue of vanishing flows, we tailor the objective function to minimize the transportation within each community while maximizing the inter-community flows. Our new GNN models achieve state-of-the-art (SOTA) performance on graph learning benchmarks such as Cora, Citeseer, and Pubmed. Tingting Dan, Jiaqi Ding, Ziquan Wei, Shahar Z. Kovalsky, Minjeong Kim 0001, Won Hwa Kim, Guorong Wu 0001 |
NeurIPS | 6 |
| 2022 | Locally Normalized Soft Contrastive Clustering for Compact ClustersabstractRecent deep clustering algorithms take advantage of self-supervised learning and self-training techniques to map the original data into a latent space, where the data embedding and clustering assignment can be jointly optimized. However, as many recent datasets are enormous and noisy, getting a clear boundary between different clusters is challenging with existing methods that mainly focus on contracting similar samples together and overlooking samples near boundary of clusters in the latent space. In this regard, we propose an end-to-end deep clustering algorithm, i.e., Locally Normalized Soft Contrastive Clustering (LNSCC). It takes advantage of similarities among each sample's local neighborhood and globally disconnected samples to leverage positiveness and negativeness of sample pairs in a contrastive way to separate different clusters. Experimental results on various datasets illustrate that our proposed approach achieves outstanding clustering performance over most of the state-of-the-art clustering methods for both image and non-image data even without convolution. Xin Ma 0006, Won Hwa Kim |
IJCAI | 2 |
| 2022 | How Much to Aggregate: Learning Adaptive Node-Wise Scales on Graphs for Brain Networks
Injun Choi, Guorong Wu 0001, Won Hwa Kim |
MICCAI (1) | 3 |
| 2022 | Neuro-RDM: An Explainable Neural Network Landscape of Reaction-Diffusion Model for Cognitive Task Recognition
Tingting Dan, Hongmin Cai, Zhuobin Huang, Paul J. Laurienti, Won Hwa Kim, Guorong Wu 0001 |
MICCAI (8) | 5 |
| 2022 | Performing Group Difference Testing on Graph Structured Data From GANs: Analysis and Applications in NeuroimagingabstractGenerative adversarial networks (GANs) have emerged as a powerful generative model in computer vision. Given their impressive abilities in generating highly realistic images, they are also being used in novel ways in applications in the life sciences. This raises an interesting question when GANs are used in scientific or biomedical studies. Consider the setting where we are restricted to only using the samples from a trained GAN for downstream group difference analysis (and do not have direct access to the real data). Will we obtain similar conclusions? In this work, we explore if "generated" data, i.e., sampled from such GANs can be used for performing statistical group difference tests in cases versus controls studies, common across many scientific disciplines. We provide a detailed analysis describing regimes where this may be feasible. We complement the technical results with an empirical study focused on the analysis of cortical thickness on brain mesh surfaces in an Alzheimer's disease dataset. To exploit the geometric nature of the data, we use simple ideas from spectral graph theory to show how adjustments to existing GANs can yield improvements. We also give a generalization error bound by extending recent results on Neural Network Distance. To our knowledge, our work offers the first analysis assessing whether the Null distribution in "healthy versus diseased subjects" type statistical testing using data generated from the GANs coincides with the one obtained from the same analysis with real data. The code is available at https://github.com/yyxiongzju/GLapGAN. Tuan Q. Dinh, Yunyang Xiong, Zhichun Huang, Tien Vo, Akshay Mishra, Won Hwa Kim, Sathya N. Ravi |
IEEE Trans. Pattern Anal. Mach. Intell. | 6 |
| 2021 | Covariate Correcting Networks for Identifying Associations Between Socioeconomic Factors and Brain Outcomes in Children
Hyuna Cho, Gunwoong Park, Amal Isaiah, Won Hwa Kim |
MICCAI (7) | 4 |
| 2021 | Disentangled Sequential Graph Autoencoder for Preclinical Alzheimer's Disease Characterizations from ADNI Study
Fan Yang 0167, Hyuna Cho, Guorong Wu 0001, Won Hwa Kim |
MICCAI (2) | 5 |
| 2020 | COVLET: Covariance-Based Wavelet-Like Transform for Statistical Analysis of Brain Characteristics in Children
Fan Yang 0167, Amal Isaiah, Won Hwa Kim |
MICCAI (7) | 3 |
| 2019 | Conditional Recurrent Flow: Conditional Generation of Longitudinal Samples With Applications to NeuroimagingabstractWe develop a conditional generative model for longitudinal image datasets based on sequential invertible neural networks. Longitudinal image acquisitions are common in various scientific and biomedical studies where often each image sequence sample may also come together with various secondary (fixed or temporally dependent) measurements. The key goal is not only to estimate the parameters of a deep generative model for the given longitudinal data, but also to enable evaluation of how the temporal course of the generated longitudinal samples are influenced as a function of induced changes in the (secondary) temporal measurements (or events). Our proposed formulation incorporates recurrent subnetworks and temporal context gating, which provide a smooth transition in a temporal sequence of generated data that can be easily informed or modulated by secondary temporal conditioning variables. We show that the formulation works well despite the smaller sample sizes common in these applications. Our model is validated on two video datasets and a longitudinal Alzheimer's disease (AD) dataset for both quantitative and qualitative evaluations of the generated samples. Further, using our generated longitudinal image samples, we show that we can capture the pathological progressions in the brain that turn out to be consistent with the existing literature, and could facilitate various types of downstream statistical analysis. Seong Jae Hwang, Zirui Tao, Won Hwa Kim |
ICCV | 4 |
| 2017 | Online Graph Completion: Multivariate Signal Recovery in Computer VisionabstractThe adoption of "human-in-the-loop" paradigms in computer vision and machine learning is leading to various applications where the actual data acquisition (e.g., human supervision) and the underlying inference algorithms are closely interwined. While classical work in active learning provides effective solutions when the learning module involves classification and regression tasks, many practical issues such as partially observed measurements, financial constraints and even additional distributional or structural aspects of the data typically fall outside the scope of this treatment. For instance, with sequential acquisition of partial measurements of data that manifest as a matrix (or tensor), novel strategies for completion (or collaborative filtering) of the remaining entries have only been studied recently. Motivated by vision problems where we seek to annotate a large dataset of images via a crowdsourced platform or alternatively, complement results from a state-of-the-art object detector using human feedback, we study the "completion" problem defined on graphs, where requests for additional measurements must be made sequentially. We design the optimization model in the Fourier domain of the graph describing how ideas based on adaptive submodularity provide algorithms that work well in practice. On a large set of images collected from Imgur, we see promising results on images that are otherwise difficult to categorize. We also show applications to an experimental design problem in neuroimaging. Won Hwa Kim, Mona Jalal, Seong Jae Hwang, Sterling C. Johnson |
CVPR | 1 |
| 2016 | Latent Variable Graphical Model Selection Using Harmonic Analysis: Applications to the Human Connectome Project (HCP)abstractA major goal of imaging studies such as the (ongoing) Human Connectome Project (HCP) is to characterize the structural network map of the human brain and identify its associations with covariates such as genotype, risk factors, and so on that correspond to an individual. But the set of image derived measures and the set of covariates are both large, so we must first estimate a 'parsimonious' set of relations between the measurements. For instance, a Gaussian graphical model will show conditional independences between the random variables, which can then be used to setup specific downstream analyses. But most such data involve a large list of 'latent' variables that remain unobserved, yet affect the 'observed' variables sustantially. Accounting for such latent variables is not directly addressed by standard precision matrix estimation, and is tackled via highly specialized optimization methods. This paper offers a unique harmonic analysis view of this problem. By casting the estimation of the precision matrix in terms of a composition of low-frequency latent variables and high-frequency sparse terms, we show how the problem can be formulated using a new wavelet-type expansion in non-Euclidean spaces. Our formulation poses the estimation problem in the frequency space and shows how it can be solved by a simple sub-gradient scheme. We provide a set of scientific results on ~500 scans from the recently released HCP data where our algorithm recovers highly interpretable and sparse conditional dependencies between brain connectivity pathways and well-known covariates. Won Hwa Kim, Hyunwoo J. Kim, Nagesh Adluru |
CVPR | 1 |
| 2016 | Adaptive Signal Recovery on Graphs via Harmonic Analysis for Experimental Design in Neuroimaging
Won Hwa Kim, Seong Jae Hwang, Nagesh Adluru, Sterling C. Johnson |
ECCV (6) | 1 |
| 2015 | Statistical inference models for image datasets with systematic variationsabstractStatistical analysis of longitudinal or cross sectional brain imaging data to identify effects of neurodegenerative diseases is a fundamental task in various studies in neuroscience. However, when there are systematic variations in the images due to parameter changes such as changes in the scanner protocol, hardware changes, or when combining data from multi-site studies, the statistical analysis becomes problematic. Motivated by this scenario, the goal of this paper is to develop a unified statistical solution to the problem of systematic variations in statistical image analysis. Based in part on recent literature in harmonic analysis on diffusion maps, we propose an algorithm which compares operators that are resilient to the systematic variations. These operators are derived from the empirical measurements of the image data and provide an efficient surrogate to capturing the actual changes across images. We also establish a connection between our method to the design of wavelets in non-Euclidean space. To evaluate the proposed ideas, we present various experimental results on detecting changes in simulations as well as show how the method offers improved statistical power in the analysis of real longitudinal PIB-PET imaging data acquired from participants at risk for Alzheimer's disease (AD). Won Hwa Kim, Barbara B. Bendlin, Moo K. Chung, Sterling C. Johnson |
CVPR | 1 |
| 2015 | On Statistical Analysis of Neuroimages with Imperfect RegistrationabstractA variety of studies in neuroscience/neuroimaging seek to perform statistical inference on the acquired brain image scans for diagnosis as well as understanding the pathological manifestation of diseases. To do so, an important first step is to register (or co-register) all of the image data into a common coordinate system. This permits meaningful comparison of the intensities at each voxel across groups (e.g., diseased versus healthy) to evaluate the effects of the disease and/or use machine learning algorithms in a subsequent step. But errors in the underlying registration make this problematic, they either decrease the statistical power or make the follow-up inference tasks less effective/accurate. In this paper, we derive a novel algorithm which offers immunity to local errors in the underlying deformation field obtained from registration procedures. By deriving a deformation invariant representation of the image, the downstream analysis can be made more robust as if one had access to a (hypothetical) far superior registration procedure. Our algorithm is based on recent work on scattering transform. Using this as a starting point, we show how results from harmonic analysis (especially, non-Euclidean wavelets) yields strategies for designing deformation and additive noise invariant representations of large 3-D brain image volumes. We present a set of results on synthetic and real brain images where we achieve robust statistical analysis even in the presence of substantial deformation errors; here, standard analysis procedures significantly under-perform and fail to identify the true signal. Won Hwa Kim, Sathya N. Ravi, Sterling C. Johnson, Ozioma C. Okonkwo |
ICCV | 1 |
| 2014 | The 4D Hyperspherical Diffusion Wavelet: A New Method for the Detection of Localized Anatomical Variation
Ameer Pasha Hosseinbor, Won Hwa Kim, Nagesh Adluru, Amit Acharya, Houri K. Vorperian, Moo K. Chung |
MICCAI (3) | 2 |
| 2013 | Multi-resolution Shape Analysis via Non-Euclidean Wavelets: Applications to Mesh Segmentation and Surface Alignment Problemsabstractview of the shape's local and global topology, and that the solution is consistent across multiple scales. Unfortunately, the preferred mathematical construct which offers this behavior in classical image/signal processing, Wavelets, is no longer applicable in this general setting (data with non-uniform topology). In particular, the traditional definition does not allow writing out an expansion for graphs that do not correspond to the uniformly sampled lattice (e.g., images). In this paper, we adapt recent results in harmonic analysis, to derive Non-Euclidean Wavelets based algorithms for a range of shape analysis problems in vision and medical imaging. We show how descriptors derived from the dual domain representation offer native multi-resolution behavior for characterizing local/global topology around vertices. With only minor modifications, the framework yields a method for extracting interest/key points from shapes, a surprisingly simple algorithm for 3-D shape segmentation (competitive with state of the art), and a method for surface alignment (without landmarks). We give an extensive set of comparison results on a large shape segmentation benchmark and derive a uniqueness theorem for the surface alignment problem. Won Hwa Kim, Moo K. Chung |
CVPR | 1 |
| 2013 | Multi-resolutional Brain Network Filtering and Analysis via Wavelets on Non-Euclidean Space
Won Hwa Kim, Nagesh Adluru, Moo K. Chung, Sylvia Charchut, Johnson J. GadElkarim, Lori L. Altshuler, Teena Moody, Anand R. Kumar, Alex D. Leow |
MICCAI (3) | 1 |
| 2012 | Wavelet based multi-scale shape features on arbitrary surfaces for cortical thickness discriminationabstractHypothesis testing on signals defined on surfaces (such as the cortical surface) is a fundamental component of a variety of studies in Neuroscience. The goal here is to identify regions that exhibit changes as a function of the clinical condition under study. As the clinical questions of interest move towards identifying very early signs of diseases, the corresponding statistical differences at the group level invariably become weaker and increasingly hard to identify. Indeed, after a multiple comparisons correction is adopted (to account for correlated statistical tests over all surface points), very few regions may survive. In contrast to hypothesis tests on point-wise measurements, in this paper, we make the case for performing statistical analysis on multi-scale shape descriptors that characterize the local topological context of the signal around each surface vertex. Our descriptors are based on recent results from harmonic analysis, that show how wavelet theory extends to non-Euclidean settings (i.e., irregular weighted graphs). We provide strong evidence that these descriptors successfully pick up group-wise differences, where traditional methods either fail or yield unsatisfactory results. Other than this primary application, we show how the framework allows performing cortical surface smoothing in the native space without mappint to a unit sphere. Won Hwa Kim, Deepti Pachauri, Charles R. Hatt, Moo K. Chung, Sterling C. Johnson |
NIPS | 1 |