Demo Data from SIGIR 2026 / reviewers in the wild / expert
Tianxiang Zhao 0001
dblp:232/5561-1
· DBLP profile ↗
24ranked-venue papers
12as first author
22since 2021 · last 2026
0000-0003-4504-7809ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 20 · 11 first-author · 19 since 2021Artificial intelligence and machine learning · 18 · 8 first-author · 16 since 2021Applied, interdisciplinary, general and emerging computing · 3 · 2 first-author · 3 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 1 first-author · 1 since 2021Human-computer interaction and ubiquitous computing · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
13 papers |
Graph learning · 43% Trustworthy machine learning · 21% Reinforcement learning · 12% | |
| Databases, data mining, and information retrieval
2 papers |
Data mining · 82% Machine learning and data management · 18% |
Topics — the 28 heaviest of 30, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Graph learning › graph neural network
node classification |
3.8 | 6 | 2024 | Imbalanced Node Classification With Synthetic Over-Sampling · IEEE Trans. Knowl. Data Eng. 2024 Disambiguated Node Classification with Graph Neural Networks · WWW 2024 Distribution Consistency based Self-Training for Graph Neural Networks with Sparse Labels · WSDM 2024 |
Machine learning › Graph learning
graph neural network |
3.6 | 5 | 2025 | Bridging Source and Target Domains via Link Prediction for Unsupervised Domain Adaptation on Graphs · WSDM 2025 Imbalanced Node Classification With Synthetic Over-Sampling · IEEE Trans. Knowl. Data Eng. 2024 Disambiguated Node Classification with Graph Neural Networks · WWW 2024 |
Machine learning › Trustworthy machine learning
interpretability |
2.2 | 3 | 2024 | Towards Inductive and Efficient Explanations for Graph Neural Networks · IEEE Trans. Pattern Anal. Mach. Intell. 2024 Interpretable Imitation Learning with Dynamic Causal Relations · WSDM 2024 Towards Faithful and Consistent Explanations for Graph Neural Networks · WSDM 2023 |
Machine learning › Trustworthy machine learning › interpretability
graph neural network explanation |
1.4 | 2 | 2024 | Towards Inductive and Efficient Explanations for Graph Neural Networks · IEEE Trans. Pattern Anal. Mach. Intell. 2024 Towards Faithful and Consistent Explanations for Graph Neural Networks · WSDM 2023 |
Machine learning › Reinforcement learning
imitation learning |
1.4 | 2 | 2024 | Interpretable Imitation Learning with Dynamic Causal Relations · WSDM 2024 Skill Disentanglement for Imitation Learning from Suboptimal Demonstrations · KDD 2023 |
Machine learning › Graph learning › graph neural network › node classification
imbalanced node classification |
1.3 | 2 | 2024 | Imbalanced Node Classification With Synthetic Over-Sampling · IEEE Trans. Knowl. Data Eng. 2024 GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural Networks · WSDM 2021 |
Machine learning › Graph learning
link prediction |
0.9 | 1 | 2025 | Bridging Source and Target Domains via Link Prediction for Unsupervised Domain Adaptation on Graphs · WSDM 2025 |
Machine learning › Transfer learning and domain adaptation › domain adaptation › graph domain adaptation
unsupervised graph domain adaptation |
0.9 | 1 | 2025 | Bridging Source and Target Domains via Link Prediction for Unsupervised Domain Adaptation on Graphs · WSDM 2025 |
Machine learning › Probabilistic and Bayesian machine learning › causal inference
causal discovery |
0.8 | 1 | 2024 | Interpretable Imitation Learning with Dynamic Causal Relations · WSDM 2024 |
Machine learning › Representation and self-supervised learning
contrastive learning |
0.8 | 1 | 2024 | Disambiguated Node Classification with Graph Neural Networks · WWW 2024 |
Machine learning › Representation and self-supervised learning › contrastive learning
graph contrastive learning |
0.8 | 1 | 2024 | Disambiguated Node Classification with Graph Neural Networks · WWW 2024 |
Machine learning › Graph learning › graph neural network
graph data augmentation |
0.8 | 1 | 2024 | Imbalanced Node Classification With Synthetic Over-Sampling · IEEE Trans. Knowl. Data Eng. 2024 |
Machine learning › Graph learning › graph representation learning
node representation learning |
0.8 | 1 | 2024 | Disambiguated Node Classification with Graph Neural Networks · WWW 2024 |
Machine learning › Transfer learning and domain adaptation › domain adaptation › unsupervised domain adaptation
self-training |
0.8 | 1 | 2024 | Distribution Consistency based Self-Training for Graph Neural Networks with Sparse Labels · WSDM 2024 |
Machine learning › Transfer learning and domain adaptation › domain adaptation
unsupervised domain adaptation |
0.8 | 1 | 2024 | Multi-source Unsupervised Domain Adaptation on Graphs with Transferability Modeling · KDD 2024 |
Machine learning › Trustworthy machine learning › interpretability
causal explanation |
0.7 | 1 | 2023 | Towards Faithful and Consistent Explanations for Graph Neural Networks · WSDM 2023 |
Machine learning › Reinforcement learning › imitation learning › learning from imperfect demonstrations
learning from suboptimal demonstrations |
0.7 | 1 | 2023 | Skill Disentanglement for Imitation Learning from Suboptimal Demonstrations · KDD 2023 |
Machine learning › Reinforcement learning › hierarchical reinforcement learning › skill learning
skill discovery |
0.7 | 1 | 2023 | Skill Disentanglement for Imitation Learning from Suboptimal Demonstrations · KDD 2023 |
Machine learning › Representation and self-supervised learning › representation learning › disentangled representation learning
skill disentanglement |
0.7 | 1 | 2023 | Skill Disentanglement for Imitation Learning from Suboptimal Demonstrations · KDD 2023 |
Machine learning › Trustworthy machine learning
fairness |
0.6 | 1 | 2022 | Towards Fair Classifiers Without Sensitive Attributes: Exploring Biases in Related Features · WSDM 2022 |
Machine learning › Trustworthy machine learning › fairness › algorithmic fairness
fairness without sensitive attributes |
0.6 | 1 | 2022 | Towards Fair Classifiers Without Sensitive Attributes: Exploring Biases in Related Features · WSDM 2022 |
Machine learning › Graph learning
graph self-supervised learning |
0.6 | 1 | 2022 | Exploring Edge Disentanglement for Node Classification · WWW 2022 |
Machine learning › Representation and self-supervised learning › representation learning › unsupervised representation learning › self-supervised representation learning
pretext task |
0.6 | 1 | 2022 | Exploring Edge Disentanglement for Node Classification · WWW 2022 |
Data mining › predictive modeling › classification
imbalanced classification |
0.5 | 1 | 2021 | GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural Networks · WSDM 2021 |
Data mining › predictive modeling › classification › imbalanced classification › oversampling
synthetic minority oversampling |
0.5 | 1 | 2021 | GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural Networks · WSDM 2021 |
Natural language and speech › Machine translation › computer-assisted translation
interactive machine translation |
0.4 | 1 | 2020 | Balancing Quality and Human Involvement: An Effective Approach to Interactive Neural Machine Translation · AAAI 2020 |
Machine learning › Reinforcement learning
reinforcement learning for NLP |
0.4 | 1 | 2020 | Balancing Quality and Human Involvement: An Effective Approach to Interactive Neural Machine Translation · AAAI 2020 |
Machine learning › Trustworthy machine learning › robustness
distribution shift |
0.2 | 1 | 2024 | Distribution Consistency based Self-Training for Graph Neural Networks with Sparse Labels · WSDM 2024 |
Methods — techniques the papers use, named apart from their topics
graph neural network · 3.1edge generation · 2.5contrastive learning · 1.6identity-preserving learning · 0.9domain adaptation · 0.9pseudo-labeling · 0.8oversampling · 0.8optimal transport · 0.8meta-learning · 0.8knowledge distillation · 0.8embedding space synthesis · 0.8domain selector · 0.8synthetic minority oversampling · 0.5embedding space · 0.5
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Enhance graph alignment for large language modelsabstractGraph-structured data is prevalent in the real world. Recently, due to the powerful emergent capabilities, Large Language Models (LLMs) have shown promising performance in modeling graphs. The key to effectively applying LLMs on graphs is converting graph data into a format LLMs can comprehend. Graph-to-token approaches are popular in enabling LLMs to process graph information. They transform graphs into sequences of tokens and align them with text tokens through instruction tuning, where self-supervised instruction tuning helps LLMs acquire general knowledge about graphs, and supervised fine-tuning specializes LLMs for the downstream tasks on graphs. Despite their initial success, we find that existing methods have a misalignment between self-supervised tasks and supervised downstream tasks, resulting in negative transfer from self-supervised fine-tuning to downstream tasks. To address these issues, we propose Graph Alignment Large Language Models (GALLM) to benefit from aligned task templates. In the self-supervised tuning stage, we introduce a novel text matching task using templates aligned with downstream tasks. In the task-specific tuning stage, we propose two category prompt methods that learn supervision information from additional explanation with further aligned templates. Experimental evaluations on four datasets demonstrate substantial improvements in supervised learning, multi-dataset generalizability, and particularly in zero-shot capability, highlighting the model's potential as a graph foundation model. Our code is available at the anonymous repository https://anonymous.4open.science/r/GALLM-AC54/. Haitong Luo, Xuying Meng, Suhang Wang, Tianxiang Zhao 0001, Fali Wang, Yujun Zhang 0001 |
Neural Networks | 4 |
| 2025 | Towards Reliable GNNs: Adversarial Calibration Learning for Confidence EstimationabstractGraph neural networks (GNNs) have achieved strong predictive performance across a range of tasks, yet they often exhibit poor confidence calibration-where the predicted confidence scores do not accurately reflect the true likelihood of correctness. This shortcoming raises concerns about their reliability in critical domains such as fraud detection and risk assessment, where well-calibrated predictions are essential for sound decision-making. Although several calibration methods have been proposed for GNNs, our experiments reveal that they tend to focus on global calibration while failing to generalize across different node groups, such as those defined by degree, class, or local structural patterns. In some cases, these methods even degrade calibration performance compared to the original uncalibrated models. To address this limitation, we introduce AdvCali, a novel framework that adaptively improves calibration across diverse node groups. AdvCali employs adversarial training to automatically identify miscalibrated groups and incorporates a differentiable Group Expected Calibration Error (ECE) loss to refine confidence estimates within them. This enables the model to adjust its calibration strategy dynamically, without relying on prior knowledge of which node groups are miscalibrated. Extensive experiments on real-world datasets show that AdvCali not only improves global calibration but also significantly enhances calibration within groups defined by feature similarity, graph topology, and connectivity patterns, outperforming existing approaches. Yilong Wang 0001, Tianxiang Zhao 0001, Suhang Wang |
CIKM | 3 |
| 2025 | Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient TuningabstractExisting continual learning works explored strategies like memory replay, regularization, and parameter isolation, but little analysis was conducted on the optimization behavior of LLMs’ continual fine-tuning. In this work, we investigate the geometric connections of different minima along the continual LLM fine-tuning trajectories. We validate this phenomenon on LLMs and propose a new method called Interpolation-based LoRA (I-LoRA). I-LoRA can strike a balance between plasticity and stability through parameter interpolation, which constructs a dual-memory experience replay framework based on LoRA. Experiments on eight domain-specific benchmarks demonstrate that I-LoRA consistently shows significant improvement over previous approaches with up to 11% performance gains. Our code is available at https://anonymous.4open.science/r/LLMCL-3823. Xinlong Li, Weijieying Ren, Lei Wang 0185, Tianxiang Zhao 0001, Richang Hong |
ICASSP | 5 |
| 2025 | Bridging Source and Target Domains via Link Prediction for Unsupervised Domain Adaptation on GraphsabstractGraph neural networks (GNNs) have shown great ability for node classification on graphs. However, the success of GNNs relies on abundant labeled data, while obtaining high-quality labels is costly and challenging, especially for newly emerging domains. Hence, unsupervised domain adaptation (UDA), which trains a classifier on the labeled source graph and adapts it to the unlabeled target graph, is attracting increasing attention. Various approaches have been proposed to alleviate the distribution shift between the source and target graphs to facilitate the classifier adaptation. However, most of them simply adopt existing UDA techniques developed for independent and identically distributed data to gain domain-invariant node embeddings for graphs, which do not fully consider the graph structure and message-passing mechanism of GNNs during the adaptation and will fail when label distribution shift exists among domains. In this paper, we proposed a novel framework that adopts link prediction to connect nodes between source and target graphs, which can facilitate message-passing between the source and target graphs and augment the target nodes to have "in-distribution'' neighborhoods with the source domain. This strategy modified the target graph on the input level to reduce its deviation from the source domain in the embedding space and is insensitive to disproportional label distributions across domains. To prevent the loss of discriminative information in the target graph, we further design a novel identity-preserving learning objective, which guides the learning of the edge insertion module together with reconstruction and adaptation losses. Experimental results on real-world datasets demonstrate the effectiveness of our framework. Yilong Wang 0001, Tianxiang Zhao 0001, Zongyu Wu 0001, Suhang Wang |
WSDM | 2 |
| 2024 | AmGNN: A Framework for Adaptive Processing of Inter-layer Information in Multi-layer Graph
Huaisheng Zhu, Zongyu Wu 0001, Tianxiang Zhao 0001, Suhang Wang |
ASONAM (1) | 3 |
| 2024 | Enhancing Graph Neural Networks with Limited Labeled Data by Actively Distilling Knowledge from Large Language ModelsabstractGraphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification but still face challenges in scenarios with few labeled nodes, despite the frequent occurrence of such tasks in real-world applications with limited labeled data. To address this challenge, various approaches have been proposed, including graph meta-learning, transfer learning, and methods based on Large Language Models (LLMs). However, traditional meta-learning and transfer learning methods often require prior knowledge from base classes or fail to exploit the potential advantages of unlabeled nodes. Meanwhile, LLM-based methods may overlook the zero-shot capabilities of LLMs and rely heavily on the quality of generated contexts. In this paper, we propose a novel approach that integrates LLMs and GNNs, leveraging the zero-shot inference capabilities of LLMs and employing a Graph-LLM-based active learning paradigm to enhance GNNs’ performance. Extensive experiments demonstrate the effectiveness of our model in improving node classification accuracy with considerably limited labeled data, surpassing state-of-the-art baselines by significant margins. Tianxiang Zhao 0001, Lingwei Chen, Suhang Wang |
IEEE Big Data | 2 |
| 2024 | HC-GST: Heterophily-aware Distribution Consistency based Graph Self-trainingabstractGraph self-training (GST), which selects and assigns pseudo-labels to unlabeled nodes, is popular for tackling label sparsity in graphs. However, recent study on homophily graphs show that GST methods could introduce and amplify distribution shift between training and test nodes as they tend to assign pseudo-labels to nodes they are good at. As GNNs typically perform better on homophilic nodes, there could be potential shifts towards homophilic pseudo-nodes, which is underexplored. Our preliminary experiments on heterophilic graphs verify that these methods can cause shifts in homophily ratio distributions, leading to training bias that improves performance on homophilic nodes while degrading it on heterophilic ones. Therefore, we study a novel problem of reducing homophily ratio distribution shifts during self-training on heterophilic graphs. A key challenge is the accurate calculation of homophily ratios and their distributions without extensive labeled data. To tackle them, we propose a novel Heterophily-aware Distribution Consistency-based Graph Self-Training (HC-GST) framework, which estimates homophily ratios using soft labels and optimizes a selection vector to align pseudo-nodes with the global homophily ratio distribution. Extensive experiments on both homophilic and heterophilic graphs show that HC-GST effectively reduces training bias and enhances self-training performance. Fali Wang, Tianxiang Zhao 0001, Suhang Wang |
CIKM | 2 |
| 2024 | Multi-source Unsupervised Domain Adaptation on Graphs with Transferability ModelingabstractIn this paper, we tackle a new problem ofmulti-source unsupervised domain adaptation (MSUDA) for graphs, where models trained on annotated source domains need to be transferred to the unsupervised target graph for node classification. Due to the discrepancy in distribution across domains, the key challenge is how to select good source instances and how to adapt the model. Diverse graph structures further complicate this problem, rendering previous MSUDA approaches less effective. In this work, we present the framework Selective Multi-source Adaptation for Graph (SelMAG ), with a graph-modeling-based domain selector, a sub-graph node selector, and a bi-level alignment objective for the adaptation. Concretely, to facilitate the identification of informative source data, the similarity across graphs is disentangled and measured with the transferability of a graph-modeling task set, and we use it as evidence for source domain selection. A node selector is further incorporated to capture the variation in transferability of nodes within the same source domain. To learn invariant features for adaptation, we align the target domain to selected source data both at the embedding space by minimizing the optimal transport distance and at the classification level by distilling the label function. Modules are explicitly learned to select informative source data and conduct the alignment in virtual training splits with a meta-learning strategy. Experimental results on five graph datasets show the effectiveness of the proposed method. Tianxiang Zhao 0001, Xiang Zhang 0001, Suhang Wang |
KDD | 1 |
| 2024 | Distribution Consistency based Self-Training for Graph Neural Networks with Sparse LabelsabstractFew-shot node classification poses a significant challenge for Graph Neural Networks (GNNs) due to insufficient supervision and potential distribution shifts between labeled and unlabeled nodes. Self-training has emerged as a widely popular framework to leverage the abundance of unlabeled data, which expands the training set by assigning pseudo-labels to selected unlabeled nodes. Efforts have been made to develop various selection strategies based on confidence, information gain, etc. However, none of these methods takes into account the distribution shift between the training and testing node sets. The pseudo-labeling step may amplify this shift and even introduce new ones, hindering the effectiveness of self-training. Therefore, in this work, we explore the potential of explicitly bridging the distribution shift between the expanded training set and test set during self-training. To this end, we propose a novel Distribution-Consistent Graph Self-Training (DC-GST) framework to identify pseudo-labeled nodes that both are informative and capable of redeeming the distribution discrepancy and formulate it as a differentiable optimization task. A distribution-shift-aware edge predictor is further adopted to augment the graph and increase the model's generalizability in assigning pseudo labels. We evaluate our proposed method on four publicly available benchmark datasets and extensive experiments demonstrate that our framework consistently outperforms state-of-the-art baselines. Fali Wang, Tianxiang Zhao 0001, Suhang Wang |
WSDM | 2 |
| 2024 | Interpretable Imitation Learning with Dynamic Causal RelationsabstractImitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret control policies learned by the agent. Difficulties mainly come from two aspects: 1) agents in imitation learning are usually implemented as deep neural networks, which are black-box models and lack interpretability; 2) the latent causal mechanism behind agents' decisions may vary along the trajectory, rather than staying static throughout time steps. To increase transparency and offer better interpretability of the neural agent, we propose to expose its captured knowledge in the form of a directed acyclic causal graph, with nodes being action and state variables and edges denoting the causal relations behind predictions. Furthermore, we design this causal discovery process to be state-dependent, enabling it to model the dynamics in latent causal graphs. Concretely, we conduct causal discovery from the perspective of Granger causality and propose a self-explainable imitation learning framework, CAIL. The proposed framework is composed of three parts: a dynamic causal discovery module, a causality encoding module, and a prediction module, and is trained in an end-to-end manner. After the model is learned, we can obtain causal relations among states and action variables behind its decisions, exposing policies learned by it. Experimental results on both synthetic and real-world datasets demonstrate the effectiveness of the proposed CAIL in learning the dynamic causal graphs for understanding the decision-making of imitation learning meanwhile maintaining high prediction accuracy. Tianxiang Zhao 0001, Wenchao Yu, Suhang Wang, Lu Wang 0029, Xiang Zhang 0001, Yuncong Chen, Yanchi Liu, Wei Cheng 0002 |
WSDM | 1 |
| 2024 | Disambiguated Node Classification with Graph Neural NetworksabstractGraph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data across various domains. Despite their great successful, one critical challenge is often overlooked by existing works, i.e., the learning of message propagation that can generalize effectively to underrepresented graph regions. These minority regions often exhibit irregular homophily/heterophily patterns and diverse neighborhood class distributions, resulting in ambiguity. In this work, we investigate the ambiguity problem within GNNs, its impact on representation learning, and the development of richer supervision signals to fight against this problem. We conduct a fine-grained evaluation of GNN, analyzing the existence of ambiguity in different graph regions and its relation with node positions. To disambiguate node embeddings, we propose a novel method, DisamGCL which exploits additional optimization guidance to enhance representation learning, particularly for nodes in ambiguous regions. DisamGCL identifies ambiguous nodes based on temporal inconsistency of predictions and introduces a disambiguation regularization by employing contrastive learning in a topology-aware manner. DisamGCL promotes discriminativity of node representations and can alleviating semantic mixing caused by message propagation, effectively addressing the ambiguity problem. Empirical results validate the efficiency of DisamGCL and highlight its potential to improve GNN performance in underrepresented graph regions. Tianxiang Zhao 0001, Xiang Zhang 0001, Suhang Wang |
WWW | 1 |
| 2024 | Towards Inductive and Efficient Explanations for Graph Neural NetworksabstractDespite recent progress in Graph Neural Networks (GNNs), explaining predictions made by GNNs remains a challenging and nascent problem. The leading method mainly considers the local explanations, i.e., important subgraph structure and node features, to interpret why a GNN model makes the prediction for a single instance, e.g. a node or a graph. As a result, the explanation generated is painstakingly customized at the instance level. The unique explanation interpreting each instance independently is not sufficient to provide a global understanding of the learned GNN model, leading to the lack of generalizability and hindering it from being used in the inductive setting. Besides, training the explanation model explaining for each instance is time-consuming for large-scale real-life datasets. In this study, we address these key challenges and propose PGExplainer, a parameterized explainer for GNNs. PGExplainer adopts a deep neural network to parameterize the generation process of explanations, which renders PGExplainer a natural approach to multi-instance explanations. Compared to the existing work, PGExplainer has better generalization ability and can be utilized in an inductive setting without training the model for new instances. Thus, PGExplainer is much more efficient than the leading method with significant speed-up. In addition, the explanation networks can also be utilized as a regularizer to improve the generalization power of existing GNNs when jointly trained with downstream tasks. Experiments on both synthetic and real-life datasets show highly competitive performance with up to 24.7% relative improvement in AUC on explaining graph classification over the leading baseline. Tianxiang Zhao 0001, Wei Cheng 0002, Dongkuan Xu, Wenchao Yu, Xiao Liu 0039, Xiang Zhang 0001 |
IEEE Trans. Pattern Anal. Mach. Intell. | 2 |
| 2024 | Imbalanced Node Classification With Synthetic Over-SamplingabstractIn recent years, graph neural networks (GNNs) have achieved state-of-the-art performance for node classification. However, most existing GNNs would suffer from the graph imbalance problem. In many real-world scenarios, node classes are imbalanced, with some majority classes making up most parts of the graph. The message propagation mechanism in GNNs would further amplify the dominance of those majority classes, resulting in sub-optimal classification performance. In this work, we seek to address this problem by generating pseudo instances of minority classes to balance the training data, extending previous over-sampling-based techniques. This task is non-trivial, as those techniques are designed with the assumption that instances are independent. Neglection of relation information would complicate this oversampling process. Furthermore, the node classification task typically takes the semi-supervised setting with only a few labeled nodes, providing insufficient supervision for the generation of minority instances. Generated new nodes of low quality would harm the trained classifier. In this work, we address these difficulties by synthesizing new nodes in a constructed embedding space, which encodes both node attributes and topology information. Furthermore, an edge generator is trained simultaneously to model the graph structure and provide relations for new samples. To further improve the data efficiency, we also explore synthesizing mixed “in-between” nodes to utilize nodes from the majority class in this over-sampling process. Experiments on real-world datasets validate the effectiveness of our proposed framework. Tianxiang Zhao 0001, Xiang Zhang 0001, Suhang Wang |
IEEE Trans. Knowl. Data Eng. | 1 |
| 2023 | T-SaS: Toward Shift-aware Dynamic Adaptation for Streaming DataabstractIn many real-world scenarios, distribution shifts exist in the streaming data across time steps. Many complex sequential data can be effectively divided into distinct regimes that exhibit persistent dynamics. Discovering the shifted behaviors and the evolving patterns underlying the streaming data are important to understand the dynamic system. Existing methods typically train one robust model to work for the evolving data of distinct distributions or sequentially adapt the model utilizing explicitly given regime boundaries. However, there are two challenges: (1) shifts in data streams could happen drastically and abruptly without precursors. Boundaries of distribution shifts are usually unavailable, and (2) training a shared model for all domains could fail to capture varying patterns. This paper aims to solve the problem of sequential data modeling in the presence of sudden distribution shifts that occur without any precursors. Specifically, we design a Bayesian framework, dubbed as T-SaS, with a discrete distribution-modeling variable to capture abrupt shifts of data. Then, we design a model that enable adaptation with dynamic network selection conditioned on that discrete variable. The proposed method learns specific model parameters for each distribution by learning which neurons should be activated in the full network. A dynamic masking strategy is adopted here to support inter-distribution transfer through the overlapping of a set of sparse networks. Extensive experiments show that our proposed method is superior in both accurately detecting shift boundaries to get segments of varying distributions and effectively adapting to downstream forecast or classification tasks. Weijieying Ren, Tianxiang Zhao 0001, Kunpeng Liu 0001 |
CIKM | 2 |
| 2023 | Skill Disentanglement for Imitation Learning from Suboptimal DemonstrationsabstractImitation learning has achieved great success in many sequential decision-making tasks, in which a neural agent is learned by imitating collected human demonstrations. However, existing algorithms typically require a large number of high-quality demonstrations that are difficult and expensive to collect. Usually, a trade-off needs to be made between demonstration quality and quantity in practice. Targeting this problem, in this work we consider the imitation of sub-optimal demonstrations, with both a small clean demonstration set and a large noisy set. Some pioneering works have been proposed, but they suffer from many limitations, e.g., assuming a demonstration to be of the same optimality throughout time steps and failing to provide any interpretation w.r.t knowledge learned from the noisy set. Addressing these problems, we propose \method by evaluating and imitating at the sub-demonstration level, encoding action primitives of varying quality into different skills. Concretely, SDIL consists of a high-level controller to discover skills and a skill-conditioned module to capture action-taking policies, and is trained following a two-phase pipeline by first discovering skills with all demonstrations and then adapting the controller to only the clean set. A mutual-information-based regularization and a dynamic sub-demonstration optimality estimator are designed to promote disentanglement in the skill space. Extensive experiments are conducted over two gym environments and a real-world healthcare dataset to demonstrate the superiority of SDIL in learning from sub-optimal demonstrations and its improved interpretability by examining learned skills. Tianxiang Zhao 0001, Wenchao Yu, Suhang Wang, Lu Wang 0029, Xiang Zhang 0001, Yuncong Chen, Yanchi Liu, Wei Cheng 0002 |
KDD | 1 |
| 2023 | You Need to Look Globally: Discovering Representative Topology Structures to Enhance Graph Neural Network
Huaisheng Zhu, Xianfeng Tang, Tianxiang Zhao 0001, Suhang Wang |
PAKDD (2) | 3 |
| 2023 | Towards Faithful and Consistent Explanations for Graph Neural NetworksabstractUncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over recent years. Instance-level GNN explanation aims to discover critical input elements, like nodes or edges, that the target GNN relies upon for making predictions. Though various algorithms are proposed, most of them formalize this task by searching the minimal subgraph which can preserve original predictions. However, an inductive bias is deep-rooted in this framework: several subgraphs can result in the same or similar outputs as the original graphs. Consequently, they have the danger of providing spurious explanations and fail to provide consistent explanations. Applying them to explain weakly-performed GNNs would further amplify these issues. To address this problem, we theoretically examine the predictions of GNNs from the causality perspective. Two typical reasons of spurious explanations are identified: confounding effect of latent variables like distribution shift, and causal factors distinct from the original input. Observing that both confounding effects and diverse causal rationales are encoded in internal representations, we propose a simple yet effective countermeasure by aligning embeddings. Concretely, concerning potential shifts in the high-dimensional space, we design a distribution-aware alignment algorithm based on anchors. This new objective is easy to compute and can be incorporated into existing techniques with no or little effort. Theoretical analysis shows that it is in effect optimizing a more faithful explanation objective in design, which further justifies the proposed approach. Tianxiang Zhao 0001, Xiang Zhang 0001, Suhang Wang |
WSDM | 1 |
| 2023 | Faithful and Consistent Graph Neural Network Explanations with Rationale AlignmentabstractUncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over recent years. Instance-level GNN explanation aims to discover critical input elements, such as nodes or edges, that the target GNN relies upon for making predictions. Though various algorithms are proposed, most of them formalize this task by searching the minimal subgraph, which can preserve original predictions. However, an inductive bias is deep-rooted in this framework: Several subgraphs can result in the same or similar outputs as the original graphs. Consequently, they have the danger of providing spurious explanations and failing to provide consistent explanations. Applying them to explain weakly performed GNNs would further amplify these issues. To address this problem, we theoretically examine the predictions of GNNs from the causality perspective. Two typical reasons for spurious explanations are identified: confounding effect of latent variables like distribution shift and causal factors distinct from the original input. Observing that both confounding effects and diverse causal rationales are encoded in internal representations, we propose a new explanation framework with an auxiliary alignment loss, which is theoretically proven to be optimizing a more faithful explanation objective intrinsically. Concretely for this alignment loss, a set of different perspectives are explored: anchor-based alignment, distributional alignment based on Gaussian mixture models, mutual-information-based alignment, and so on. A comprehensive study is conducted both on the effectiveness of this new framework in terms of explanation faithfulness/consistency and on the advantages of these variants. For our codes, please refer to the following URL link: https://github.com/TianxiangZhao/GraphNNExplanation Tianxiang Zhao 0001, Xiang Zhang 0001, Suhang Wang |
ACM Trans. Intell. Syst. Technol. | 1 |
| 2022 | Explanation Guided Contrastive Learning for Sequential RecommendationabstractRecently, contrastive learning has been applied to the sequential recommendation task to address data sparsity caused by users with few item interactions and items with few user adoptions. Nevertheless, the existing contrastive learning-based methods fail to ensure that the positive (or negative) sequence obtained by some random augmentation (or sequence sampling) on a given anchor user sequence remains to be semantically similar (or different). When the positive and negative sequences turn out to be false positive and false negative respectively, it may lead to degraded recommendation performance. In this work, we address the above problem by proposing Explanation Guided Augmentations (EGA) and Explanation Guided Contrastive Learning for Sequential Recommendation (EC4SRec) model framework. The key idea behind EGA is to utilize explanation method(s) to determine items' importance in a user sequence and derive the positive and negative sequences accordingly. EC4SRec then combines both self-supervised and supervised contrastive learning over the positive and negative sequences generated by EGA operations to improve sequence representation learning for more accurate recommendation results. Extensive experiments on four real-world benchmark datasets demonstrate that EC4SRec outperforms the state-of-the-art sequential recommendation methods and two recent contrastive learning-based sequential recommendation methods, CL4SRec and DuoRec. Our experiments also show that EC4SRec can be easily adapted for different sequence encoder backbones (e.g., GRU4Rec and Caser), and improve their recommendation performance. Lei Wang 0185, Ee-Peng Lim, Zhiwei Liu 0001, Tianxiang Zhao 0001 |
CIKM | 4 |
| 2022 | Towards Fair Classifiers Without Sensitive Attributes: Exploring Biases in Related FeaturesabstractDespite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their adoption on high-stake applications. Thus, many efforts have been taken for developing fair machine learning models. Most of them require that sensitive attributes are available during training to learn fair models. However, in many real-world applications, it is usually infeasible to obtain the sensitive attributes due to privacy or legal issues, which challenges existing fair-ensuring strategies. Though the sensitive attribute of each data sample is unknown, we observe that there are usually some non-sensitive features in the training data that are highly correlated with sensitive attributes, which can be used to alleviate the bias. Therefore, in this paper, we study a novel problem of exploring features that are highly correlated with sensitive attributes for learning fair and accurate classifiers. We theoretically show that by minimizing the correlation between these related features and model prediction, we can learn a fair classifier. Based on this motivation, we propose a novel framework which simultaneously uses these related features for accurate prediction and enforces fairness. In addition, the model can dynamically adjust the regularization weight of each related feature to balance its contribution on model classification and fairness. Experimental results on real-world datasets demonstrate the effectiveness of the proposed model for learning fair models with high classification accuracy. Tianxiang Zhao 0001, Enyan Dai, Kai Shu, Suhang Wang |
WSDM | 1 |
| 2022 | Exploring Edge Disentanglement for Node ClassificationabstractEdges in real-world graphs are typically formed by a variety of factors and carry diverse relation semantics. For example, connections in a social network could indicate friendship, being colleagues, or living in the same neighborhood. However, these latent factors are usually concealed behind mere edge existence due to the data collection and graph formation processes. Despite rapid developments in graph learning over these years, most models take a holistic approach and treat all edges as equal. One major difficulty in disentangling edges is the lack of explicit supervisions. In this work, with close examination of edge patterns, we propose three heuristics and design three corresponding pretext tasks to guide the automatic edge disentanglement. Concretely, these self-supervision tasks are enforced on a designed edge disentanglement module to be trained jointly with the downstream node classification task to encourage automatic edge disentanglement. Channels of the disentanglement module are expected to capture distinguishable relations and neighborhood interactions, and outputs from them are aggregated as node representations. The proposed is easy to be incorporated with various neural architectures, and we conduct experiments on 6 real-world datasets. Empirical results show that it can achieve significant performance gains. Tianxiang Zhao 0001, Xiang Zhang 0001, Suhang Wang |
WWW | 1 |
| 2021 | GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural NetworksabstractNode classification is an important research topic in graph learning. Graph neural networks (GNNs) have achieved state-of-the-art performance of node classification. However, existing GNNs address the problem where node samples for different classes are balanced; while for many real-world scenarios, some classes may have much fewer instances than others. Directly training a GNN classifier in this case would under-represent samples from those minority classes and result in sub-optimal performance. Therefore, it is very important to develop GNNs for imbalanced node classification. However, the work on this is rather limited. Hence, we seek to extend previous imbalanced learning techniques for i.i.d data to the imbalanced node classification task to facilitate GNN classifiers. In particular, we choose to adopt synthetic minority over-sampling algorithms, as they are found to be the most effective and stable. This task is non-trivial, as previous synthetic minority over-sampling algorithms fail to provide relation information for newly synthesized samples, which is vital for learning on graphs. Moreover, node attributes are high-dimensional. Directly over-sampling in the original input domain could generates out-of-domain samples, which may impair the accuracy of the classifier. We propose a novel framework, \method, in which an embedding space is constructed to encode the similarity among the nodes. New samples are synthesize in this space to assure genuineness. In addition, an edge generator is trained simultaneously to model the relation information, and provide it for those new samples. This framework is general and can be easily extended into different variations. The proposed framework is evaluated using three different datasets, and it outperforms all baselines with a large margin. Tianxiang Zhao 0001, Xiang Zhang 0001, Suhang Wang |
WSDM | 1 |
| 2020 | Balancing Quality and Human Involvement: An Effective Approach to Interactive Neural Machine TranslationabstractConventional interactive machine translation typically requires a human translator to validate every generated target word, even though most of them are correct in the advanced neural machine translation (NMT) scenario. Previous studies have exploited confidence approaches to address the intensive human involvement issue, which request human guidance only for a few number of words with low confidences. However, such approaches do not take the history of human involvement into account, and optimize the models only for the translation quality while ignoring the cost of human involvement. In response to these pitfalls, we propose a novel interactive NMT model, which explicitly accounts the history of human involvements and particularly is optimized towards two objectives corresponding to the translation quality and the cost of human involvement, respectively. Specifically, the model jointly predicts a target word and a decision on whether to request human guidance, which is based on both the partial translation and the history of human involvements. Since there is no explicit signals on the decisions of requesting human guidance in the bilingual corpus, we optimize the model with the reinforcement learning technique which enables our model to accurately predict when to request human guidance. Simulated and real experiments show that the proposed model can achieve higher translation quality with similar or less human involvement over the confidence-based baseline. Tianxiang Zhao 0001, Lemao Liu, Guoping Huang, Yingling Liu, Guiquan Liu, Shuming Shi 0001 |
AAAI | 1 |
| 2020 | Semi-Supervised Graph-to-Graph TranslationabstractGraph translation is very promising research direction and has awide range of potential real-world applications. Graph is a natural structure for representing relationship and interactions, and its translation can encode the intrinsic semantic changes of relation-ships in different scenarios. However, despite its seemingly wide possibilities, usage of graph translation so far is still quite limited.One important reason is the lack of high-quality paired dataset. For example, we can easily build graphs representing peoples? shared music tastes and those representing co-purchase behavior, but a well paired dataset is much more expensive to obtain. Therefore,in this work, we seek to provide a graph translation model in the semi-supervised scenario. This task is non-trivial, because graph translation involves changing the semantics in the form of link topology and node attributes, which is difficult to capture due to the combinatory nature and inter-dependencies. Furthermore, due to the high order of freedom in graph's composition, it is difficult to assure the generalization ability of trained models. These difficulties impose a tighter requirement for the exploitation of unpaired samples. Addressing them, we propose to construct a dual representation space, where transformation is performed explicitly to model the semantic transitions. Special encoder/decoder structures are designed, and auxiliary mutual information loss is also adopted to enforce the alignment of unpaired/paired examples. We evaluate the proposed method in three different datasets. Tianxiang Zhao 0001, Xianfeng Tang, Xiang Zhang 0001, Suhang Wang |
CIKM | 1 |