Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Tyler Derr

dblp:207/7927 · DBLP profile ↗
← Back
63ranked-venue papers
9as first author
48since 2021 · last 2026
0000-0002-0080-5998ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 50 · 9 first-author · 38 since 2021Databases, data management, data science and information retrieval · 41 · 9 first-author · 30 since 2021Graphics, computer vision, multimedia, augmented reality and games · 8 · 7 since 2021Applied, interdisciplinary, general and emerging computing · 8 · 4 since 2021Human-computer interaction and ubiquitous computing · 4 · 1 first-author · 1 since 2021Systems, architecture and hardware · 1Computer networks · 1 · 1 since 2021Theory of computation · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
33 papers
Graph learning · 59% Trustworthy machine learning · 22% Language models and text generation · 4%
Databases, data mining, and information retrieval
15 papers
Recommender systems · 42% Knowledge graphs · 23% Web and social media mining · 17%
Interdisciplinary, comprehensive, and emerging computing
5 papers
Bioinformatics and computational biology · 60% Medical and health informatics · 22% Smart cities and intelligent transportation · 18%

Topics — the 30 heaviest of 90, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Graph learning
graph neural network
8.2142026
SaVe-TAG: LLM-based Interpolation for Long-Tailed Text-Attributed Graphs · KDD (1) 2026
Edge Classification on Graphs: New Directions in Topological Imbalance · WSDM 2025
Robust Graph Neural Networks via Unbiased Aggregation · NeurIPS 2024
Machine learning › Trustworthy machine learning
fairness
2.742024
Can One Embedding Fit All? A Multi-Interest Learning Paradigm Towards Improving User Interest Diversity Fairness · WWW 2024
Leveraging Opposite Gender Interaction Ratio as a Path towards Fairness in Online Dating Recommendations Based on User Sexual Orientation · AAAI 2024
Fairness and Explainability: Bridging the Gap towards Fair Model Explanations · AAAI 2023
Machine learning › Graph learning
link prediction
1.822026
Graph2Video: Leveraging Video Models to Model Dynamic Graph Evolution · AAAI 2026
A Topological Perspective on Demystifying GNN-Based Link Prediction Performance · ICLR 2024
Machine learning › Graph learning
dynamic graph learning
1.622026
Graph2Video: Leveraging Video Models to Model Dynamic Graph Evolution · AAAI 2026
THINK: Temporal Hypergraph Hyperbolic Network · ICDM 2022
Recommender systems
fairness-aware recommendation
1.522024
Can One Embedding Fit All? A Multi-Interest Learning Paradigm Towards Improving User Interest Diversity Fairness · WWW 2024
Leveraging Opposite Gender Interaction Ratio as a Path towards Fairness in Online Dating Recommendations Based on User Sexual Orientation · AAAI 2024
Machine learning › Graph learning › graph neural network
scalable graph neural network
1.422024
The 5th International Workshop on Machine Learning on Graphs (MLoG) · WSDM 2024
The 3rd International Workshop on Machine Learning on Graphs (MLoG) · WSDM 2023
Machine learning › Trustworthy machine learning
interpretability
1.222023
Fairness and Explainability: Bridging the Gap towards Fair Model Explanations · AAAI 2023
On Structural Explanation of Bias in Graph Neural Networks · KDD 2022
Machine learning › Trustworthy machine learning › fairness › fair graph learning
fair graph neural network
1.122022
Improving Fairness in Graph Neural Networks via Mitigating Sensitive Attribute Leakage · KDD 2022
On Structural Explanation of Bias in Graph Neural Networks · KDD 2022
Machine learning › Graph learning › graph neural network
graph convolutional network
1.122023
Collaboration-Aware Graph Convolutional Network for Recommender Systems · WWW 2023
Epidemic Graph Convolutional Network · WSDM 2020
Machine learning › Graph learning › graph neural network › node classification
long-tailed node classification
1.012026
SaVe-TAG: LLM-based Interpolation for Long-Tailed Text-Attributed Graphs · KDD (1) 2026
Machine learning › Graph learning › link prediction
temporal link prediction
1.012026
Graph2Video: Leveraging Video Models to Model Dynamic Graph Evolution · AAAI 2026
Machine learning › Graph learning
text-attributed graph
1.012026
SaVe-TAG: LLM-based Interpolation for Long-Tailed Text-Attributed Graphs · KDD (1) 2026
Machine learning › Learning theory › statistical learning theory › regularization theory
vicinal risk minimization
1.012026
SaVe-TAG: LLM-based Interpolation for Long-Tailed Text-Attributed Graphs · KDD (1) 2026
Machine learning › Graph learning
graph representation learning
0.922021
Node Similarity Preserving Graph Convolutional Networks · WSDM 2021
Deep Graph Learning: Foundations, Advances and Applications · KDD 2020
Machine learning › Graph learning
network embedding
0.922021
Node Similarity Preserving Graph Convolutional Networks · WSDM 2021
ROSE: Role-based Signed Network Embedding · WWW 2020
Machine learning › Learning paradigms
class imbalance
0.912025
Edge Classification on Graphs: New Directions in Topological Imbalance · WSDM 2025
Machine learning › Trustworthy machine learning › uncertainty estimation
conformal prediction
0.912025
Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware Perspective · AAAI 2025
Machine learning › Graph learning › graph inference › graph prediction
edge classification
0.912025
Edge Classification on Graphs: New Directions in Topological Imbalance · WSDM 2025
Machine learning › Graph learning
graph generation
0.912025
A Large-scale Training Paradigm for Graph Generative Models · ICLR 2025
Natural language and speech › Language models and text generation › large language model training
large-scale pretraining
0.912025
A Large-scale Training Paradigm for Graph Generative Models · ICLR 2025
Natural language and speech › Language models and text generation
retrieval-augmented generation
0.912025
Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware Perspective · AAAI 2025
Machine learning › Graph learning › data-centric graph learning
topology imbalance
0.912025
Edge Classification on Graphs: New Directions in Topological Imbalance · WSDM 2025
Knowledge graphs
knowledge graph reasoning
0.912025
Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware Perspective · AAAI 2025
Web and social media mining
social network analysis
0.912025
BTS: A Comprehensive Benchmark for Tie Strength Prediction · KDD (2) 2025
Web and social media mining › social network analysis
tie strength prediction
0.912025
BTS: A Comprehensive Benchmark for Tie Strength Prediction · KDD (2) 2025
Machine learning and data management
uncertainty quantification
0.912025
Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware Perspective · AAAI 2025
Empirical software engineering
benchmarking
0.912025
BTS: A Comprehensive Benchmark for Tie Strength Prediction · KDD (2) 2025
Machine learning › Graph learning › network embedding
signed network embedding
0.822020
ROSE: Role-based Signed Network Embedding · WWW 2020
Signed Graph Convolutional Networks · ICDM 2018
Machine learning › Trustworthy machine learning › robustness
adversarial robustness
0.812024
Robust Graph Neural Networks via Unbiased Aggregation · NeurIPS 2024
Natural language and speech › Question answering and dialogue systems › knowledge-intensive question answering
multi-document question answering
0.812024
Knowledge Graph Prompting for Multi-Document Question Answering · AAAI 2024

Methods — techniques the papers use, named apart from their topics

graph neural network · 6.6machine learning · 2.8reinforcement learning · 2.3uncertainty quantification · 1.7tie resilience evaluation · 1.7pseudo-labeling · 1.7conformal prediction · 1.7video foundation model · 1.0spatio-temporal modeling · 1.0link-level embedding · 1.0large language model · 1.0confidence-based edge assignment · 1.0fine-tuning · 0.9unsupervised anomaly detection · 0.8topological concentration · 0.8survey · 0.8robust estimation · 0.8re-weighting · 0.8
YearPublicationVenuePosition
2026 Graph2Video: Leveraging Video Models to Model Dynamic Graph Evolution
abstract
Dynamic graphs are common in real‑world systems such as social media, recommender systems, and traffic networks. Existing dynamic graph models for link prediction often fall short in capturing the full complexity of temporal evolution. They tend to overlook fine‑grained variations in interaction order, struggle with dependencies that span long time horizons, and provide limited modeling of pair‑specific relational dynamics. To address those challenges, we propose Graph2Video, a video‑inspired framework that views the temporal neighborhood of a target link as a sequence of “graph frames”. By stacking temporally ordered subgraph frames into a “graph video”, Graph2Video leverages the inductive biases of video foundation models to capture both fine-grained local variations and long-range temporal dynamics. It generates a link-level embedding that serves as a lightweight, plug-and-play, link-centric memory unit. This embedding integrates seamlessly into existing dynamic graph encoders, effectively addressing the limitations of prior approaches. Extensive experiments on benchmark datasets show that Graph2Video outperforms state‑of‑the‑art baselines in the link prediction task on most cases. The results highlight that borrowing spatio‑temporal modeling techniques from computer vision provides a principled and effective avenue for advancing dynamic graph learning.
Hua Liu 0008, Yanbin Wei, Tyler Derr, Haoyu Han 0001, Yu Zhang 0006
AAAI4
2026 SaVe-TAG: LLM-based Interpolation for Long-Tailed Text-Attributed Graphs
abstract
Real-world graph data often follows long-tailed distributions, making it difficult for Graph Neural Networks (GNNs) to generalize well across both head and tail classes. Recent advances in Vicinal Risk Minimization (VRM) have shown promise in mitigating class imbalance with numeric interpolation; however, existing approaches largely rely on embedding-space arithmetic, which fails to capture the rich semantics inherent in text-attributed graphs. In this work, we propose our method, SaVe-TAG (Semantic-aware Vicinal Risk Minimization for Long-Tailed Text-Attributed Graphs), a novel VRM framework that leverages Large Language Models (LLMs) to perform text-level interpolation, generating on-manifold, boundary-enriching synthetic samples for minority classes. To mitigate the risk of noisy generation, we introduce a confidence-based edge assignment mechanism that uses graph topology as a natural filter to ensure structural consistency. We provide theoretical justification for our method and conduct extensive experiments on benchmark datasets, showing that our approach consistently outperforms both numeric interpolation and prior long-tailed node classification baselines. Our results highlight the importance of integrating semantic and structural signals for balanced and effective learning on text-attributed graphs. The source code is publicly available at: https://github.com/LWang-Laura/SaVe-TAG.
Yu Wang 0160, Bo Ni, Yuying Zhao, Yao Ma 0001, Tyler Derr
KDD (1)7
2026 Introduction to the Special Issue on Transformers
Feng Xia 0001, Tyler Derr, Anh Tuan Luu, Richa Singh 0001, Aline Villavicencio
ACM Trans. Intell. Syst. Technol.2
2026 A Survey on Signed Network Reconstruction Modeling and Its Applications
abstract
The proliferation in the use of Online Social Networks has revolutionized information sharing and consumption, leading to the development of advanced techniques such as link prediction, recommendation systems, community detection, node classification, and network representation learning. However, the availability and quality of real-world datasets for testing these algorithms pose challenges. Synthetic signed datasets generated through signed network reconstruction models offer alternatives for algorithm testing and experimentation. This survey presents an overview of state-of-the-art signed network reconstruction modeling techniques, evaluates their performance through rigorous experimental analysis, explores real-world applications, discusses challenges and open research problems, and guides future research efforts in the field. By consolidating knowledge and providing insights into existing models, this survey contributes to advancing the understanding and improvement of signed network reconstruction modeling. Various research papers discussed in this survey along with publicly available links to their codes are available at: https://github.com/Aikta-Arya/Signed-Network-Reconstruction-Modeling .
Aikta Arya, Pradumn Kumar Pandey, Niloy Ganguly, Tyler Derr
ACM Trans. Knowl. Discov. Data4
2025 Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware Perspective
abstract
Recently, Knowledge Graphs (KGs) have been successfully coupled with Large Language Models (LLMs) to mitigate their hallucinations and enhance their reasoning capability, e.g., KG-based retrieval-augmented framework. However, current KG-LLM frameworks lack rigorous uncertainty estimation, limiting their reliable deployment in applications where the cost of errors is significant. Directly incorporating uncertainty quantification into KG-LLM frameworks presents a challenge due to their more complex architectures and the intricate interactions between the knowledge graph and language model components. To address this crucial gap, we propose a new trustworthy KG-LLM framework, UAG (Uncertainty Aware Knowledge-Graph Reasoning), which incorporates uncertainty quantification into the KG-LLM framework. We design an uncertainty-aware multi-step reasoning framework that leverages conformal prediction to provide a theoretical guarantee on the prediction set. To manage the error rate of the multi-step process, we additionally introduce an error rate control module to adjust the error rate within the individual components. Extensive experiments show that UAG can achieve any pre-defined coverage rate while reducing the prediction set/interval size by 40% on average over the baselines.
Bo Ni, Yu Wang 0160, Erik Blasch, Tyler Derr
AAAI5
2025 Signed Network Dataset Repository: Extracting Signed Relations From Social Networks
abstract
The proliferation in the use of social media and networking platforms has enhanced frequent interactions among individuals. The signed networks can be utilized to best perceive such complex relations. However, these real-world signed network datasets are scarce as the real-world signed datasets often involve dealing with sensitive information about individuals and their relationships. The ethical and privacy concerns of various social media platforms can further limit the availability of datasets for research and academic purposes. Furthermore, the availability of signed bipartite network datasets is even scarcer than signed network datasets. Existing signed network datasets also lack node/edge level attributes, yet recent trends in graph analytics have shown the significance of these features, for example, with GNNs, to advance benchmarking. To address such issues, we present three datasets in this paper: Reddit Posts (bipartite network with primary node level attributes and secondary level edge attributes), Bitcoin-OTC, and Bitcoin-Alpha datasets (signed networks with primary node and edge level attributes). Additionally, we explore potential research applications the dataset opens up across various domains. Various datasets discussed in this paper, along with already existing signed network datasets, are made publicly available using Signed Network Dataset Repository (SigNET Repo) at: https://aikta-arya.github.io/SigNET-/
Aikta Arya, Pradumn Kumar Pandey, Tyler Derr
ICC3
2025 A Large-scale Training Paradigm for Graph Generative Models
abstract
Large Generative Models (LGMs) such as GPT, Stable Diffusion, Sora, and Suno are trained on a huge amount of texts, images, videos, and audio that are extremely diverse from numerous domains. This large-scale training paradigm on diverse well-curated data enhances the creativity and diversity of the generated content. However, all previous graph-generative models (e.g., GraphRNN, MDVAE, MoFlow, GDSS, and DiGress) have been trained only on one dataset each time, which cannot replicate the revolutionary success achieved by LGMs in other fields. To remedy this crucial gap, we propose a large-scale training paradigm that uses a large corpus of graphs (over 5000 graphs) from 13 domains, leading to the development of large graph generative models (LGGMs). We empirically demonstrate that the pre-trained LGGMs have superior zero-shot generative capability to existing graph generative models. Furthermore, our pre-trained LGGMs can be easily fine-tuned with graphs from target domains and demonstrate even better performance than those directly trained from scratch, behaving as a solid starting point for real-world customization. Inspired by Stable Diffusion, we further equip LGGMs with the Text-to-Graph generation capability, such as providing the description of the network name and domain (i.e., "The power-1138-bus graph represents a network of buses in a power distribution system.") and network statistics (i.e., "The graph has a low average degree, suitable for modeling social media interactions."). This Text-to-Graph capability integrates the extensive world knowledge in the underlying language model, offering users fine-grained control of the generated graphs. We release the code, the model checkpoint, and the datasets at https://github.com/KINDLab-Fly/LGGM.
Yu Wang 0160, Ryan Rossi, Namyong Park 0001, Huiyuan Chen, Nesreen K. Ahmed, Puja Trivedi, Franck Dernoncourt, Danai Koutra, Tyler Derr
ICLR9
2025 Machine Learning on Graphs in the Era of Generative Artificial Intelligence
abstract
Graphs, which encode pairwise relations between entities, serve as a fundamental data structure across real-world domains. Many critical applications can be formulated as graph-based tasks, and graph machine learning (GML), from the shallow embedding models to graph neural networks and further advanced to the most powerful graph transformers, has been well-established to automate knowledge discovery and decision-making on graphs. In parallel, the recent emergence of large foundational models has driven machine learning into a new era of Generative Artificial Intelligence (Gen-AI), and this revolution presents both unprecedented opportunities and profound challenges for the well-established GML paradigms. However, few investigations have analyzed and envisioned how GML should evolve to harness these opportunities, address these challenges, and embrace this new Gen-AI era. To fill in this gap, we organize the first international Workshop on Machine Learning on Graphs in the Era of Generative Artificial Intelligence (MLoG-GenAI), held in connection with the 31st ACM Conference on Knowledge Discovery and Data Mining, which provides a venue to gather academic researchers and industry practitioners to discuss and picture the development of GML in the new Gen-AI era.
Yu Wang 0160, Yu Zhang 0044, Zhichun Guo, Harry Shomer, Haoyu Han 0001, Tyler Derr, Nesreen K. Ahmed, Mahantesh Halappanavar, Jiliang Tang
KDD (2)6
2025 BTS: A Comprehensive Benchmark for Tie Strength Prediction
abstract
The rapid rise of online social networks underscores the need to understand the heterogeneous strengths of online relationships. Yet, efforts to assess tie strength (TS) are hindered by the lack of ground-truth labels, differing research perspectives, and limited model performance in real-world settings. To address this gap, we introduce BTS, a comprehensive Benchmark for Tie Strength prediction, aiming to establish a standardized foundation for evaluating and advancing TS prediction methodologies. Specifically, our contributions are: TS Pseudo-Label Techniques -- we categorize TS into seven standardized pseudo-labeling techniques based on prior literature; TS Dataset Collection -- we present a representative collection of three social networks and perform data analysis by investigating the class distributions and correlations across the generated pseudo-labels; TS Pseudo-Label Evaluation Framework -- we propose a standardized framework to evaluate the pseudo-label quality from the perspective of tie resilience; Benchmarking -- we evaluate existing tie strength prediction model performance using the BTS dataset collection, exploring the effects of different experiment settings, models, and evaluation criteria on the results. Furthermore, we derive key insights to enhance existing methods and shed light on promising directions for future research in this domain. The BTS dataset collection, along with the curation codes and experimental scripts, is all available at: https://github.com/XueqiC/Awesome-Tie-Strength-Prediction.
Xueqi Cheng 0002, Catherine Yang, Yuying Zhao, Yu Wang 0160, Hamid Karimi, Tyler Derr
KDD (2)6
2025 Edge Classification on Graphs: New Directions in Topological Imbalance
abstract
Recent years have witnessed the remarkable success of applying Graph Machine Learning (GML) to node/graph classification and link prediction. However, edge classification task that enjoys numerous real-world applications such as social network analysis and cybersecurity, has not seen significant advancement with the progress of GML. To address this gap, our study pioneers a comprehensive approach to edge classification. We identify a novel 'Topological Imbalance Issue,' which arises from the skewed distribution of edges across different classes, affecting the local subgraph of each edge and harming the performance of edge classifications. Inspired by recent node-level studies observing performance discrepancies with varying local structural patterns, we aim to investigate if the topological imbalanced edge classification tasks can also be mitigated by characterizing the local class distribution variance. Thus, we introduce Topological Entropy (TE), a novel topological-based metric that measures the topological imbalance for each edge. Our empirical studies confirm that TE effectively measures local class distribution variance, and indicate that prioritizing edges with high TE values can help address the issue of topological imbalance. Inspired by this observation, we develop two strategies - Topological Reweighting and TE Wedge-based Mixup - to adaptively focus training on (synthetic) edges based on their TEs. While topological reweighting directly manipulates training edge weights according to TE, our wedge-based mixup interpolates synthetic edges between high TE wedges. To further enhance performance, we integrate these strategies into a novel topological imbalance strategy for edge classification: TopoEdge. Extensive experiments on real-world datasets demonstrate the efficacy of our proposed strategies. Our code and data are available at https://github.com/XueqiC/TopoEdge. Additionally, our curated datasets and designed experimental settings establish a new benchmark for future edge classification research, particularly in addressing imbalance issues.
Xueqi Cheng 0002, Yu Wang 0160, Yunchao Liu 0001, Yuying Zhao, Charu C. Aggarwal, Tyler Derr
WSDM6
2025 Fairness and Diversity in Recommender Systems: A Survey
abstract
Recommender systems (RS) are effective tools for mitigating information overload and have seen extensive applications across various domains. However, the single focus on utility goals proves to be inadequate in addressing real-world concerns, leading to increasing attention to fairness-aware and diversity-aware RS. While most existing studies explore fairness and diversity independently, we identify strong connections between these two domains. In this survey, we first discuss each of them individually and then dive into their connections. Additionally, motivated by the concepts of user-level and item-level fairness, we broaden the understanding of diversity to encompass not only the item level but also the user level. With this expanded perspective on user and item-level diversity, we re-interpret fairness studies from the viewpoint of diversity. This fresh perspective enhances our understanding of fairness-related work and paves the way for potential future research directions. Articles discussed in this survey along with public code links are available at: https://github.com/YuyingZhao/Awesome-Fairness-and-Diversity-Papers-in-Recommender-Systems
Yuying Zhao, Yu Wang 0160, Yunchao Liu 0001, Xueqi Cheng 0002, Charu C. Aggarwal, Tyler Derr
ACM Trans. Intell. Syst. Technol.6
2024 Knowledge Graph Prompting for Multi-Document Question Answering
abstract
The `pre-train, prompt, predict' paradigm of large language models (LLMs) has achieved remarkable success in open-domain question answering (OD-QA). However, few works explore this paradigm in multi-document question answering (MD-QA), a task demanding a thorough understanding of the logical associations among the contents and structures of documents. To fill this crucial gap, we propose a Knowledge Graph Prompting (KGP) method to formulate the right context in prompting LLMs for MD-QA, which consists of a graph construction module and a graph traversal module. For graph construction, we create a knowledge graph (KG) over multiple documents with nodes symbolizing passages or document structures (e.g., pages/tables), and edges denoting the semantic/lexical similarity between passages or document structural relations. For graph traversal, we design an LLM-based graph traversal agent that navigates across nodes and gathers supporting passages assisting LLMs in MD-QA. The constructed graph serves as the global ruler that regulates the transitional space among passages and reduces retrieval latency. Concurrently, the graph traversal agent acts as a local navigator that gathers pertinent context to progressively approach the question and guarantee retrieval quality. Extensive experiments underscore the efficacy of KGP for MD-QA, signifying the potential of leveraging graphs in enhancing the prompt design and retrieval augmented generation for LLMs. Our code: https://github.com/YuWVandy/KG-LLM-MDQA.
Yu Wang 0160, Nedim Lipka, Ryan Rossi, Alexa F. Siu, Ruiyi Zhang 0002, Tyler Derr
AAAI6
2024 Leveraging Opposite Gender Interaction Ratio as a Path towards Fairness in Online Dating Recommendations Based on User Sexual Orientation
abstract
Online dating platforms have gained widespread popularity as a means for individuals to seek potential romantic relationships. While recommender systems have been designed to improve the user experience in dating platforms by providing personalized recommendations, increasing concerns about fairness have encouraged the development of fairness-aware recommender systems from various perspectives (e.g., gender and race). However, sexual orientation, which plays a significant role in finding a satisfying relationship, is under-investigated. To fill this crucial gap, we propose a novel metric, Opposite Gender Interaction Ratio (OGIR), as a way to investigate potential unfairness for users with varying preferences towards the opposite gender. We empirically analyze a real online dating dataset and observe existing recommender algorithms could suffer from group unfairness according to OGIR. We further investigate the potential causes for such gaps in recommendation quality, which lead to the challenges of group quantity imbalance and group calibration imbalance. Ultimately, we propose a fair recommender system based on re-weighting and re-ranking strategies to respectively mitigate these associated imbalance challenges. Experimental results demonstrate both strategies improve fairness while their combination achieves the best performance towards maintaining model utility while improving fairness.
Yuying Zhao, Yu Wang 0160, Pamela J. Wisniewski, Charu C. Aggarwal, Tyler Derr
AAAI6
2024 EDGE-UP: Enhanced Dynamic GNN Ensemble for Unfollow Prediction in Online Social Networks
Soheila Farokhi, Arash Azizian Foumani, Xiaojun Qi 0001, Tyler Derr, Hamid Karimi
ASONAM (1)4
2024 Data Quality-aware Graph Machine Learning
abstract
Recent years have seen a significant shift in Artificial Intelligence from model-centric to data-centric approaches, highlighted by the success of large foundational models. Following this trend, despite numerous innovations in graph machine learning model design, graph-structured data often suffers from data quality issues, jeopardizing the progress of Data-centric AI in graph-structured applications. Our proposed tutorial addresses this gap by raising awareness about data quality issues within the graph machine-learning community. We provide an overview of existing topology, imbalance, bias, limited data, and abnormality issues in graph data. Additionally, we highlight recent developments in foundational graph models that focus on identifying, investigating, mitigating, and resolving these issues.
Yu Wang 0160, Kaize Ding, Jian Kang 0008, Ryan Rossi, Tyler Derr
CIKM6
2024 Topology-aware Retrieval Augmentation for Text Generation
Yu Wang 0160, Nedim Lipka, Ruiyi Zhang 0002, Alexa F. Siu, Yuying Zhao, Bo Ni, Xin Wang 0061, Ryan Rossi, Tyler Derr
CIKM9
2024 A Topological Perspective on Demystifying GNN-Based Link Prediction Performance
abstract
Graph Neural Networks (GNNs) have shown great promise in learning node embeddings for link prediction (LP). While numerous studies improve the overall GNNs' LP performance, none have explored their varying performance across different nodes and the underlying reasons. To this end, we demystify which nodes perform better from the perspective of their local topology. Despite the widespread belief that low-degree nodes exhibit worse LP performance, we surprisingly observe an inconsistent performance trend. This prompts us to propose a node-level metric, Topological Concentration (TC), based on the intersection of the local subgraph of each node with the ones of its neighbors. We empirically demonstrate that TC correlates with LP performance more than other node-level topological metrics, better identifying low-performing nodes than using degree. With TC, we discover a novel topological distribution shift issue in which nodes' newly joined neighbors tend to become less interactive with their existing neighbors, compromising the generalizability of node embeddings for LP at testing time. To make the computation of TC scalable, We further propose Approximated Topological Concentration (ATC) and justify its efficacy in approximating TC with reduced computation complexity. Given the positive correlation between node TC and its LP performance, we explore the potential of boosting LP performance via enhancing TC by re-weighting edges in the message-passing and discuss its effectiveness with limitations. Our code is publicly available at https://github.com/YuWVandy/Topo_LP_GNN.
Yu Wang 0160, Tong Zhao 0003, Yuying Zhao, Yunchao Liu 0001, Xueqi Cheng 0002, Neil Shah, Tyler Derr
ICLR7
2024 FT-AED: Benchmark Dataset for Early Freeway Traffic Anomalous Event Detection
abstract
Early and accurate detection of anomalous events on the freeway, such as accidents, can improve emergency response and clearance. However, existing delays and mistakes from manual crash reporting records make it a difficult problem to solve. Current large-scale freeway traffic datasets are not designed for anomaly detection and ignore these challenges. In this paper, we introduce the first large-scale lane-level freeway traffic dataset for anomaly detection. Our dataset consists of a month of weekday radar detection sensor data collected in 4 lanes along an 18-mile stretch of Interstate 24 heading toward Nashville, TN, comprising over 3.7 million sensor measurements. We also collect official crash reports from the Tennessee Department of Transportation Traffic Management Center and manually label all other potential anomalies in the dataset. To show the potential for our dataset to be used in future machine learning and traffic research, we benchmark numerous deep learning anomaly detection models on our dataset. We find that unsupervised graph neural network autoencoders are a promising solution for this problem and that ignoring spatial relationships leads to decreased performance. We demonstrate that our methods can reduce reporting delays by over 10 minutes on average while detecting 75% of crashes. Our dataset and all preprocessing code needed to get started are publicly released at https://vu.edu/ft-aed/ to facilitate future research.
Austin Coursey, Junyi Ji, Marcos Quiñones-Grueiro, William Barbour, Yuhang Zhang 0009, Tyler Derr, Gautam Biswas, Daniel B. Work
NeurIPS6
2024 Robust Graph Neural Networks via Unbiased Aggregation
abstract
The adversarial robustness of Graph Neural Networks (GNNs) has been questioned due to the false sense of security uncovered by strong adaptive attacks despite the existence of numerous defenses. In this work, we delve into the robustness analysis of representative robust GNNs and provide a unified robust estimation point of view to understand their robustness and limitations. Our novel analysis of estimation bias motivates the design of a robust and unbiased graph signal estimator. We then develop an efficient Quasi-Newton Iterative Reweighted Least Squares algorithm to solve the estimation problem, which is unfolded as robust unbiased aggregation layers in GNNs with theoretical guarantees. Our comprehensive experiments confirm the strong robustness of our proposed model under various scenarios, and the ablation study provides a deep understanding of its advantages.
Zhichao Hou, Ruiqi Feng, Tyler Derr
NeurIPS3
2024 WelQrate: Defining the Gold Standard in Small Molecule Drug Discovery Benchmarking
abstract
While deep learning has revolutionized computer-aided drug discovery, the AI community has predominantly focused on model innovation and placed less emphasis on establishing best benchmarking practices. We posit that without a sound model evaluation framework, the AI community's efforts cannot reach their full potential, thereby slowing the progress and transfer of innovation into real-world drug discovery.Thus, in this paper, we seek to establish a new gold standard for small molecule drug discovery benchmarking, WelQrate. Specifically, our contributions are threefold: WelQrate dataset collection - we introduce a meticulously curated collection of 9 datasets spanning 5 therapeutic target classes. Our hierarchical curation pipelines, designed by drug discovery experts, go beyond the primary high-throughput screen by leveraging additional confirmatory and counter screens along with rigorous domain-driven preprocessing, such as Pan-Assay Interference Compounds (PAINS) filtering, to ensure the high-quality data in the datasets; WelQrate Evaluation Framework - we propose a standardized model evaluation framework considering high-quality datasets, featurization, 3D conformation generation, evaluation metrics, and data splits, which provides a reliable benchmarking for drug discovery experts conducting real-world virtual screening; Benchmarking - we evaluate model performance through various research questions using the WelQrate dataset collection, exploring the effects of different models, dataset quality, featurization methods, and data splitting strategies on the results.In summary, we recommend adopting our proposed WelQrate as the gold standard in small molecule drug discovery benchmarking. The WelQrate dataset collection, along with the curation codes, and experimental scripts are all publicly available at www.WelQrate.org.
Yunchao Liu 0001, Ha Dong, Xin Wang 0061, Rocco Moretti, Yu Wang 0160, Zhaoqian Su, Jiawei Gu, Bobby Bodenheimer, Charles David Weaver, Jens Meiler, Tyler Derr
NeurIPS11
2024 The 5th International Workshop on Machine Learning on Graphs (MLoG)
abstract
Graphs, which encode pairwise relations between entities, are a kind of universal data structure for a lot of real-world data, including social networks, transportation networks, and chemical molecules. Many important applications on these data can be treated as computational tasks on graphs. Recently, machine learning techniques are widely developed and utilized to effectively tame graphs for discovering actionable patterns and harnessing them for advancing various graph-related computational tasks. Huge success has been achieved and numerous real-world applications have benefited from it. However, since in today's world, we are generating and gathering data in a much faster and more diverse way, real-world graphs are becoming increasingly large-scale and complex. More dedicated efforts are needed to propose more advanced machine learning techniques and properly deploy them for real-world applications in a scalable way. Thus, we organize The 5th International Workshop on Machine Learning on Graphs (MLoG) (https://mlog-workshop.github.io/wsdm24.html), held in conjunction with the 17th ACM Conference on Web Search and Data Mining (WSDM), which provides a venue to gather academia researchers and industry researchers/practitioners to present the recent progress on machine learning on graphs.
Tyler Derr, Yao Ma 0001, Kaize Ding, Tong Zhao 0003, Nesreen K. Ahmed
WSDM1
2024 Can One Embedding Fit All? A Multi-Interest Learning Paradigm Towards Improving User Interest Diversity Fairness
abstract
Recommender systems (RSs) have gained widespread applications across various domains owing to the superior ability to capture users' interests. However, the complexity and nuanced nature of users' interests, which span a wide range of diversity, pose a significant challenge in delivering fair recommendations. In practice, user preferences vary significantly; some users show a clear preference toward certain item categories, while others have a broad interest in diverse ones. Even though it is expected that all users should receive high-quality recommendations, the effectiveness of RSs in catering to this disparate interest diversity remains under-explored.
Yuying Zhao, Minghua Xu 0003, Huiyuan Chen, Yuzhong Chen 0004, Yiwei Cai, Rashidul Islam, Yu Wang 0160, Tyler Derr
WWW8
2024 A Survey on Privacy in Graph Neural Networks: Attacks, Preservation, and Applications
abstract
Graph Neural Networks (GNNs) have gained significant attention owing to their ability to handle graph-structured data and the improvement in practical applications. However, many of these models prioritize high utility performance, such as accuracy, with a lack of privacy consideration, which is a major concern in modern society where privacy attacks are rampant. To address this issue, researchers have started to develop privacy-preserving GNNs. Despite this progress, there is a lack of a comprehensive overview of the attacks and the techniques for preserving privacy in the graph domain. In this survey, we aim to address this gap by summarizing the attacks on graph data according to the targeted information, categorizing the privacy preservation techniques in GNNs, and reviewing the datasets and applications that could be used for analyzing/solving privacy issues in GNNs. We also outline potential directions for future research in order to build better privacy-preserving GNNs.
Yuying Zhao, Zhaoqing Li, Xueqi Cheng 0002, Yu Wang 0160, Olivera Kotevska, Philip S. Yu, Tyler Derr
IEEE Trans. Knowl. Data Eng.8
2023 Interpretable Chirality-Aware Graph Neural Network for Quantitative Structure Activity Relationship Modeling in Drug Discovery
abstract
In computer-aided drug discovery, quantitative structure activity relation models are trained to predict biological activity from chemical structure. Despite the recent success of applying graph neural network to this task, important chemical information such as molecular chirality is ignored. To fill this crucial gap, we propose Molecular-Kernel Graph NeuralNetwork (MolKGNN) for molecular representation learning, which features SE(3)-/conformation invariance, chirality-awareness, and interpretability. For our MolKGNN, we first design a molecular graph convolution to capture the chemical pattern by comparing the atom's similarity with the learnable molecular kernels. Furthermore, we propagate the similarity score to capture the higher-order chemical pattern. To assess the method, we conduct a comprehensive evaluation with nine well-curated datasets spanning numerous important drug targets that feature realistic high class imbalance and it demonstrates the superiority of MolKGNN over other graph neural networks in computer-aided drug discovery. Meanwhile, the learned kernels identify patterns that agree with domain knowledge, confirming the pragmatic interpretability of this approach. Our code and supplementary material are publicly available at https://github.com/meilerlab/MolKGNN.
Yunchao Liu 0001, Yu Wang 0160, Oanh Vu, Rocco Moretti, Bobby Bodenheimer, Jens Meiler, Tyler Derr
AAAI7
2023 Fairness and Explainability: Bridging the Gap towards Fair Model Explanations
abstract
While machine learning models have achieved unprecedented success in real-world applications, they might make biased/unfair decisions for specific demographic groups and hence result in discriminative outcomes. Although research efforts have been devoted to measuring and mitigating bias, they mainly study bias from the result-oriented perspective while neglecting the bias encoded in the decision-making procedure. This results in their inability to capture procedure-oriented bias, which therefore limits the ability to have a fully debiasing method. Fortunately, with the rapid development of explainable machine learning, explanations for predictions are now available to gain insights into the procedure. In this work, we bridge the gap between fairness and explainability by presenting a novel perspective of procedure-oriented fairness based on explanations. We identify the procedure-based bias by measuring the gap of explanation quality between different groups with Ratio-based and Value-based Explanation Fairness. The new metrics further motivate us to design an optimization objective to mitigate the procedure-based bias where we observe that it will also mitigate bias from the prediction. Based on our designed optimization objective, we propose a Comprehensive Fairness Algorithm (CFA), which simultaneously fulfills multiple objectives - improving traditional fairness, satisfying explanation fairness, and maintaining the utility performance. Extensive experiments on real-world datasets demonstrate the effectiveness of our proposed CFA and highlight the importance of considering fairness from the explainability perspective. Our code: https://github.com/YuyingZhao/FairExplanations-CFA.
Yuying Zhao, Yu Wang 0160, Tyler Derr
AAAI3
2023 An Analysis of the Dynamics of Ties on Twitter
abstract
Online social networks are the breeding grounds for user connections, fostering information exchange, communication, content sharing, and community building. However, the dissolution of these digital relationships, often a less-explored facet, complements the studies of tie formation and maintenance. A comprehensive grasp of these connections, encompassing their inception, unraveling, and the potential foresight of disconnections, offers invaluable insights into network dynamics and the progression of interpersonal bonds. Yet, the investigation of broken ties faces a substantial challenge: the paucity of longitudinal and detailed data. To bridge this gap, this paper curates an expansive dataset, spanning over 120,000 Twitter users tracked across 15 weeks with weekly snapshots. Armed with this dataset, we embark on an extensive exploration of Twitter links, delving into five distinct categories within the Twitter social graph. These categories encompass structural features like centrality, content-related aspects, including post polarity, user profile attributes like verified status, egocentric network elements such as reciprocity, and dense user representations typified by node2vec. Subsequently, we conduct a thorough analysis of these diverse features to unveil meaningful patterns.
Kiana Kheiri, Muhammad Fawad Akbar Khan, Tyler Derr, Hamid Karimi
IEEE Big Data3
2023 Enhanced Graph Neural Networks with Ego-Centric Spectral Subgraph Embeddings Augmentation
abstract
Graph Neural Networks (GNNs) have shown remarkable merit in performing various learning-based tasks in complex networks. The superior performance of GNNs often correlates with the availability and quality of node-level features in the input networks. However, for many network applications, such node-level information may be missing or unreliable, thereby limiting the applicability and efficacy of GNNs. To address this limitation, we present a novel approach denoted as Ego-centric Spectral subGraph Embedding Augmentation (ESGEA), which aims to enhance and design node features, particularly in scenarios where information is lacking. Our method leverages the topological structure of the local subgraph to create topology-aware node features. The subgraph features are generated using an efficient spectral graph embedding technique, and they serve as node features that capture the local topological organization of the network. The explicit node features, if present, are then enhanced with the subgraph embeddings in order to improve the overall performance. ESGEA is compatible with any GNN-based architecture and is effective even in the absence of node features. We evaluate the proposed method in a social network graph classification task where node attributes are unavailable, as well as in a node classification task where node features are corrupted or even absent. The evaluation results on seven datasets and eight baseline models indicate up to a 10% improvement in AUC and a 7% improvement in accuracy for graph and node classification tasks, respectively.
Anwar Said, Mudassir Shabbir, Tyler Derr, Waseem Abbas 0003, Xenofon Koutsoukos
ICMLA3
2023 NeuroGraph: Benchmarks for Graph Machine Learning in Brain Connectomics
abstract
Machine learning provides a valuable tool for analyzing high-dimensional functional neuroimaging data, and is proving effective in predicting various neurological conditions, psychiatric disorders, and cognitive patterns. In functional magnetic resonance imaging (MRI) research, interactions between brain regions are commonly modeled using graph-based representations. The potency of graph machine learning methods has been established across myriad domains, marking a transformative step in data interpretation and predictive modeling. Yet, despite their promise, the transposition of these techniques to the neuroimaging domain has been challenging due to the expansive number of potential preprocessing pipelines and the large parameter search space for graph-based dataset construction. In this paper, we introduce NeuroGraph, a collection of graph-based neuroimaging datasets, and demonstrated its utility for predicting multiple categories of behavioral and cognitive traits. We delve deeply into the dataset generation search space by crafting 35 datasets that encompass static and dynamic brain connectivity, running in excess of 15 baseline methods for benchmarking. Additionally, we provide generic frameworks for learning on both static and dynamic graphs. Our extensive experiments lead to several key observations. Notably, using correlation vectors as node features, incorporating larger number of regions of interest, and employing sparser graphs lead to improved performance. To foster further advancements in graph-based data driven neuroimaging analysis, we offer a comprehensive open-source Python package that includes the benchmark datasets, baseline implementations, model training, and standard evaluation.
Anwar Said, Roza G. Bayrak, Tyler Derr, Mudassir Shabbir, Daniel Moyer, Catie Chang, Xenofon Koutsoukos
NeurIPS3
2023 The 3rd International Workshop on Machine Learning on Graphs (MLoG)
abstract
Graphs, which encode pairwise relations between entities, are a kind of universal data structure for a lot of real-world data, including social networks, transportation networks, and chemical molecules. Many important applications on these data can be treated as computational tasks on graphs. Recently, machine learning techniques are widely developed and utilized to effectively tame graphs for discovering actionable patterns and harnessing them for advancing various graph-related computational tasks. Huge success has been achieved and numerous real-world applications have benefited from it. However, since in today's world, we are generating and gathering data in a much faster and more diverse way, real-world graphs are becoming increasingly large-scale and complex. More dedicated efforts are needed to propose more advanced machine learning techniques and properly deploy them for real-world applications in a scalable way. Thus, we organize The 3rd International Workshop on Machine Learning on Graphs (MLoG), held in conjunction with the 16th ACM Conference on Web Search and Data Mining (WSDM), which provides a venue to gather academia researchers and industry researchers/practitioners to present the recent progress on machine learning on graphs.
Tyler Derr, Yao Ma 0001, Benedek Rozemberczki, Neil Shah, Shirui Pan
WSDM1
2023 Collaboration-Aware Graph Convolutional Network for Recommender Systems
abstract
Graph Neural Networks (GNNs) have been successfully adopted in recommender systems by virtue of the message-passing that implicitly captures collaborative effect. Nevertheless, most of the existing message-passing mechanisms for recommendation are directly inherited from GNNs without scrutinizing whether the captured collaborative effect would benefit the prediction of user preferences. In this paper, we first analyze how message-passing captures the collaborative effect and propose a recommendation-oriented topological metric, Common Interacted Ratio (CIR), which measures the level of interaction between a specific neighbor of a node with the rest of its neighbors. After demonstrating the benefits of leveraging collaborations from neighbors with higher CIR, we propose a recommendation-tailored GNN, Collaboration-Aware Graph Convolutional Network (CAGCN), that goes beyond 1-Weisfeiler-Lehman(1-WL) test in distinguishing non-bipartite-subgraph-isomorphic graphs. Experiments on six benchmark datasets show that the best CAGCN variant outperforms the most representative GNN-based recommendation model, LightGCN, by nearly 10% in Recall@20 and also achieves around 80% speedup. Our code/supplementary is at https://github.com/YuWVandy/CAGCN.
Yu Wang 0160, Yuying Zhao, Tyler Derr
WWW4
2023 Adversarial Attacks for Black-Box Recommender Systems via Copying Transferable Cross-Domain User Profiles
abstract
As widely used in data-driven decision-making, recommender systems have been recognized for their capabilities to provide users with personalized services in many user-oriented online services, such as E-commerce (e.g., Amazon, Taobao, etc.) and Social Media sites (e.g., Facebook and Twitter). Recent works have shown that deep neural networks-based recommender systems are highly vulnerable to adversarial attacks, where adversaries can inject carefully crafted fake user profiles (i.e., a set of items that fake users have interacted with) into a target recommender system to promote or demote a set of target items. Instead of generating users with fake profiles from scratch, in this article, we introduce a novel strategy to obtain “fake” user profiles via copying cross-domain user profiles, where a reinforcement learning based black-box attacking framework (CopyAttack+) is developed to effectively and efficiently select cross-domain user profiles from the source domain to attack the target system. Moreover, we propose to train a local surrogate system for mimicking adversarial black-box attacks in the source domain, so as to provide transferable signals with the purpose of enhancing the attacking strategy in the target black-box recommender system. Comprehensive experiments on three real-world datasets are conducted to demonstrate the effectiveness of the proposed attacking framework.
Wenqi Fan, Xiangyu Zhao 0001, Qing Li 0001, Tyler Derr, Yao Ma 0001, Hui Liu 0031, Jianping Wang 0001, Jiliang Tang
IEEE Trans. Knowl. Data Eng.4
2022 Inferring EHR Utilization Workflows through Audit Logs
Xinmeng Zhang, Yuying Zhao, Chao Yan 0004, Tyler Derr, You Chen 0001
AMIA4
2022 Imbalanced Graph Classification via Graph-of-Graph Neural Networks
abstract
Graph Neural Networks (GNNs) have achieved unprecedented success in identifying categorical labels of graphs. However, most existing graph classification problems with GNNs follow the protocol of balanced data splitting, which misaligns with many real-world scenarios in which some classes have much fewer labels than others. Directly training GNNs under this imbalanced scenario may lead to uninformative representations of graphs in minority classes, and compromise the overall classification performance, which signifies the importance of developing effective GNNs towards handling imbalanced graph classification. Existing methods are either tailored for non-graph structured data or designed specifically for imbalanced node classification while few focus on imbalanced graph classification. To this end, we introduce a novel framework, Graph-of-Graph Neural Networks (G2GNN), which alleviates the graph imbalance issue by deriving extra supervision globally from neighboring graphs and locally from stochastic augmentations of graphs. Globally, we construct a graph of graphs (GoG) based on kernel similarity and perform GoG propagation to aggregate neighboring graph representations. Locally, we employ topological augmentation via masking node features or dropping edges with self-consistency regularization to generate stochastic augmentations of each graph that improve the model generalizability. Extensive graph classification experiments conducted on seven benchmark datasets demonstrate our proposed G2GNN outperforms numerous baselines by roughly 5% in both F1-macro and F1-micro scores.
Yu Wang 0160, Yuying Zhao, Neil Shah, Tyler Derr
CIKM4
2022 PAS: Privacy Algorithms in Systems
abstract
Today we face an explosion of data generation, ranging from health monitoring to national security infrastructure systems. More and more systems are connected to the Internet that collects data at regular time intervals. These systems share data and use machine learning methods for intelligent decisions, which resulted in numerous real-world applications (e.g., autonomous vehicles, recommendation systems, and heart-rate monitoring) that have benefited from it. However, these approaches are prone to identity thief and other privacy related cyber-security attacks. So, how can data privacy be protected efficiently in these scenarios? More dedicated efforts are needed to propose the integration of privacy techniques into existing systems and develop more advanced privacy techniques to address the complex challenges of multi-system connectivity and data fusion. Therefore, we have introduced Privacy Algorithms in Systems (PAS) at CIKM which provides a venue to gather academic researchers and industry researchers/practitioners to present their research in an effort to advance the frontier of this critical direction of privacy algorithms in systems.
Philip S. Yu, Olivera Kotevska, Tyler Derr
CIKM3
2022 Enhancing Individual Fairness through Propensity Score Matching
abstract
The central idea of individual fairness is based on an auspicious yet intuitive assertion: similar individuals should be treated similarly. Nevertheless, the fulfillment of individual fairness is hindered by three major obstacles. First, one needs to determine individuals who should receive similar treatment. Second, seamlessly formulating the notion of individual fairness in an ML learning process is another challenge. Third, effectively evaluating the notion of similar treatment in probabilistic classifiers is another challenge. To overcome these challenges, we propose a novel framework called FairMatch. Our proposed framework offers a new approach to pairing similar and dissimilar individuals using a causal analysis method called propensity score matching. Moreover, we formulate individual fairness as a representation learning problem where we incorporate similar and dissimilar pairs in a triplet-based loss function. Eventually, we devise a novel metric to evaluate individual fairness that captures the notion of similar treatment in probabilistic classifiers in a better way. Experimental results on four real-world datasets verify the superiority of FairMatch to existing solutions where we demonstrate it can deliver fairer decisions without scarifying the predictive performance.
Hamid Karimi, Muhammad Fawad Akbar Khan, Tyler Derr, Hui Liu 0031
DSAA4
2022 THINK: Temporal Hypergraph Hyperbolic Network
abstract
Network-based time series forecasting is a challenging task as it involves complex geometric properties, higher-order relations, and scale-free characteristics. Previous work has modeled network-based series as oversimplified graphs or has ignored the power law dynamics of real-world temporal and dynamic networks, which could yield suboptimal results. With the aim to address these issues, here we propose THINK, a novel framework based on hypergraph learning that captures the hyperbolic properties of time-evolving dynamic hypergraphs. We design an elegant hyperbolic distance-aware hypergraph attention mechanism to better capture informative internal structural features on the Poincaré ball. Through quantitative and conceptual analysis on seven tasks across temporal, and time-evolving dynamic hypergraphs, we demonstrate THINK’s practicality in comparison to a variety of benchmarks spanning finance, health, and energy networks.
Shivam Agarwal, Ramit Sawhney, Megh Thakkar, Preslav Nakov, Jiawei Han 0001, Tyler Derr
ICDM6
2022 Decision Boundaries of Deep Neural Networks
abstract
Deep neural networks and in particular, deep neural classifiers have become an integral part of many modern applications. Despite their practical success, we still have limited knowledge of how they work and the demand for such an understanding is evergrowing. In this regard, one crucial aspect of deep neural network classifiers that can help us deepen our knowledge about their decision-making behavior is to investigate their decision boundaries. Nevertheless, this is contingent upon having access to samples populating the areas near the decision boundary. To achieve this, we propose a novel approach we call Deep Decision boundary Instance Generation (DeepDIG). DeepDIG utilizes a method based on adversarial example generation as an effective way of generating samples near the decision boundary of a neural network model. Then, we introduce a set of important characteristics that take advantage of the generated borderline instances and provide multifaceted understandings of deep neural networks. We have performed extensive experiments on multiple representative datasets across various deep neural network models and characterized their decision boundaries. The entire code is publicly available.1
Hamid Karimi, Tyler Derr
ICMLA2
2022 On Structural Explanation of Bias in Graph Neural Networks
abstract
Graph Neural Networks (GNNs) have shown satisfying performance in various graph analytical problems. Hence, they have become the de facto solution in a variety of decision-making scenarios. However, GNNs could yield biased results against certain demographic subgroups. Some recent works have empirically shown that the biased structure of the input network is a significant source of bias for GNNs. Nevertheless, no studies have systematically scrutinized which part of the input network structure leads to biased predictions for any given node. The low transparency on how the structure of the input network influences the bias in GNN outcome largely limits the safe adoption of GNNs in various decision-critical scenarios. In this paper, we study a novel research problem of structural explanation of bias in GNNs. Specifically, we propose a novel post-hoc explanation framework to identify two edge sets that can maximally account for the exhibited bias and maximally contribute to the fairness level of the GNN prediction for any given node, respectively. Such explanations not only provide a comprehensive understanding of bias/fairness of GNN predictions but also have practical significance in building an effective yet fair GNN model. Extensive experiments on real-world datasets validate the effectiveness of the proposed framework towards delivering effective structural explanations for the bias of GNNs. Open-source code can be found at https://github.com/yushundong/REFEREE.
Yushun Dong, Song Wang 0013, Yu Wang 0160, Tyler Derr, Jundong Li
KDD4
2022 ChemicalX: A Deep Learning Library for Drug Pair Scoring
abstract
In this paper, we introduce ChemicalX, a PyTorch-based deep learning library designed for providing a range of state of the art models to solve the drug pair scoring task. The primary objective of the library is to make deep drug pair scoring models accessible to machine learning researchers and practitioners in a streamlined framework. The design of ChemicalX reuses existing high level model training utilities, geometric deep learning, and deep chemistry layers from the PyTorch ecosystem. Our system provides neural network layers, custom pair scoring architectures, data loaders, and batch iterators for end users. We showcase these features with example code snippets and case studies to highlight the characteristics of ChemicalX. A range of experiments on real world drug-drug interaction, polypharmacy side effect, and combination synergy prediction tasks demonstrate that the models available in ChemicalX are effective at solving the pair scoring task. Finally, we show that ChemicalX could be used to train and score machine learning models on large drug pair datasets with hundreds of thousands of compounds on commodity hardware.
Benedek Rozemberczki, Charles Tapley Hoyt, Anna Gogleva, Piotr Grabowski, Klas Karis, Andrej Lamov, Andriy Nikolov, Sebastian Nilsson, Michaël Ughetto, Yu Wang 0160, Tyler Derr, Benjamin M. Gyori
KDD11
2022 Improving Fairness in Graph Neural Networks via Mitigating Sensitive Attribute Leakage
abstract
Graph Neural Networks (GNNs) have shown great power in learning node representations on graphs. However, they may inherit historical prejudices from training data, leading to discriminatory bias in predictions. Although some work has developed fair GNNs, most of them directly borrow fair representation learning techniques from non-graph domains without considering the potential problem of sensitive attribute leakage caused by feature propagation in GNNs. However, we empirically observe that feature propagation could vary the correlation of previously innocuous non-sensitive features to the sensitive ones. This can be viewed as a leakage of sensitive information which could further exacerbate discrimination in predictions. Thus, we design two feature masking strategies according to feature correlations to highlight the importance of considering feature propagation and correlation variation in alleviating discrimination. Motivated by our analysis, we propose Fair View Graph Neural Network (FairVGNN) to generate fair views of features by automatically identifying and masking sensitive-correlated features considering correlation variation after feature propagation. Given the learned fair views, we adaptively clamp weights of the encoder to avoid using sensitive-related features. Experiments on real-world datasets demonstrate that FairVGNN enjoys a better trade-off between model utility and fairness.
Yu Wang 0160, Yuying Zhao, Yushun Dong, Huiyuan Chen, Jundong Li, Tyler Derr
KDD6
2021 Stock Selection via Spatiotemporal Hypergraph Attention Network: A Learning to Rank Approach
abstract
Quantitative trading and investment decision making are intricate financial tasks that rely on accurate stock selection. Despite advances in deep learning that have made significant progress in the complex and highly stochastic stock prediction problem, modern solutions face two significant limitations. They do not directly optimize the target of investment in terms of profit, and treat each stock as independent from the others, ignoring the rich signals between related stocks' temporal price movements. Building on these limitations, we reformulate stock prediction as a learning to rank problem and propose STHAN-SR, a neural hypergraph architecture for stock selection. The key novelty of our work is the proposal of modeling the complex relations between stocks through a hypergraph and a temporal Hawkes attention mechanism to tailor a new spatiotemporal attention hypergraph network architecture to rank stocks based on profit by jointly modeling stock interdependence and the temporal evolution of their prices. Through experiments on three markets spanning over six years of data, we show that STHAN-SR significantly outperforms state-of-the-art neural stock forecasting methods. We validate our design choices through ablative and exploratory analyses over STHAN-SR's spatial and temporal components and demonstrate its practical applicability.
Ramit Sawhney, Shivam Agarwal, Arnav Wadhwa, Tyler Derr, Rajiv Ratn Shah
AAAI4
2021 Deep Adversarial Network Alignment
abstract
Network alignment, in general, seeks to discover the hidden underlying correspondence between nodes across two (or more) networks when given their network structure. However, most existing network alignment methods have added assumptions of additional constraints to guide the alignment, such as having a set of seed node-node correspondences across the networks or the existence of side-information. Instead, we seek to develop a general unsupervised network alignment algorithm that makes no additional assumptions. Recently, network embedding has proven effective in many network analysis tasks, but embeddings of different networks are not aligned. Thus, we present our Deep Adversarial Network Alignment (DANA) framework that first uses deep adversarial learning to discover complex mappings for aligning the embedding distributions of the two networks. Then, using our learned mapping functions, DANA performs an efficient nearest neighbor node alignment. Furthermore, we present an unsupervised heuristic to perform model selection for DANA. We perform experiments on real world datasets to show the effectiveness of our framework for first aligning the graph embedding distributions and then discovering node alignments that outperform existing methods.
Tyler Derr, Hamid Karimi, Jiejun Xu, Jiliang Tang
CIKM1
2021 Graph Feature Gating Networks
abstract
Graph neural networks (GNNs) have received tremendous attention due to their power in learning effective representations for graphs. Most GNNs follow a message-passing scheme where the node representations are updated by aggregating and transforming the information from the neighborhood. Meanwhile, they adopt the same strategy in aggregating the information from different feature dimensions. However, suggested by social dimension theory and spectral embedding, there are potential benefits to treat the dimensions differently during the aggregation process. In this work, we investigate to enable heterogeneous contributions of feature dimensions in GNNs. In particular, we propose a general graph feature gating network (GFGN) based on the graph signal denoising problem and then correspondingly introduce three graph filters under GFGN to allow different levels of contributions from feature dimensions. Extensive experiments on various real-world datasets demonstrate the effectiveness and robustness of the proposed frameworks.
Wei Jin 0009, Yao Ma 0001, Tyler Derr, Charu C. Aggarwal, Jiliang Tang
CIKM4
2021 Tree Decomposed Graph Neural Network
abstract
Graph Neural Networks (GNNs) have achieved significant success in learning better representations by performing feature propagation and transformation iteratively to leverage neighborhood information. Nevertheless, iterative propagation restricts the information of higher-layer neighborhoods to be transported through and fused with the lower-layer neighborhoods', which unavoidably results in feature smoothing between neighborhoods in different layers and can thus compromise the performance, especially on heterophily networks. Furthermore, most deep GNNs only recognize the importance of higher-layer neighborhoods while yet to fully explore the importance of multi-hop dependency within the context of different layer neighborhoods in learning better representations. In this work, we first theoretically analyze the feature smoothing between neighborhoods in different layers and empirically demonstrate the variance of the homophily level across neighborhoods at different layers. Motivated by these analyses, we further propose a tree decomposition method to disentangle neighborhoods in different layers to alleviate feature smoothing among these layers. Moreover, we characterize the multi-hop dependency via graph diffusion within our tree decomposition formulation to construct Tree Decomposed Graph Neural Network (TDGNN), which can flexibly incorporate information from large receptive fields and aggregate this information utilizing the multi-hop dependency. Comprehensive experiments demonstrate the superior performance of TDGNN on both homophily and heterophily networks under a variety of node classification settings. Extensive parameter analysis highlights the ability of TDGNN to prevent over-smoothing and incorporate features from shallow layers with deeper multi-hop dependencies, which provides new insights towards deeper graph neural networks.
Yu Wang 0160, Tyler Derr
CIKM2
2021 Interpretable Visual Understanding with Cognitive Attention Network
Xuejiao Tang, Wenbin Zhang 0002, Yi Yu 0001, Kea Turner, Tyler Derr, Eirini Ntoutsi
ICANN (1)5
2021 Attacking Black-box Recommendations via Copying Cross-domain User Profiles
abstract
Recommender systems, which aim to suggest personalized lists of items for users, have drawn a lot of attention. In fact, many of these state-of-the-art recommender systems have been built on deep neural networks (DNNs). Recent studies have shown that these deep neural networks are vulnerable to attacks, such as data poisoning, which generate fake users to promote a selected set of items. Correspondingly, effective defense strategies have been developed to detect these generated users with fake profiles. Thus, new strategies of creating more `realistic' user profiles to promote a set of items should be investigated to further understand the vulnerability of DNNs based recommender systems. In this work, we present a novel framework CopyAttack. It is a reinforcement learning based black-box attacking method that harnesses real users from a source domain by copying their profiles into the target domain with the goal of promoting a subset of items. CopyAttack is constructed to both efficiently and effectively learn policy gradient networks that first select, then further refine/craft user profiles from the source domain, and ultimately copy them into the target domain. CopyAttack's goal is to maximize the hit ratio of the targeted items in the Top-k recommendation list of the users in the target domain. We conducted experiments on two real-world datasets and empirically verified the effectiveness of the proposed framework. The implementation of CopyAttack is available at https://github.com/wenqifan03/CopyAttack.
Wenqi Fan, Tyler Derr, Xiangyu Zhao 0001, Yao Ma 0001, Hui Liu 0031, Jianping Wang 0001, Jiliang Tang, Qing Li 0001
ICDE2
2021 Graph Adversarial Attack via Rewiring
abstract
Graph Neural Networks (GNNs) have demonstrated their powerful capability in learning representations for graph-structured data. Consequently, they have enhanced the performance of many graph-related tasks such as node classification and graph classification. However, it is evident from recent studies that GNNs are vulnerable to adversarial attacks. Their performance can be largely impaired by deliberately adding carefully created unnoticeable perturbations to the graph. Existing attacking methods often produce perturbation by adding/deleting a few edges, which might be noticeable even when the number of modified edges is small. In this paper, we propose a graph rewiring operation to perform the attack. It can affect the graph in a less noticeable way compared to existing operations such as adding/deleting edges. We then utilize deep reinforcement learning to learn the strategy to effectively perform the rewiring operations. Experiments on real-world graphs demonstrate the effectiveness of the proposed framework. To understand the proposed framework, we further analyze how its generated perturbation impacts the target model and the advantages of the rewiring operations. The implementation of the proposed framework is available at https://github.com/alge24/ReWatt.
Yao Ma 0001, Suhang Wang, Tyler Derr, Lingfei Wu 0001, Jiliang Tang
KDD3
2021 Node Similarity Preserving Graph Convolutional Networks
abstract
Graph Neural Networks (GNNs) have achieved tremendous success in various real-world applications due to their strong ability in graph representation learning. GNNs explore the graph structure and node features by aggregating and transforming information within node neighborhoods. However, through theoretical and empirical analysis, we reveal that the aggregation process of GNNs tends to destroy node similarity in the original feature space. There are many scenarios where node similarity plays a crucial role. Thus, it has motivated the proposed framework SimP-GCN that can effectively and efficiently preserve node similarity while exploiting graph structure. Specifically, to balance information from graph structure and node features, we propose a feature similarity preserving aggregation which adaptively integrates graph structure and node features. Furthermore, we employ self-supervised learning to explicitly capture the complex feature similarity and dissimilarity relations between nodes. We validate the effectiveness of SimP-GCN on seven benchmark datasets including three assortative and four disassorative graphs. The results demonstrate that SimP-GCN outperforms representative baselines. Further probe shows various advantages of the proposed framework. The implementation of SimP-GCN is available at https://github.com/ChandlerBang/SimP-GCN.
Wei Jin 0009, Tyler Derr, Yiqi Wang 0001, Yao Ma 0001, Zitao Liu 0001, Jiliang Tang
WSDM2
2020 Towards Improving Sample Representativeness of Teachers on Online Social Media: A Case Study on Pinterest
Hamid Karimi, Tyler Derr, Kaitlin T. Torphy, Kenneth A. Frank, Jiliang Tang
AIED (2)2
2020 Online Academic Course Performance Prediction using Relational Graph Convolutional Neural Network
Hamid Karimi, Tyler Derr, Jiangtao Huang, Jiliang Tang
EDM2
2020 Learning from Incomplete Labeled Data via Adversarial Data Generation
abstract
Positive and unlabeled (PU) learning aims to obtain a well-performed classifier via an incomplete binary training set, in which only a part of labels of one category is known while the rest are unknown. However, in many real-world applications such as image recognition, the collected data samples often involve more than two categories. Moreover, only a small portion of the collected samples might have associated labels due to some practical reasons, and these labeled samples cannot always cover all the categories. We refer to this type of data as incomplete labeled data. In this paper, we first formally define the incomplete labeled data learning problem and then aim to tackle it via adversarial data generation. Specifically, we propose a novel generative framework LILA, which can produce synthetic labeled samples for both partially labeled categories and unlabeled categories. To enforce that the generated samples for unlabeled categories can associate with correct labels, we integrate two active learning processes into the LILA framework for selecting unlabeled samples in the collected sample set to query their labels effectively. After LILA has been well trained, a classifier can be trained on the balanced augmented data set consisting of both generated and original labeled samples. Extensive experiments on real image data demonstrate the effectiveness of our proposed framework. We release the implementation of the proposed framework via https://github.com/wentao-repo/LILA.
Wentao Wang 0006, Tyler Derr, Yao Ma 0001, Suhang Wang, Hui Liu 0031, Zitao Liu 0001, Jiliang Tang
ICDM2
2020 Deep Graph Learning: Foundations, Advances and Applications
abstract
Many real data come in the form of non-grid objects, i.e. graphs, from social networks to molecules. Adaptation of deep learning from grid-alike data (e.g. images) to graphs has recently received unprecedented attention from both machine learning and data mining communities, leading to a new cross-domain field---Deep Graph Learning (DGL). Instead of painstaking feature engineering, DGL aims to learn informative representations of graphs in an end-to-end manner. It has exhibited remarkable success in various tasks, such as node/graph classification, link prediction, etc.
Yu Rong 0001, Tingyang Xu, Junzhou Huang, Wenbing Huang 0001, Hong Cheng 0001, Yao Ma 0001, Yiqi Wang 0001, Tyler Derr, Lingfei Wu 0001, Tengfei Ma 0001
KDD8
2020 Characterizing Teacher Connections in Online Social Media: A Case Study on Pinterest
abstract
Increasingly many teachers are turning to online social media to supplement educational resources and meet students' needs in the classrooms. The diffusion of information from online social media to the classroom is significantly faster than traditional curriculum-based approaches. However, this is contingent upon how well teachers across an online social media network are connected. To understand this, we perform a thorough and large-scale investigation of teacher connections in online social media, which is lacking in the literature. To make this feasible, we construct a large dataset of teachers on Pinterest, an image-based popular online social media. Our dataset includes 540 teachers across 5 states and 48 districts, thousands of connections they have established (either with their peers or some other Pinterest users), and all the resources they have shared in their accounts. Then, taking into account some crucial teacher-related attributes (e.g., their districts, grade levels, etc), we characterize direct and indirect teacher connections. Moreover, we compare the physical (face to face) and virtual (Pinterest) network of our surveyed teachers using several graph-related metrics. The finding in this study can serve as a basis to investigate teachers on social media in a deeper manner.
Hamid Karimi, Kaitlin T. Torphy, Tyler Derr, Kenneth A. Frank, Jiliang Tang
L@S3
2020 Epidemic Graph Convolutional Network
abstract
A growing trend recently is to harness the structure of today's big data, where much of the data can be represented as graphs. Simultaneously, graph convolutional networks (GCNs) have been proposed and since seen rapid development. More recently, due to the scalability issues that arise when attempting to utilize these powerful models on real-world data, methodologies have sought the use of sampling techniques. More specifically, minibatches of nodes are formed and then sets of nodes are sampled to aggregate from in one or more layers. Among these methods, the two prominent ways are based on sampling nodes from either a local or global perspective. In this work, we first observe the similarities in the two sampling strategies to that of epidemic and diffusion network models. Then we harness this understanding to fuse together the benefits of sampling from both a local and global perspective while alleviating some of the inherent issues found in both through the use of a low-dimensional approximation for the path-based Katz similarity measure. Our proposed framework, Epidemic Graph Convolutional Network (EGCN), is thus able to achieve improved performance over sampling from just one of the two perspectives alone. Empirical experiments are performed on several public benchmark datasets to verify the effectiveness over existing methodologies for the node classification task and we furthermore present some empirical parameter analysis of EGCN.
Tyler Derr, Yao Ma 0001, Wenqi Fan, Charu C. Aggarwal, Jiliang Tang
WSDM1
2020 Network Analysis with Negative Links
abstract
As we rapidly continue into the information age, the rate at which data is produced has created an unprecedented demand for novel methods to effectively/efficiently extract insightful patterns. Then, once paired with domain knowledge, we can seek to understand the past, make predictions about the future, and ultimately take actionable steps towards improving our society. Thus, due to the fact that much of today's big data can be represented as graphs, emphasis is being taken to harness the natural structure of data through network analysis. Furthermore, many real-world networks can be better represented as signed networks, e.g., in an online social network such as Facebook, friendships can be represented as positive links while negative links can represent blocked users. Hence, due to signed networks being ubiquitous, in this work we seek to provide a fundamental background into the domain, a hierarchical categorization of existing work highlighting both seminal and state of the art, provide a curated collection of signed network datasets, and discuss important future directions.
Tyler Derr
WSDM1
2020 ROSE: Role-based Signed Network Embedding
abstract
In real-world networks, nodes might have more than one type of relationship. Signed networks are an important class of such networks consisting of two types of relations: positive and negative. Recently, embedding signed networks has attracted increasing attention and is more challenging than classic networks since nodes are connected by paths with multi-types of links. Existing works capture the complex relationships by relying on social theories. However, this approach has major drawbacks, including the incompleteness/inaccurateness of such theories. Thus, we propose network transformation based embedding to address these shortcomings. The core idea is that rather than directly finding the similarities of two nodes from the complex paths connecting them, we can obtain their similarities through simple paths connecting their different roles. We employ this idea to build our proposed embedding technique that can be described in three steps: (1) the input directed signed network is transformed into an unsigned bipartite network with each node mapped to a set of nodes we denote as role-nodes. Each role-node captures a certain role that a node in the original network plays; (2) the network of role-nodes is embedded; and (3) the original network is encoded by aggregating the embedding vectors of role-nodes. Our experiments show the novel proposed technique substantially outperforms existing models.
Amin Javari, Tyler Derr, Pouya Esmailian, Jiliang Tang, Kevin Chen-Chuan Chang
WWW2
2019 Multi-factor congressional vote prediction
abstract
In recent times we have seen a trend of having the ideologies of the two dominant political parties in the U.S. growing further and further apart. Simultaneously we have entered the age of big data raising enormous interest in computational approaches to solve problems in many domains such as political elections. However, an overlooked problem lies in predicting what happens once our elected officials take office, more specifically, predicting the congressional votes, which are perhaps the most influential decisions being made in the U.S. This, nevertheless, is far from a trivial task, since the congressional system is highly complex and heavily influenced by both ideological and social factors. Thus, dedicated efforts are required to first effectively identify and represent these factors, then furthermore capture the interactions between them. To this end, we proposed a robust end-to-end framework Multi-Factor Congressional Vote Prediction (MFCVP) that defines and encodes features from indicative ideological factors while also extracting novel social features. This allows for a principled expressive representation of the complex system, which ultimately leads to MFCVP making accurate vote predictions. Experimental results on a dataset from the U.S. House of Representatives shows the superiority of MFCVP to several representatives approaches when predicting votes for individual representatives and also the overall outcome of the bill voted on. Finally, we perform a factor analysis to understand the effectiveness and interplay between the different factors.
Hamid Karimi, Tyler Derr, Aaron Brookhouse, Jiliang Tang
ASONAM2
2019 Balance in Signed Bipartite Networks
abstract
A large portion of today's big data can be represented as networks. However, not all networks are the same, and in fact, for many that have additional complexities to their structure, traditional general network analysis methods are no longer applicable. For example, signed networks contain both positive and negative links, and thus dedicated theories and algorithms have been developed. However, previous work mainly focuses on the unipartite setting where signed links connect any pair of nodes. Signed bipartite networks on the one hand, are commonly found, but have primarily been overlooked. Their complexities of having two node types where signed links can only form across the two sets introduce challenges that prevent most existing literature on unipartite signed and unsigned bipartite networks from being applied. On the other hand, balance theory, a key signed social theory, has been generally defined for cycles of any length and is being used in the form of triangles for numerous unipartite signed network tasks. However, in bipartite networks there are no triangles and furthermore there exist two types of nodes. Therefore, in this work, we conduct the first comprehensive analysis and validation of balance theory using the smallest cycle in signed bipartite networks - signed butterflies (i.e., cycles of length 4 containing the two node types). Then, to investigate the applicability of balance theory aiding signed bipartite network tasks, we develop multiple sign prediction methods that utilize balance theory in the form of signed butterflies. Our sign prediction experiment on three real-world signed bipartite networks demonstrates the effectiveness of using these signed butterflies for not only sign prediction, but paves the way for improvements in other signed bipartite network analysis tasks.
Tyler Derr, Cassidy Johnson, Yi Chang 0001, Jiliang Tang
CIKM1
2019 Deep Adversarial Social Recommendation
abstract
Recent years have witnessed rapid developments on social recommendation techniques for improving the performance of recommender systems due to the growing influence of social networks to our daily life. The majority of existing social recommendation methods unify user representation for the user-item interactions (item domain) and user-user connections (social domain). However, it may restrain user representation learning in each respective domain, since users behave and interact differently in the two domains, which makes their representations to be heterogeneous. In addition, most of traditional recommender systems can not efficiently optimize these objectives, since they utilize negative sampling technique which is unable to provide enough informative guidance towards the training during the optimization process. In this paper, to address the aforementioned challenges, we propose a novel deep adversarial social recommendation framework DASO. It adopts a bidirectional mapping method to transfer users' information between social domain and item domain using adversarial learning. Comprehensive experiments on two real-world datasets show the effectiveness of the proposed framework.
Wenqi Fan, Tyler Derr, Yao Ma 0001, Jianping Wang 0001, Jiliang Tang, Qing Li 0001
IJCAI2
2018 Opinions Power Opinions: Joint Link and Interaction Polarity Predictions in Signed Networks
abstract
Social media has been widely adopted by online users to share their opinions. Among users in signed networks, two types of opinions can be expressed. They can directly specify opinions to others via establishing positive or negative links; and they also can give opinions to content generated by others via a variety of social interactions such as commenting and rating. Intuitively these two types of opinions should be related. For example, users are likely to give positive (or negative) opinions to content from those with positive (or negative) links; and users tend to create positive (or negative) links with those that they frequently positively (or negatively) interact with. Therefore we can leverage one type of opinions to power the other. Meanwhile, they can enrich each other that can help mitigate the data sparsity and cold-start problems in the corresponding predictive tasks - link and interaction polarity predictions, respectively. In this paper, we investigate the problem of joint link and interaction polarity predictions in signed networks. We first understand the correlation between these two types of opinions; and then propose a framework that can predict signed links and the polarities of interactions simultaneously. The experimental results on a real-world signed network demonstrate the effectiveness of the proposed framework.
Tyler Derr, Zhiwei Wang 0001, Jiliang Tang
ASONAM1
2018 Signed Network Modeling Based on Structural Balance Theory
abstract
The modeling of networks, specifically generative models, has been shown to provide a plethora of information about the underlying network structures, as well as many other benefits behind their construction. There has been a considerable increase in interest for the better understanding and modeling of networks, and the vast majority of existing work has been for unsigned networks. However, many networks can have positive and negative links (or signed networks), especially in online social media. It is evident from recent work that signed networks present unique properties and principles from unsigned networks due to the added complexity, which pose tremendous challenges on existing unsigned network models. Hence, in this paper, we investigate the problem of modeling signed networks. In particular, we provide a principled approach to capture important properties and principles of signed networks and propose a novel signed network model guided by Structural Balance Theory. Empirical experiments on three real-world signed networks demonstrate the effectiveness of the proposed model.
Tyler Derr, Charu C. Aggarwal, Jiliang Tang
CIKM1
2018 Signed Graph Convolutional Networks
abstract
Due to the fact much of today's data can be represented as graphs, there has been a demand for generalizing neural network models for graph data. One recent direction that has shown fruitful results, and therefore growing interest, is the usage of graph convolutional neural networks (GCNs). They have been shown to provide a significant improvement on a wide range of tasks in network analysis, one of which being node representation learning. The task of learning low-dimensional node representations has shown to increase performance on a plethora of other tasks from link prediction and node classification, to community detection and visualization. Simultaneously, signed networks (or graphs having both positive and negative links) have become ubiquitous with the growing popularity of social media. However, since previous GCN models have primarily focused on unsigned networks (or graphs consisting of only positive links), it is unclear how they could be applied to signed networks due to the challenges presented by negative links. The primary challenges are based on negative links having not only a different semantic meaning as compared to positive links, but their principles are inherently different and they form complex relations with positive links. Therefore we propose a dedicated and principled effort that utilizes balance theory to correctly aggregate and propagate the information across layers of a signed GCN model. We perform empirical experiments comparing our proposed signed GCN against state-of-the-art baselines for learning node representations in signed networks. More specifically, our experiments are performed on four real-world datasets for the classical link sign prediction problem that is commonly used as the benchmark for signed network embeddings algorithms.
Tyler Derr, Yao Ma 0001, Jiliang Tang
ICDM1
2017 Understanding and Predicting Weight Loss with Mobile Social Networking Data
abstract
It has become increasingly popular to use mobile social networking applications for weight loss and management. Users can not only create profiles and maintain their records but also perform a variety of social activities that shatter the barrier to share or seek information. Due to the open and connected nature, these applications produce massive data that consists of rich weight-related information which offers immense opportunities for us to enable advanced research on weight loss. In this paper, we conduct the initial investigation to understand weight loss with a large-scale mobile social networking dataset with near 10 million users. In particular, we study individual and social factors related to weight loss and reveal a number of interesting findings that help us build a meaningful model to predict weight loss automatically. The experimental results demonstrate the effectiveness of the proposed model and the significance of social factors in weight loss.
Zhiwei Wang 0001, Tyler Derr, Dawei Yin 0001, Jiliang Tang
CIKM2