EDBT 2026 Demo / reviewers in the wild / expert
Liangwei Yang
dblp:260/5064 · also Liang Wei Yang
· DBLP profile ↗
27ranked-venue papers in the field
5as first author
27since 2021 · last 2026
0000-0001-5660-766XORCID · verified
Domains — venue-derived; a paper can count in several
Information Retrieval & Web Search · 13 (3 first)Data Mining & Knowledge Discovery · 9 (1 first)Big Data, Cloud & Distributed Data Systems · 5 (1 first)
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | StabCF: A Stabilized Training Method for Collaborative FilteringabstractCollaborative Filtering (CF) with implicit feedback is widely used in personalized recommender systems. In most real-world scenarios, only implicit feedback signals are available, making CF training heavily dependent on sampling-based paradigms—typically optimized via pairwise ranking losses such as Bayesian Personalized Ranking (BPR). This simple yet effective approach has achieved remarkable success and remains the foundation of many modern recommender models. However, despite its empirical success, little attention has been paid to the inherent training instability issue under this sampling-based paradigm. In this paper, we conduct an in-depth analysis of training stability and find that unstable training not only hinders convergence but also leads to fluctuating and suboptimal recommendation performance. We identify two fundamental sources of this instability in CF: (1) noisy or sparse positive samples, where a single observed interaction may not reliably reflect user preference; and (2) inconsistent negative samples, where randomly drawn negatives from unobserved space vary drastically in negative hardness, leading to uninformative or noisy gradient updates. To address these two challenges, we propose StabCF, a Stabilized Training Method for Collaborative Filtering, which improves training stability by synthesizing enriched positive samples from historical positives and constructing consistent hard negatives through user-aware negatives mixing. By replacing raw training triplets with synthesized positive-negative pairs, StabCF effectively smooths the training dynamics and improves convergence stability. Extensive experiments on three public datasets demonstrate that StabCF not only significantly stabilizes the training process but also achieves superior recommendation performance. Our PyTorch implementation is available at https://github.com/Wu-Xi/StabCF. Xi Wu 0009, Liangwei Yang, Yi Zhao 0029, Jiquan Peng, Jibing Gong |
KDD (1) | 3 |
| 2025 | Dual Context-Aware Negative Sampling Strategy for Graph-based Collaborative FilteringabstractNegative sampling plays a critical role in collaborative filtering (CF), as it accelerates convergence and improves recommendation accuracy. Among recent studies, mixup-based negative sampling has shown promising performance. However, existing methods primarily focus on increasing the similarity between the synthesized negative and the positive item, without considering the false positive issue commonly found in implicit feedback scenarios. Blindly training all positive samples with overly hard negatives can magnify the impact of false positives and hurt recommendation performance. To address this challenge, we first provide a theoretical analysis revealing that mixup-synthesized hard negatives implicitly reweight the similarity difference between the user's interactions and both the positive and negative boundaries, thereby shaping the training signal. Motivated by this, we propose a novel strategy named Dual Context-Aware Negative Sampling (DCANS), which enhances each positive item by assessing its alignment with the user's interest context, and simultaneously adjusts the hardness of synthesized negatives based on their relevance to the same interest context. This strategy optimizes the training direction toward the user's genuine preferences, mitigating the negative impact of false positives while preserving the benefits of hard negative sampling. Extensive experiments on three benchmark datasets demonstrate that our method achieves consistent improvements over state-of-the-art baselines. Our PyTorch implementation is available https://github.com/Wu-Xi/DCANS. Xi Wu 0009, Liangwei Yang, Xiaohan Fang, Jiquan Peng, Jibing Gong |
CIKM | 3 |
| 2025 | Benchmarking Graph Foundation ModelsabstractIn real-world applications, graph data has garnered significant attention for its representation and analysis using Graph Neural Networks. Recent advancements have led to the development of Graph Foundation Models (GFMs), which aim to enhance cross-domain and cross-task generalization ability. Despite promising results from GFMs, a lack of standardized evaluation processes hinders comparative analysis and cross-domain applicability. To address this gap, we propose GFMBench, an open-source pipeline that standardizes the training, evaluation, and deployment of GFMs across diverse real-world graph applications. GFMBench integrates state-of-the-art GFMs and datasets, providing a modular design for comprehensive support across data preprocessing, model training, and evaluation. The pipeline includes a robust evaluation framework for benchmarking GFM generalization ability, encompassing supervised learning, cross-domain zero-shot and few-shot learning, and in-context learning. To validate the usability of GFMs, we deploy them on the Open Academic Graph, enabling applications such as topic search and author recommendation. This work provides a unified benchmark for GFMs, enabling deeper insights into their generalization ability across various graph tasks and domains. We further open-source GFMBench https://github.com/BUPT-GAMMA/ggfm and related documents https://ggfm.readthedocs.io/en/latest/. Liangwei Yang, Zeyuan Guo, Jiayi Gao, Tianhao Chai, Cheng Yang 0002, Chuan Shi 0001 |
KDD (2) | 2 |
| 2025 | SGCL: Unifying Self-Supervised and Supervised Learning for Graph RecommendationabstractRecommender systems (RecSys) are essential for online platforms, providing personalized suggestions to users within a vast sea of information.Self-supervised graph learning seeks to harness highorder collaborative filtering signals through unsupervised augmentation on the user-item bipartite graph, primarily leveraging a multi-task learning framework that includes both supervised recommendation loss and self-supervised contrastive loss.However, this separate design introduces additional graph convolution processes and creates inconsistencies in gradient directions due to disparate losses, resulting in prolonged training times and sub-optimal performance.In this study, we introduce a unified framework of Supervised Graph Contrastive Learning for recommendation (SGCL) to address these issues.SGCL uniquely combines the training of recommendation and unsupervised contrastive losses into a cohesive supervised contrastive learning loss, aligning both tasks within a single optimization direction for exceptionally fast training.Extensive experiments on three real-world datasets show that SGCL outperforms state-of-the-art methods, achieving superior accuracy and efficiency. Weizhi Zhang 0001, Liangwei Yang, Zihe Song 0001, Henry Peng Zou, Ke Xu 0018, Yuanjie Zhu, Philip S. Yu |
RecSys | 2 |
| 2024 | Personalized Multi-task Training for Recommender SystemabstractIn the vast landscape of internet information, recommender systems (RecSys) have become essential for guiding users through a sea of choices aligned with their preferences. These systems have applications in diverse domains. Personalization is a key technique in RecSys, where modern methods leverage representation learning to encode user/item interactions into embeddings, forming the foundation for personalized recommendations. However, integrating information from multiple sources to enhance recommendation performance remains challenging. This paper introduces a novel approach named PMTRec, the first personalized multi-task learning algorithm to obtain comprehensive user/item embeddings from various information sources. Addressing challenges specific to personalized RecSys, we develop modules to handle personalized task weights, diverse task orientations, and variations in gradient magnitudes across tasks. PMTRec dynamically adjusts task weights based on gradient norms for each user/item, employs a Task Focusing module to align gradient combinations with the main recommendation task, and uses a Gradient Magnitude Balancing module to ensure balanced training across tasks. Through extensive experiments on three real-world datasets with different scales, we demonstrate that PMTRec significantly outperforms existing multi-task learning methods, showcasing its effectiveness in achieving enhanced recommendation accuracy by leveraging multiple tasks simultaneously. Our contributions open new avenues for advancing personalized multi-task training in RecSys. Liangwei Yang, Zhiwei Liu 0001, Jianguo Zhang 0005, Rithesh Murthy, Shelby Heinecke, Huan Wang 0016, Caiming Xiong, Philip S. Yu |
IEEE Big Data | 1 |
| 2024 | Do We Really Need Graph Convolution During Training? Light Post-Training Graph-ODE for Efficient RecommendationabstractThe efficiency and scalability of graph convolution networks (GCNs) in training recommender systems (RecSys) have been persistent concerns, hindering their deployment in real-world applications. This paper presents a critical examination of the necessity of graph convolutions during the training phase and introduces an innovative alternative: the Light Post-Training Graph Ordinary-Differential-Equation (LightGODE). Our investigation reveals that the benefits of GCNs are more pronounced during testing rather than training. Motivated by this, LightGODE utilizes a novel post-training graph convolution method that bypasses the computation-intensive message passing of GCNs and employs a non-parametric continuous graph ordinary-differential-equation (ODE) to dynamically model node representations. This approach drastically reduces training time while achieving fine-grained post-training graph convolution to avoid the distortion of the original training embedding space, termed the embedding discrepancy issue. We validate our model across several real-world datasets of different scales, demonstrating that LightGODE not only outperforms GCN-based models in terms of efficiency and effectiveness but also significantly mitigates the embedding discrepancy commonly associated with deeper graph convolution layers. Our LightGODE challenges the prevailing paradigms in RecSys training and suggests re-evaluating the role of graph convolutions, potentially guiding future developments of efficient large-scale graph-based RecSys. Weizhi Zhang 0001, Liangwei Yang, Zihe Song 0001, Henry Peng Zou, Ke Xu 0018, Liancheng Fang, Philip S. Yu |
CIKM | 2 |
| 2024 | Collaborative Alignment for RecommendationabstractTraditional recommender systems have primarily relied on identity representations (IDs) to model users and items. Recently, the integration of pre-trained language models (PLMs) has enhanced the capability to capture semantic descriptions of items. However, while PLMs excel in few-shot, zero-shot, and unified modeling scenarios, they often overlook the crucial signals from collaborative filtering (CF), resulting in suboptimal performance when sufficient training data is available. To effectively combine semantic representations with the CF signal and enhance recommender system performance in both warm and cold settings, two major challenges must be addressed: (1) bridging the gap between semantic and collaborative representation spaces, and (2) refining while preserving the integrity of semantic representations. In this paper, we introduce CARec, a novel model that adeptly integrates collaborative filtering signals with semantic representations, ensuring alignment within the semantic space while maintaining essential semantics. We present experimental results from four real-world datasets, which demonstrate significant improvements. By leveraging collaborative alignment, CARec also shows remarkable effectiveness in cold-start scenarios, achieving notable enhancements in recommendation performance. The code is available at https://github.com/ChenMetanoia/CARec **REMOVE 2nd URL**://github.com/ChenMetanoia/CARec. Chen Wang 0052, Liangwei Yang, Zhiwei Liu 0001, Xiaolong Liu 0012, Mingdai Yang, Yueqing Liang, Philip S. Yu |
CIKM | 2 |
| 2024 | Pre-Training with Transferable Attention for Addressing Market Shifts in Cross-Market Sequential RecommendationabstractCross-market recommendation (CMR) involves selling the same set of items across multiple nations or regions within a transfer learning framework. However, CMR's distinctive characteristics, including limited data sharing due to privacy policies, absence of user overlap, and a shared item set between markets present challenges for traditional recommendation methods. Moreover, CMR experiences market shifts, leading to differences in item popularity and user preferences among different markets. This study focuses on cross-market sequential recommendation (CMSR) and proposes the Cross-market Attention Transferring with Sequential Recommendation (CAT-SR) framework to address these challenges and market shifts. CAT-SR incorporates a pre-training strategy emphasizing item-item correlation, selective self-attention transferring for effective transfer learning, and query and key adapters for market-specific user preferences. Experimental results on real-world cross-market datasets demonstrate the superiority of CAT-SR, and ablation studies validate the benefits of its components across different geographical continents. CAT-SR offers a robust and adaptable solution for cross-market sequential recommendation. The code is available at https://github.com/ChenMetanoia/CATSR-KDD/. Chen Wang 0052, Ziwei Fan 0001, Liangwei Yang, Mingdai Yang, Xiaolong Liu 0012, Zhiwei Liu 0001, Philip S. Yu |
KDD | 3 |
| 2024 | Conditional Denoising Diffusion for Sequential Recommendation
Yu Wang 0158, Zhiwei Liu 0001, Liangwei Yang, Philip S. Yu |
PAKDD (5) | 3 |
| 2024 | Instruction-based Hypergraph PretrainingabstractPretraining has been widely explored to augment the adaptability of graph learning models to transfer knowledge from large datasets to a downstream task, such as link prediction or classification. However, the gap between training objectives and the discrepancy between data distributions in pretraining and downstream tasks hinders the transfer of the pre-trained knowledge. Inspired by instruction-based prompts widely used in pre-trained language models, we introduce instructions into graph pertaining. In this paper, we propose a novel pretraining framework named Instruction-based Hypergraph Pretraining. To overcome the discrepancy between pretraining and downstream tasks, text-based instructions provide explicit guidance on specific tasks for representation learning. Compared to learnable prompts, whose effectiveness depends on the quality and diversity of training data, text-based instructions intrinsically encapsulate task information and support the model's generalization beyond the structure seen during pretraining. To capture high-order relations with task information in a context-aware manner, a novel prompting hypergraph convolution layer is devised to integrate instructions into information propagation in hypergraphs. Extensive experiments conducted on three public datasets verify the superiority of IHP in various scenarios. Mingdai Yang, Zhiwei Liu 0001, Liangwei Yang, Xiaolong Liu 0012, Chen Wang 0052, Hao Peng 0001, Philip S. Yu |
SIGIR | 3 |
| 2024 | Knowledge Graph Context-Enhanced Diversified RecommendationabstractThe field of Recommender Systems (RecSys) has been extensively studied to enhance accuracy by leveraging users' historical interactions. Nonetheless, this persistent pursuit of accuracy frequently engenders diminished diversity, culminating in the well-recognized "echo chamber" phenomenon. Diversified RecSys has emerged as a countermeasure, placing diversity on par with accuracy and garnering noteworthy attention from academic circles and industry practitioners. This research explores the diversified RecSys within the intricate context of knowledge graphs (KG). These KGs act as repositories of interconnected information concerning entities and items, offering a propitious avenue to amplify recommendation diversity through the incorporation of insightful contextual information. Our contributions include introducing an innovative metric, Entity Coverage, and Relation Coverage, which effectively quantifies diversity within the KG domain. Additionally, we introduce the Diversified Embedding Learning (DEL) module, meticulously designed to formulate user representations that possess an innate awareness of diversity. In tandem with this, we introduce a novel technique named Conditional Alignment and Uniformity (CAU). It adeptly encodes KG item embeddings while preserving contextual integrity. Collectively, our contributions signify a substantial stride towards augmenting the panorama of recommendation diversity within the KG-informed RecSys paradigms. Xiaolong Liu 0012, Liangwei Yang, Zhiwei Liu 0001, Mingdai Yang, Chen Wang 0052, Hao Peng 0001, Philip S. Yu |
WSDM | 2 |
| 2024 | Unified Pretraining for Recommendation via Task HypergraphsabstractAlthough pretraining has garnered significant attention and popularity in recent years, its application in graph-based recommender systems is relatively limited. It is challenging to exploit prior knowledge by pretraining in widely used ID-dependent datasets. On the one hand, user-item interaction history in one dataset can hardly be transferred to other datasets through pretraining, where IDs are different. On the other hand, pretraining and finetuning on the same dataset leads to a high risk of overfitting. In this paper, we propose a novel multitask pretraining framework named Unified Pretraining for Recommendation via Task Hypergraphs. For a unified learning pattern to handle diverse requirements and nuances of various pretext tasks, we design task hypergraphs to generalize pretext tasks to hyperedge prediction. A novel transitional attention layer is devised to discriminatively learn the relevance between each pretext task and recommendation. Experimental results on three benchmark datasets verify the superiority of UPRTH. Additional detailed investigations are conducted to demonstrate the effectiveness of the proposed framework. Mingdai Yang, Zhiwei Liu 0001, Liangwei Yang, Xiaolong Liu 0012, Chen Wang 0052, Hao Peng 0001, Philip S. Yu |
WSDM | 3 |
| 2023 | Group-Aware Interest Disentangled Dual-Training for Personalized RecommendationabstractPersonalized recommender systems aim to predict users’ preferences for items. It has become an indispensable part of online services. Online social platforms enable users to form groups based on their common interests. The users’ group participation on social platforms reveals their interests and can be utilized as side information to mitigate the data sparsity and cold-start problem in recommender systems. Users join different groups out of different interests. In this paper, we generate group representation from the user’s interests and propose IGRec (Interest-based Group enhanced Recommendation) to utilize the group information accurately. It consists of four modules. (1) Interest disentangler via self-gating that disentangles users’ interests from their initial embedding representation. (2) Interest aggregator that generates the interest-based group representation by Gumbel-Softmax aggregation on the group members’ interests. (3) Interest-based group aggregation that fuses user’s representation with the participated group representation. (4) A dual-trained rating prediction module to utilize both user-item and group-item interactions. We conduct extensive experiments on three publicly available datasets. Results show IGRec can effectively alleviate the data sparsity problem and enhance the recommender system with interest-based group representation. Experiments on the group recommendation task further show the informativeness of interest-based group representation. Xiaolong Liu 0012, Liangwei Yang, Zhiwei Liu 0001, Xiaohan Li 0001, Mingdai Yang, Chen Wang 0052, Philip S. Yu |
IEEE Big Data | 2 |
| 2023 | Multi-View Graph Convolution for Participant RecommendationabstractSocial networks have become essential for people’s lives. The proliferation of web services further expands social networks at an unprecedented scale, leading to immeasurable commercial value for online platforms. Recently, the group buying (GB) business mode is prevalent and also becoming more popular in E-commerce. GB explicitly forms groups of users with similar interests to secure better discounts from the merchants, often operating within social networks. It is a novel way to further unlock the commercial value by explicitly utilizing the online social network in E-commerce. Participant recommendation, a fundamental problem emerging together with GB, aims to find the participants for a launched group buying process with an initiator and a target item to increase the GB success rate. This paper proposes Multi-View Graph Convolution for Participant Recommendation (MVPRec) to tackle this problem. To differentiate the roles of users (Initiator/Participant) within the GB process, we explicitly reconstruct historical GB data into initiator-view and participant-view graphs. Together with the social graph, we obtain a multi-view user representation with graph encoders. Then MVPRec fuses the GB and social representation with an attention module to obtain the user representation and learns a matching score with the initiator’s social friends via a multi-head attention mechanism. Social friends with the Top-k matching score are recommended for the corresponding GB process. Experiments on three datasets justify the effectiveness of MVPRec in the emerging participant recommendation problem. MVPRec is open-sourced at https://github.com/Xiaolong-Liu-bdsc/MVPRec to inspire further research in the new group buying E-commerce business mode. Xiaolong Liu 0012, Liangwei Yang, Chen Wang 0052, Mingdai Yang, Zhiwei Liu 0001, Philip S. Yu |
IEEE Big Data | 2 |
| 2023 | Dual-Teacher Knowledge Distillation for Strict Cold-Start RecommendationabstractRecommender systems (RecSys) aim to predict users’ preferences based on historical interactions and content profiles, and they are vital components of many online services. However, the strict cold-start (SCS) issue, i.e., users/items have no prior interactions, poses significant challenges for RecSys. The existing methods seek to transfer content knowledge, collaborative filtering (CF) knowledge, or combine the two from the warm-start scenario towards the (strict) cold-start scenarios. However, these approaches either ignore the available information or model the information in rough manners such that the two types of knowledge interfere with each other, leading to ineffective and uncontrolled knowledge transfer. In this work, we propose a novel dual-teacher knowledge distillation (DTKD) framework that simultaneously and effectively transfers both content and CF knowledge. The proposed DTKD framework contains two teachers, one for each knowledge type, that is specifically designed according to the characteristics of the content and CF data to distill the knowledge fully. Soft scoring is calculated during the distillation to denoise and augment the original hard-labeled interactions. A knowledge fusion module is then proposed to collect the consensus of the two teachers’ opinions. Finally, DTKD transfers both content and CF knowledge into a student module that learns the shared viewpoints of the teachers. We conduct extensive experiments on real-world datasets under the warm-start as well as three different SCS settings (i.e., strict cold users, strict cold items, and strict cold users & items). Experimental results show that DTKD outperforms strong baselines by large margins under all settings, especially the SCS ones. Weizhi Zhang 0001, Liangwei Yang, Yuwei Cao, Ke Xu 0018, Yuanjie Zhu, Philip S. Yu |
IEEE Big Data | 2 |
| 2023 | Dimension Independent Mixup for Hard Negative Sample in Collaborative FilteringabstractCollaborative filtering (CF) is a widely employed technique that predicts user preferences based on past interactions. Negative sampling plays a vital role in training CF-based models with implicit feedback. In this paper, we propose a novel perspective based on the sampling area to revisit existing sampling methods. We point out that current sampling methods mainly focus on Point-wise or Line-wise sampling, lacking flexibility and leaving a significant portion of the hard sampling area un-explored. To address this limitation, we propose Dimension Independent Mixup for Hard Negative Sampling (DINS), which is the first Area-wise sampling method for training CF-based models. DINS comprises three modules: Hard Boundary Definition, Dimension Independent Mixup, and Multi-hop Pooling. Experiments with real-world datasets on both matrix factorization and graph-based models demonstrate that DINS outperforms other negative sampling methods, establishing its effectiveness and superiority. Our work contributes a new perspective, introduces Area-wise sampling, and presents DINS as a novel approach that achieves state-of-the-art performance for negative sampling. Our implementations are available in PyTorch. Xi Wu 0009, Liangwei Yang, Jibing Gong, Xiaolong Liu 0012, Philip S. Yu |
CIKM | 2 |
| 2023 | Graph-based Alignment and Uniformity for RecommendationabstractCollaborative filtering-based recommender systems (RecSys) rely on learning representations for users and items to predict preferences accurately. Representation learning on the hypersphere is a promising approach due to its desirable properties, such as alignment and uniformity. However, the sparsity issue arises when it encounters RecSys. To address this issue, we propose a novel approach, graph-based alignment and uniformity (GraphAU), that explicitly considers high-order connectivities in the user-item bipartite graph. GraphAU aligns the user/item embedding to the dense vector representations of high-order neighbors using a neighborhood aggregator, eliminating the need to compute the burdensome alignment to high-order neighborhoods individually. To address the discrepancy in alignment losses, GraphAU includes a layer-wise alignment pooling module to integrate alignment losses layer-wise. Experiments on four datasets show that GraphAU significantly alleviates the sparsity issue and achieves state-of-the-art performance. We open-source GraphAU at https://github.com/YangLiangwei/GraphAU. Liangwei Yang, Zhiwei Liu 0001, Chen Wang 0052, Mingdai Yang, Xiaolong Liu 0012, Jing Ma 0004, Philip S. Yu |
CIKM | 1 |
| 2023 | Group Identification via Transitional Hypergraph Convolution with Cross-view Self-supervised LearningabstractWith the proliferation of social media, a growing number of users search for and join group activities in their daily life. This develops a need for the study on the group identification (GI) task, i.e., recommending groups to users. The major challenge in this task is how to predict users' preferences for groups based on not only previous group participation of users but also users' interests in items. Although recent developments in Graph Neural Networks (GNNs) accomplish embedding multiple types of objects in graph-based recommender systems, they, however, fail to address this GI problem comprehensively. In this paper, we propose a novel framework named Group Identification via Transitional Hypergraph Convolution with Graph Self-supervised Learning (GTGS). We devise a novel transitional hypergraph convolution layer to leverage users' preferences for items as prior knowledge when seeking their group preferences. To construct comprehensive user/group representations for GI task, we design the cross-view self-supervised learning to encourage the intrinsic consistency between item and group preferences for each user, and the group-based regularization to enhance the distinction among group embeddings. Experimental results on three benchmark datasets verify the superiority of GTGS. Additional detailed investigations are conducted to demonstrate the effectiveness of the proposed framework. Mingdai Yang, Zhiwei Liu 0001, Liangwei Yang, Xiaolong Liu 0012, Chen Wang 0052, Hao Peng 0001, Philip S. Yu |
CIKM | 3 |
| 2023 | Multi-task Item-attribute Graph Pre-training for Strict Cold-start Item RecommendationabstractRecommendation systems suffer in the strict cold-start (SCS) scenario, where the user-item interactions are entirely unavailable. The well-established, dominating identity (ID)-based approaches completely fail to work. Cold-start recommenders, on the other hand, leverage item contents (brand, title, descriptions, etc.) to map the new items to the existing ones. However, the existing SCS recommenders explore item contents in coarse-grained manners that introduce noise or information loss. Moreover, informative data sources other than item contents, such as users’ purchase sequences and review texts, are largely ignored. In this work, we explore the role of the fine-grained item attributes in bridging the gaps between the existing and the SCS items and pre-train a knowledgeable item-attribute graph for SCS item recommendation. Our proposed framework, ColdGPT, models item-attribute correlations into an item-attribute graph by extracting fine-grained attributes from item contents. ColdGPT then transfers knowledge into the item-attribute graph from various available data sources, i.e., item contents, historical purchase sequences, and review texts of the existing items, via multi-task learning. To facilitate the positive transfer, ColdGPT designs specific submodules according to the natural forms of the data sources and proposes to coordinate the multiple pre-training tasks via unified alignment-and-uniformity losses. Our pre-trained item-attribute graph acts as an implicit, extendable item embedding matrix, which enables the SCS item embeddings to be easily acquired by inserting these items into the item-attribute graph and propagating their attributes’ embeddings. We carefully process three public datasets, i.e., Yelp, Amazon-home, and Amazon-sports, to guarantee the SCS setting for evaluation. Extensive experiments show that ColdGPT consistently outperforms the existing SCS recommenders by large margins and even surpasses models that are pre-trained on 75 - 224 times more, cross-domain data on two out of four datasets. Our code and pre-processed datasets for SCS evaluations are publicly available to help future SCS studies. Yuwei Cao, Liangwei Yang, Chen Wang 0052, Zhiwei Liu 0001, Hao Peng 0001, Chenyu You, Philip S. Yu |
RecSys | 2 |
| 2023 | Ranking-based Group Identification via Factorized Attention on Social Tripartite GraphabstractDue to the proliferation of social media, a growing number of users search for and join group activities in their daily life. This develops a need for the study on the ranking-based group identification (RGI) task, i.e., recommending groups to users. The major challenge in this task is how to effectively and efficiently leverage the item interaction information from users' and groups' online behaviors, in addition to the information from social interaction between users and groups. Though recent developments of Graph Neural Networks (GNNs) succeed in aggregating both social and user-item interaction simultaneously, they however fail to comprehensively resolve this RGI task. In this paper, we propose a novel GNN-based framework named Contextualized Factorized Attention for Group identification (CFAG). We devise tripartite graph convolution to aggregate information from different types of neighborhoods among users, groups, and items. To cope with the data sparsity issue, we devise a novel propagation augmentation (PA) layer, which is based on our proposed factorized attention mechanism. PA layers efficiently learn the relevance degree of non-neighbor nodes to improve the information propagation to users. Experimental results on three benchmark datasets verify the superiority of CFAG. Additional detailed investigations are conducted to demonstrate the effectiveness of the proposed framework. Mingdai Yang, Zhiwei Liu 0001, Liangwei Yang, Xiaolong Liu 0012, Chen Wang 0052, Hao Peng 0001, Philip S. Yu |
WSDM | 3 |
| 2023 | DGRec: Graph Neural Network for Recommendation with Diversified Embedding GenerationabstractGraph Neural Network (GNN) based recommender systems have been attracting more and more attention in recent years due to their excellent performance in accuracy. Representing user-item interactions as a bipartite graph, a GNN model generates user and item representations by aggregating embeddings of their neighbors. However, such an aggregation procedure often accumulates information purely based on the graph structure, overlooking the redundancy of the aggregated neighbors and resulting in poor diversity of the recommended list. In this paper, we propose diversifying GNN-based recommender systems by directly improving the embedding generation procedure. Particularly, we utilize the following three modules: submodular neighbor selection to find a subset of diverse neighbors to aggregate for each GNN node, layer attention to assign attention weights for each layer, and loss reweighting to focus on the learning of items belonging to long-tail categories. Blending the three modules into GNN, we present DGRec (Diversified GNN-based Recommender System) for diversified recommendation. Experiments on real-world datasets demonstrate that the proposed method can achieve the best diversity while keeping the accuracy comparable to state-of-the-art GNN-based recommender systems. We open source DGRec at https://github.com/YangLiangwei/DGRec. Liangwei Yang, Shengjie Wang 0001, Yunzhe Tao, Jiankai Sun, Xiaolong Liu 0012, Philip S. Yu, Taiqing Wang |
WSDM | 1 |
| 2023 | Graph-based Village Level Poverty IdentificationabstractPoverty status identification is the first obstacle to eradicating poverty. Village-level poverty identification is very challenging due to the arduous field investigation and insufficient information. The development of the Web infrastructure and its modeling tools provides fresh approaches to identifying poor villages. Upon those techniques, we build a village graph for village poverty status identification. By modeling the village connections as a graph through the geographic distance, we show the correlation between village poverty status and its graph topological position and identify two key factors (Centrality, Homophily Decaying effect) for identifying villages. We further propose the first graph-based method to identify poor villages. It includes a global Centrality2Vec module to embed village centrality into the dense vector and a local graph distance convolution module that captures the decaying effect. In this paper, we make the first attempt to interpret and identify village-level poverty from a graph perspective. Jing Ma 0004, Liangwei Yang, Qiong Feng, Weizhi Zhang 0001, Philip S. Yu |
WWW | 2 |
| 2022 | MetaKRec: Collaborative Meta-Knowledge Enhanced Recommender SystemabstractKnowledge graph (KG) enhanced recommendation has demonstrated improved performance in the recommendation system (RecSys) and attracted considerable research interest. Recently the literature has adopted neural graph networks (GNNs) on the collaborative knowledge graph and built an end-to-end KG-enhanced RecSys. However, the majority of these approaches have three limitations: (1) treat the collaborative knowledge graph as a homogeneous graph and overlook the highly heterogeneous relationships among items, (2) lack of design to explicitly leverage the rich side information, and (3) overlook the rich knowledge in user preference.To fill this gap, in this paper, we explore the rich, heterogeneous relationship among items and propose a new KG-enhanced recommendation model called Collaborative Meta-Knowledge Enhanced Recommender System (MetaKRec). In particular, we focus on modeling the rich, heterogeneous semantic relationships among items and construct several collaborative Meta-KGs to explicitly depict the relatedness of the items under the guidance of meta-knowledge. In addition to the knowledge obtained from KG, we leverage user knowledge that extracts from user preference to construct the Meta-KGs. The constructed Meta-KGs can capture the knowledge from both the knowledge graph and user preference. Furthermore. we utilize a light convolution encoder to recursively integrate the item relationship in each collaborative Meta-KGs. This scheme allows us to explicitly gather the heterogeneous semantic relationships among items and encode them into the representations of items. In addition, we propose channel attention to fuse the item and user representations from different Meta-KGs. Extensive experiments are conducted on four real-world benchmark datasets, demonstrating significant gains over the state-of-the-art baselines on both regular and cold-start recommendation settings. Shen Wang 0005, Liangwei Yang, Jibing Gong, Shaojie Zheng, Shuying Du, Zhiwei Liu 0001, Philip S. Yu |
IEEE Big Data | 2 |
| 2022 | ContrastVAE: Contrastive Variational AutoEncoder for Sequential RecommendationabstractAiming at exploiting the rich information in user behaviour sequences, sequential recommendation has been widely adopted in real-world recommender systems. However, current methods suffer from the following issues: 1) sparsity of user-item interactions, 2) uncertainty of sequential records, 3) long-tail items. In this paper, we propose to incorporate contrastive learning into the framework of Variational AutoEncoders to address these challenges simultaneously. Firstly, we introduce ContrastELBO, a novel training objective that extends the conventional single-view ELBO to two-view case and theoretically builds a connection between VAE and contrastive learning from a two-view perspective. Then we propose Contrastive Variational AutoEncoder (ContrastVAE in short), a two-branched VAE model with contrastive regularization as an embodiment of ContrastELBO for sequential recommendation. We further introduce two simple yet effective augmentation strategies named model augmentation and variational augmentation to create a second view of a sequence and thus making contrastive learning possible. Experiments on four benchmark datasets demonstrate the effectiveness of ContrastVAE and the proposed augmentation methods. Codes are available at https://github.com/YuWang-1024/ContrastVAE Yu Wang 0158, Zhiwei Liu 0001, Liangwei Yang, Philip S. Yu |
CIKM | 4 |
| 2022 | Large-scale Personalized Video Game Recommendation via Social-aware Contextualized Graph Neural NetworkabstractBecause of the large number of online games available nowadays, online game recommender systems are necessary for users and online game platforms. The former can discover more potential online games of their interests, and the latter can attract users to dwell longer in the platform. This paper investigates the characteristics of user behaviors with respect to the online games on the Steam platform. Based on the observations, we argue that a satisfying recommender system for online games is able to characterize: personalization, game contextualization and social connection. However, simultaneously solving all is rather challenging for game recommendation. Firstly, personalization for game recommendation requires the incorporation of the dwelling time of engaged games, which are ignored in existing methods. Secondly, game contextualization should reflect the complex and high-order properties of those relations. Last but not least, it is problematic to use social connections directly for game recommendations due to the massive noise within social connections. To this end, we propose a Social-aware Contextualized Graph Neural Recommender System (SCGRec), which harnesses three perspectives to improve game recommendation. We conduct a comprehensive analysis of users’ online game behaviors, which motivates the necessity of handling those three characteristics in the online game recommendation. Liangwei Yang, Zhiwei Liu 0001, Yu Wang 0158, Chen Wang 0052, Ziwei Fan 0001, Philip S. Yu |
WWW | 1 |
| 2022 | Federated Social Recommendation with Graph Neural NetworkabstractRecommender systems have become prosperous nowadays, designed to predict users’ potential interests in items by learning embeddings. Recent developments of the Graph Neural Networks (GNNs) also provide recommender systems (RSs) with powerful backbones to learn embeddings from a user-item graph. However, only leveraging the user-item interactions suffers from the cold-start issue due to the difficulty in data collection. Hence, current endeavors propose fusing social information with user-item interactions to alleviate it, which is the social recommendation problem. Existing work employs GNNs to aggregate both social links and user-item interactions simultaneously. However, they all require centralized storage of the social links and item interactions of users, which leads to privacy concerns. Additionally, according to strict privacy protection under General Data Protection Regulation, centralized data storage may not be feasible in the future, urging a decentralized framework of social recommendation. As a result, we design a federated learning recommender system for the social recommendation task, which is rather challenging because of its heterogeneity, personalization, and privacy protection requirements. To this end, we devise a novel framework Fe drated So cial recommendation with G raph neural network ( FeSoG ). Firstly, FeSoG adopts relational attention and aggregation to handle heterogeneity. Secondly, FeSoG infers user embeddings using local data to retain personalization. Last but not least, the proposed model employs pseudo-labeling techniques with item sampling to protect the privacy and enhance training. Extensive experiments on three real-world datasets justify the effectiveness of FeSoG in completing social recommendation and privacy protection. We are the first work proposing a federated learning framework for social recommendation to the best of our knowledge. Zhiwei Liu 0001, Liangwei Yang, Ziwei Fan 0001, Hao Peng 0001, Philip S. Yu |
ACM Trans. Intell. Syst. Technol. | 2 |
| 2021 | ConsisRec: Enhancing GNN for Social Recommendation via Consistent Neighbor AggregationabstractSocial recommendation aims to fuse social links with user-item interactions to alleviate the cold-start problem for rating prediction. Recent developments of Graph Neural Networks (GNNs) motivate endeavors to design GNN-based social recommendation frameworks to aggregate both social and user-item interaction information simultaneously. However, most existing methods neglect the social inconsistency problem, which intuitively suggests that social links are not necessarily consistent with the rating prediction process. Social inconsistency can be observed from both context-level and relation-level. Therefore, we intend to empower the GNN model with the ability to tackle the social inconsistency problem. We propose to sample consistent neighbors by relating sampling probability with consistency scores between neighbors. Besides, we employ the relation attention mechanism to assign consistent relations with high importance factors for aggregation. Experiments on two real-world datasets verify the model effectiveness. Liangwei Yang, Zhiwei Liu 0001, Yingtong Dou, Jing Ma 0004, Philip S. Yu |
SIGIR | 1 |