Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Qidong Liu 0002

dblp:254/1779-2 · DBLP profile ↗
shortlisted ← Back
28ranked-venue papers
9as first author
27since 2021 · last 2026
0000-0002-0751-2602ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Databases, data management, data science and information retrieval · 19 · 6 first-author · 19 since 2021Artificial intelligence and machine learning · 17 · 5 first-author · 16 since 2021Graphics, computer vision, multimedia, augmented reality and games · 4 · 1 first-author · 4 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Databases, data mining, and information retrieval
15 papers
Recommender systems · 86% Information retrieval · 7% Data mining · 7%
Artificial intelligence
8 papers
Language models and text generation · 19% Efficient and distributed learning · 17% Representation and self-supervised learning · 12%
Interdisciplinary, comprehensive, and emerging computing
2 papers
Medical and health informatics · 100%

Topics — the 30 heaviest of 45, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Recommender systems
sequential recommendation
4.662026
LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase Training · SIGIR 2026
Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation · SIGIR 2025
SIGMA: Selective Gated Mamba for Sequential Recommendation · AAAI 2025
Recommender systems
large language model-based recommendation
2.132026
LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase Training · SIGIR 2026
LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendation · AAAI 2025
Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation · SIGIR 2025
Recommender systems › sequential recommendation
cross-domain sequential recommendation
1.922026
LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase Training · SIGIR 2026
Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation · SIGIR 2025
Recommender systems
user modeling
1.522024
M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework · SIGIR 2024
Bi-Level User Modeling for Deep Recommenders · ICDM 2024
Recommender systems
generative recommendation
1.012026
GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networks · SIGIR 2026
Natural language and speech › Language models and text generation
large language model reasoning
0.912025
Stepwise Reasoning Disruption Attack of LLMs · ACL (1) 2025
Machine learning › Representation and self-supervised learning › representation learning › spatio-temporal representation learning
trajectory representation learning
0.912025
Learning Generalized and Flexible Trajectory Models from Omni-Semantic Supervision · KDD (2) 2025
Medical and health informatics
clinical prediction
0.912025
A Contrastive Pretrain Model with Prompt Tuning for Multi-center Medication Recommendation · ACM Trans. Inf. Syst. 2025
Medical and health informatics › clinical decision support
medication recommendation
0.912025
A Contrastive Pretrain Model with Prompt Tuning for Multi-center Medication Recommendation · ACM Trans. Inf. Syst. 2025
Data mining
behavior modeling
0.912025
Behavior Modeling Space Reconstruction for E-Commerce Search · WWW 2025
Information retrieval
e-commerce search
0.912025
Behavior Modeling Space Reconstruction for E-Commerce Search · WWW 2025
Recommender systems › sequential recommendation
efficient sequential recommendation
0.912025
SIGMA: Selective Gated Mamba for Sequential Recommendation · AAAI 2025
Recommender systems › side information integration
knowledge augmentation
0.912025
Large Language Model Enhanced Recommender Systems: Methods, Applications and Trends · KDD (2) 2025
Recommender systems › sequential recommendation
next-item recommendation
0.912025
SIGMA: Selective Gated Mamba for Sequential Recommendation · AAAI 2025
Data mining › time series analysis
time series forecasting
0.912025
TimeEmb: A Lightweight Static-Dynamic Disentanglement Framework for Time Series Forecasting · NeurIPS 2025
Recommender systems › user modeling
user preference modeling
0.912025
LLM-Powered User Simulator for Recommender System · AAAI 2025
Information retrieval › evaluation › user simulation
user simulator
0.912025
LLM-Powered User Simulator for Recommender System · AAAI 2025
Security and privacy of machine learning › large language model security
adversarial attacks on language models
0.912025
Stepwise Reasoning Disruption Attack of LLMs · ACL (1) 2025
Machine learning › Generative modeling
diffusion model
0.812024
ControlTraj: Controllable Trajectory Generation with Topology-Constrained Diffusion Model · KDD 2024
Machine learning › Efficient and distributed learning › parameter-efficient fine-tuning
low-rank adaptation
0.812024
When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications · SIGIR 2024
Machine learning › Deep learning architectures and training
mixture of experts
0.812024
When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications · SIGIR 2024
Machine learning › Learning paradigms
multi-task learning
0.812024
When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications · SIGIR 2024
Machine learning › Efficient and distributed learning
parameter-efficient fine-tuning
0.812024
When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications · SIGIR 2024
Robotics › Motion planning and robot control
trajectory planning
0.812024
ControlTraj: Controllable Trajectory Generation with Topology-Constrained Diffusion Model · KDD 2024
Recommender systems
cross-domain recommendation
0.812024
M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework · SIGIR 2024
Recommender systems › context-aware recommendation
dynamic recommendation
0.812024
M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework · SIGIR 2024
Recommender systems › beyond-accuracy recommendation
long-tail recommendation
0.812024
LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation · NeurIPS 2024
Recommender systems
mixture of experts
0.812024
M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework · SIGIR 2024
Recommender systems
neural recommendation
0.812024
Bi-Level User Modeling for Deep Recommenders · ICDM 2024
Recommender systems
multi-scenario recommendation
0.712023
PLATE: A Prompt-Enhanced Paradigm for Multi-Scenario Recommendations · SIGIR 2023

Methods — techniques the papers use, named apart from their topics

large language model · 2.6contrastive learning · 2.6prompt tuning · 2.4stepwise reasoning disruption · 1.7adversarial prompting · 1.7mixture of experts · 1.5transferable item augmenter · 1.0trajectory sampling · 1.0reward-based fine-tuning · 1.0generative flow networks · 1.0dual-phase training · 1.0domain-aware profiling · 1.0survey · 0.9statistical model · 0.9self-supervised learning · 0.9pre-training · 0.9omni-semantic supervision · 0.9ensemble model · 0.9
YearPublicationVenuePosition
2026 LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase Training
abstract
Cross-domain Sequential Recommendation (CDSR) has been proposed to enrich user-item interactions by incorporating information from various domains. Despite current progress, the domain imbalance issue and domain transition issue hinder further development of CDSR. The former presents a phenomenon where interactions in one domain dominate the entire behavior, leading to difficulty in capturing domain-specific features in the other domain. The latter points to the difficulty in capturing users' cross-domain preferences within the mixed interaction sequence, resulting in poor next-item prediction performance for specific domains. With world knowledge and powerful reasoning abilities, Large Language Models (LLMs) partially alleviate the above issues by functioning as both a generator and an encoder. However, current LLMs-enhanced CDSR methods are still under exploration, which fail to recognize the irrelevant noise and rough profiling problems. Thus, to address the aforementioned challenges, we propose an LLMs Enhanced Cross-domain Sequential Recommendation with Dual-phase Training (LLM-EDT). To address the domain imbalance issue while minimizing irrelevant noise, we propose the transferable item augmenter to adaptively generate possible cross-domain behaviors for users. Then, to alleviate the domain transition issue, we introduce a dual-phase training strategy to empower the domain-specific thread with a domain-shared background. As for the rough profiling problem, we devise a domain-aware profiling module to summarize the user's preference in each domain and adaptively aggregate them to generate comprehensive user profiles. The experiments on three public datasets validate the effectiveness of our proposed LLM-EDT. To ease reproducibility, we have released the detailed code online {https://github.com/Applied-Machine-Learning-Lab/SIGIR26_LLM-EDT}. © 2026 Copyright held by the owner/author(s).
Ziwei Liu 0010, Qidong Liu 0002, Yejing Wang, Pengyue Jia, Tong Xu 0001, Wei Huang 0046, Chong Chen 0001, Xiangyu Zhao 0001
SIGIR2
2026 GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networks
abstract
Generative recommendation (GR) has shown great promise in industrial applications, particularly for candidate generation and end-to-end recommendations. However, existing GR training paradigms suffer from two fundamental mismatches with real-world deployment requirements. First, they optimize for point-wise prediction of a single ground-truth item, whereas practical systems must produce a diverse, high-value set of candidates. Second, they treat all user interactions as equally informative, ignoring their inherent differences in utility. Although reward-based fine-tuning offers a partial remedy, it often lacks token-level supervision. To address these challenges, we reformulate GR as a sequential set-generation problem and propose GFlowGR, a GFlowNet-based fine-tuning framework that explicitly aligns generation probabilities with item-level utilities. GFlowGR comprises three tightly integrated components, each addressing a key limitation of conventional fine-tuning: a trajectory sampler that constructs training trajectories from candidate sets to enable set-wise learning, a behavior-aware reward model that quantifies item utility to support value-aware optimization, and a GFlowNet objective that provides token-level supervision. Extensive experiments on three real-world datasets with two representative LLM-based GR backbones show consistent and significant improvements over strong baselines, validating the effectiveness of our approach. For real-world deployment, GFlowGR has been integrated into Taobao 's search advertising businesses, delivering a 0.4% relative improvement in annual revenue since its launch in mid-2025, corresponding to billion-level monetary gains. Code is available at https://github.com/Applied-Machine-Learning-Lab/SIGIR26_GFlowGR.
Yejing Wang, Shengyu Zhou, Jinyu Lu, Qidong Liu 0002, Xinhang Li 0001, Wenlin Zhang 0001, Feng Li 0067, Pengjie Wang 0002, Chuan Yu 0002, Jian Xu 0015, Bo Zheng 0007, Xiangyu Zhao 0001
SIGIR4
2026 Graph Mixture of Experts with Differential Cross-Attention Alignment for Multimodal Intent Recognition
Shilin Sun 0001, Wenbin An, Qidong Liu 0002, Jiahao Nie 0002, Zhi Zeng 0001, Xian-Sheng Hua, Yaqiang Wu, Feng Tian 0002
Knowl. Based Syst.3
2025 LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendation
abstract
Sequential Recommender Systems (SRS), which model a user's interaction history to predict the next item of interest, are widely used in various applications. However, existing SRS often struggle with low-popularity items, a challenge known as the long-tail problem. This issue leads to reduced serendipity for users and diminished profits for sellers, ultimately harming the overall system. Large Language Model (LLM) has the ability to capture semantic relationships between items, independent of their popularity, making them a promising solution to this problem. In this paper, we introduce LLMEmb, a novel method leveraging LLM to generate item embeddings that enhance SRS performance. To bridge the gap between general-purpose LLM and the recommendation domain, we propose a Supervised Contrastive Fine-Tuning (SCFT) approach. This approach includes attribute-level data augmentation and a tailored contrastive loss to make LLM more recommendation-friendly. Additionally, we emphasize the importance of integrating collaborative signals into LLM-generated embeddings, for which we propose Recommendation Adaptation Training (RAT). This further refines the embeddings for optimal use in SRS. The LLMEmb-derived embeddings can be seamlessly integrated with any SRS model, underscoring the practical value. Comprehensive experiments conducted on three real-world datasets demonstrate that LLMEmb significantly outperforms existing methods across multiple SRS models.
Qidong Liu 0002, Xian Wu 0001, Yejing Wang, Yuanshao Zhu, Xiangyu Zhao 0001, Feng Tian 0002, Yefeng Zheng 0001
AAAI1
2025 LLM-Powered User Simulator for Recommender System
abstract
User simulators can rapidly generate a large volume of timely user behavior data, providing a testing platform for reinforcement learning-based recommender systems, thus accelerating their iteration and optimization. However, prevalent user simulators generally suffer from significant limitations, including the opacity of user preference modeling and the incapability of evaluating simulation accuracy. In this paper, we introduce an LLM-powered user simulator to simulate user engagement with items in an explicit manner, thereby enhancing the efficiency and effectiveness of reinforcement learning-based recommender systems training. Specifically, we identify the explicit logic of user preferences, leverage LLMs to analyze item characteristics and distill user sentiments, and design a logical model to imitate real human engagement. By integrating a statistical model, we further enhance the reliability of the simulation, proposing an ensemble model that synergizes logical and statistical insights for user interaction simulations. Capitalizing on the extensive knowledge and semantic generation capabilities of LLMs, our user simulator faithfully emulates user behaviors and preferences, yielding high-fidelity training data that enrich the training of recommendation algorithms. We establish quantifying and qualifying experiments on five datasets to validate the simulator's effectiveness and stability across various recommendation scenarios.
Zijian Zhang 0009, Shuchang Liu 0001, Ziru Liu, Rui Zhong 0003, Qingpeng Cai 0001, Xiangyu Zhao 0001, Chunxu Zhang, Qidong Liu 0002, Peng Jiang 0002
AAAI8
2025 SIGMA: Selective Gated Mamba for Sequential Recommendation
abstract
Sequential Recommender Systems (SRS) has stood out as a highly promising technique in numerous domains due to its impressive capability of capturing complex user preferences. Current SRS have employed transformer-based models to give the next-item prediction. Nevertheless, its quadratic computational complexity has often resulted in notable inefficiencies, posing a significant obstacle to real-time recommendation processes. Recently, Mamba has demonstrated its exceptional effectiveness in time series prediction, delivering substantial improvements in both efficiency and effectiveness. However, directly applying Mamba to SRS poses certain challenges. Its unidirectional structure may impede the ability to capture contextual information in user-item interactions, while its instability in state estimation may hinder the ability to capture short-term patterns in interaction sequences. To address these issues, we propose a novel framework called Selective Gated Mamba for Sequential Recommendation (SIGMA). By introducing the Partially Flipped Mamba (PF-Mamba), we construct a special bi-directional structure to address the context modeling challenge. Then, to consolidate PF-Mamba's performance, we employed an input-dependent Dense Selective Gate (DS Gate) to allocate the weights of the two directions and further filter the sequential information. Moreover, for short sequence modeling, we devise a Feature Extract GRU (FE-GRU) to capture the short-term dependencies. Experimental results demonstrate that SIGMA significantly outperforms existing baselines across five real-world datasets. Our implementation code is available in Supplementary Material to ease reproducibility.
Ziwei Liu 0010, Qidong Liu 0002, Yejing Wang, Pengyue Jia, Maolin Wang 0001, Zitao Liu 0001, Yi Chang 0001, Xiangyu Zhao 0001
AAAI2
2025 Stepwise Reasoning Disruption Attack of LLMs
abstract
Jingyu Peng, Maolin Wang, Xiangyu Zhao, Kai Zhang, Wanyu Wang, Pengyue Jia, Qidong Liu, Ruocheng Guo, Qi Liu. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Jingyu Peng, Maolin Wang 0001, Xiangyu Zhao 0001, Kai Zhang 0038, Pengyue Jia, Qidong Liu 0002, Ruocheng Guo, Qi Liu 0003
ACL (1)7
2025 SELF: Surrogate-light Feature Selection with Large Language Models in Deep Recommender Systems
abstract
Feature selection is crucial in recommender systems for improving model efficiency and predictive performance. Conventional approaches typically employ surrogate models-such as decision trees or neural networks-to estimate feature importance. However, their effectiveness is inherently constrained, as these models may struggle under suboptimal training conditions, including feature collinearity, high-dimensional sparsity, and insufficient data. In this paper, we propose SELF, a SurrogatE-Light Feature selection method for deep recommender systems. SELF integrates semantic reasoning from Large Language Models (LLMs) with task-specific learning from surrogate models, enabling an automated and lightweight feature selection process. Specifically, LLMs first produce a semantically informed ranking of feature importance, which is subsequently refined by a surrogate model, effectively integrating general world knowledge with task-specific learning. Comprehensive experiments on three public datasets from real-world recommender platforms validate the effectiveness of SELF. To facilitate reproducibility, our code is publicly available.
Pengyue Jia, Zhaocheng Du, Yichao Wang 0002, Xiangyu Zhao 0001, Xiaopeng Li 0014, Yuhao Wang 0006, Qidong Liu 0002, Huifeng Guo, Ruiming Tang
CIKM7
2025 Exploring Triple Knowledge Cues for Zero-Shot Human-Object Interaction Detection
abstract
Current zero-shot human-object interaction detection methods often follow a two-phase pipeline, which uses a pre-trained detector to detect instances and then adopts CLIP to perform interaction prediction. During the second phase, they either obtain pairwise representations by directly performing RoI-Align on CLIP features or designing additional queries and decoders to fuse CLIP features. However, CLIP visual features often lack fine-grained information, thus being detrimental to capturing complex HOI interactions. Besides, extra decoders might increase computation costs. Thus, we propose a triple knowledge cues exploration model without extra decoders to explore various knowledge guidance for improving CLIP representations. First, we incorporate position distribution and semantic priors to delineate a layout from the predicted boxes and inject semantics by using the CLIP text embeddings. Next, we explore object priors by leveraging predefined class names and the text encoder to obtain saliency maps for humans and objects. Then, we design three types of holistic tokens to capture diverse attribute cues for human, object, and interaction, respectively. The above cues are finally integrated into a vanilla two-stage CLIP-based baseline. The experimental results on HICO-DET demonstrate the effectiveness of our proposed model.
Ni Zhang 0001, Qidong Liu 0002, Guang Dai, Yan Chen 0031, Feng Tian 0002
ICASSP3
2025 Large Language Model Enhanced Recommender Systems: Methods, Applications and Trends
abstract
Due to exceptional reasoning and understanding abilities, the Large Language Model (LLM) has revolutionized the pattern of many fields, including recommender systems (RS). There has been a handful of research that focuses on empowering the RS by LLM. Recently, considering the latency and memory costs in real-world applications, LLM-Enhanced RS (LLMERS) is highlighted. This direction pushes the LLM into the online system with a large step by eliminating the utilization of LLM during inference. As a cutting-edge field, there is a clear need for a comprehensive survey to summarize this direction. In this survey, we systematically investigate the most up-to-date works of LLM-enhanced RS to boost this direction. Based on the component of an RS model that the LLM aims to augment, the basic taxonomy includes Knowledge Enhancement, Interaction Enhancement and Model Enhancement. Additionally, we identify several promising research directions. To facilitate access to the surveyed papers, we release a repository.
Qidong Liu 0002, Xiangyu Zhao 0001, Yuhao Wang 0006, Yejing Wang, Zijian Zhang 0009, Xiang Li 0113, Maolin Wang 0001, Pengyue Jia, Chong Chen 0001, Wei Huang 0046, Feng Tian 0002
KDD (2)1
2025 Learning Generalized and Flexible Trajectory Models from Omni-Semantic Supervision
Yuanshao Zhu, James Jian Qiao Yu, Xiangyu Zhao 0001, Xiao Han 0004, Qidong Liu 0002, Xuetao Wei, Yuxuan Liang 0002
KDD (2)5
2025 TimeEmb: A Lightweight Static-Dynamic Disentanglement Framework for Time Series Forecasting
abstract
Temporal non-stationarity, the phenomenon that time series distributions change over time, poses fundamental challenges to reliable time series forecasting. Intuitively, the complex time series can be decomposed into two factors, i.e., time-invariant and time-varying components, which indicate static and dynamic patterns, respectively. Nonetheless, existing methods often conflate the time-varying and time-invariant components, and jointly learn the combined long-term patterns and short-term fluctuations, leading to suboptimal performance facing distribution shifts. To address this issue, we initiatively propose a lightweight static-dynamic decomposition framework, TimeEmb, for time series forecasting. TimeEmb innovatively separates time series into two complementary components: (1) time-invariant component, captured by a novel global embedding module that learns persistent representations across time series, and (2) time-varying component, processed by an efficient frequency-domain filtering mechanism inspired by full-spectrum analysis in signal processing. Experiments on real-world datasets demonstrate that TimeEmb outperforms state-of-the-art baselines and requires fewer computational resources. We conduct comprehensive quantitative and qualitative analyses to verify the efficacy of static-dynamic disentanglement. This lightweight framework can also improve existing time-series forecasting methods with simple integration. To ease reproducibility, our code is available at https://github.com/showmeon/TimeEmb.
Mingyuan Xia 0005, Chunxu Zhang, Zijian Zhang 0009, Hao Miao 0001, Qidong Liu 0002, Yuanshao Zhu, Bo Yang 0002
NeurIPS5
2025 Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation
abstract
Cross-domain Sequential Recommendation (CDSR) aims to extract the preference from the user's historical interactions across various domains. Despite some progress in CDSR, two problems set the barrier for further advancements, i.e., overlap dilemma and transition complexity. The former means existing CDSR methods severely rely on users who own interactions on all domains to learn cross-domain item relationships, compromising the practicability. The latter refers to the difficulties in learning the complex transition patterns from the mixed behavior sequences. With powerful representation and reasoning abilities, Large Language Models (LLMs) are promising to address these two problems by bridging the items and capturing the user's preferences from a semantic view. Therefore, we propose an LLMs Enhanced Cross-domain Sequential Recommendation model (LLM4CDSR). To obtain the semantic item relationships, we first propose an LLM-based unified representation module to represent items. Then, a trainable adapter with contrastive regularization is designed to adapt the CDSR task. Besides, a hierarchical LLMs profiling module is designed to summarize user cross-domain preferences. Finally, these two modules are integrated into the proposed tri-thread framework to derive recommendations. We have conducted extensive experiments on three public cross-domain datasets, validating the effectiveness of LLM4CDSR. We have released the code online.
Qidong Liu 0002, Xiangyu Zhao 0001, Yejing Wang, Zijian Zhang 0009, Howard Zhong, Chong Chen 0001, Xiang Li 0113, Wei Huang 0046, Feng Tian 0002
SIGIR1
2025 Behavior Modeling Space Reconstruction for E-Commerce Search
abstract
Delivering superior search services is crucial for enhancing customer experience and driving revenue growth in e-commerce. Conventionally, search systems model user behaviors by combining user preference and query-item relevance statically, often through a fixed logical 'and' relationship. This paper reexamines existing approaches through a unified lens using causal graphs and Venn diagrams, uncovering two prevalent yet significant issues: entangled preference and relevance effects, and a collapsed modeling space. To surmount these challenges, our research introduces a novel framework, DRP, which enhances search accuracy through two components to reconstruct the behavior modeling space. Specifically, we implement preference editing to proactively remove the relevance effect from preference predictions, yielding untainted user preferences. Additionally, we employ adaptive fusion, which dynamically adjusts fusion criteria to align with the varying patterns of relevance and preference, facilitating more nuanced and tailored behavior predictions within the reconstructed modeling space. Empirical validation on two public datasets and a proprietary e-commerce search dataset underscores the superiority of our proposed methodology, demonstrating marked improvements in performance over existing approaches. The code is available at https://github.com/Applied-Machine-Learning-Lab/DRP.
Yejing Wang, Chi Zhang 0060, Xiangyu Zhao 0001, Qidong Liu 0002, Maolin Wang 0001, Xuetao Wei, Zitao Liu 0001, Wei Lin 0016
WWW4
2025 A Contrastive Pretrain Model with Prompt Tuning for Multi-center Medication Recommendation
abstract
Medication recommendation is one of the most critical health-related applications, which has attracted extensive research interest recently. Most existing works focus on a single hospital with abundant medical data. However, many small hospitals only have a few records, which hinders applying existing medication recommendation works to the real world. Thus, we seek to explore a more practical setting, i.e., multi-center medication recommendation. In this setting, most hospitals have few records, but the total number of records is large. Though small hospitals may benefit from total affluent records, it is also faced with the challenge that the data distributions between various hospitals are much different. In this work, we introduce a novel Contrastive Pretrain Model with Prompt Tuning (TEMPT) for multi-center medication recommendation, which includes two stages of pretraining and finetuning. We first design two self-supervised tasks for the pretraining stage to learn general medical knowledge. They are mask prediction and contrastive tasks, which extract the intra- and inter-relationships of input diagnosis and procedures. Furthermore, we devise a novel prompt tuning method to capture the specific information of each hospital rather than adopting the common finetuning. On the one hand, the proposed prompt tuning can better learn the heterogeneity of each hospital to fit various distributions. On the other hand, it can also relieve the catastrophic forgetting problem of finetuning. To validate the proposed model, we conduct extensive experiments on the public eICU, a multi-center medical dataset. The experimental results illustrate the effectiveness of our model. The implementation code is available to ease the reproducibility. 1
Qidong Liu 0002, Zhaopeng Qiu, Xiangyu Zhao 0001, Xian Wu 0001, Zijian Zhang 0009, Tong Xu 0001, Feng Tian 0002
ACM Trans. Inf. Syst.1
2024 Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models
abstract
Model editing aims to precisely alter the behaviors of large language models (LLMs) in relation to specific knowledge, while leaving unrelated knowledge intact. This approach has proven effective in addressing issues of hallucination and outdated information in LLMs. However, the potential of using model editing to modify knowledge in the medical field remains largely unexplored, even though resolving hallucination is a pressing need in this area. Our observations indicate that current methods face significant challenges in dealing with specialized and complex knowledge in medical domain. Therefore, we propose MedLaSA, a novel Layer-wise Scalable Adapter strategy for medical model editing. MedLaSA harnesses the strengths of both adding extra parameters and locate-then-edit methods for medical model editing. We utilize causal tracing to identify the association of knowledge in neurons across different layers, and generate a corresponding scale set from the association value for each piece of knowledge. Subsequently, we incorporate scalable adapters into the dense layers of LLMs. These adapters are assigned scaling values based on the corresponding specific knowledge, which allows for the adjustment of the adapter's weight and rank. The more similar the content, the more consistent the scale between them. This ensures precise editing of semantically identical knowledge while avoiding impact on unrelated knowledge. To evaluate the editing impact on the behaviours of LLMs, we propose two model editing studies for medical domain: (1) editing factual knowledge for medical specialization and (2) editing the explanatory ability for complex knowledge. We build two novel medical benchmarking datasets and introduce a series of challenging and comprehensive metrics. Extensive experiments on medical LLMs demonstrate the editing efficiency of MedLaSA, without affecting unrelated knowledge.
Derong Xu, Zhihong Zhu 0001, Zhenxi Lin, Qidong Liu 0002, Xian Wu 0001, Tong Xu 0001, Yuyang Ye 0002, Xiangyu Zhao 0001, Enhong Chen, Yefeng Zheng 0001
CIKM5
2024 Bi-Level User Modeling for Deep Recommenders
abstract
Deep Recommender Systems (DRS) are essential for navigating the extensive data across various platforms in today's digital landscape. Current DRS models often treat all features equally and implement complex structures to enhance the capture of feature interactions. However, they may fail to recognize crucial user patterns due to not fully utilizing user-specific features for user modeling. Moreover, prevailing user modeling techniques concentrate exclusively on either the group or individual level, overlooking the potential insights from the unaddressed one. This oversight can miss shared group preferences or learn group patterns that conflict with individual preferences. To overcome these limitations, we introduce GPRec, a novel bi-level user modeling approach that substantially improves DRS. GPRec explicitly categorizes users into groups in a learnable manner and aligns them with corresponding group embeddings. We design the dual group embedding space to offer a diverse perspective on group preferences by contrasting positive and negative patterns. On the individual level, GPRec identifies personal preferences from ID-like features and refines the obtained individual representations to be independent of group ones, thereby providing a robust complement to the group-level modeling. We also present various strategies for the flexible integration of GPRec into various DRS models. Rigorous testing of GPRec on three public datasets has demonstrated significant improvements in recommendation quality. Additional experiments further explore crucial components of GPRec, its parameter sensitivity, and the group diversity. The implementation code is readily available online to facilitate future research and practical deployment: https://github.com/Applied-Machine-Learning-Lab/GPRec.
Yejing Wang, Xiangyu Zhao 0001, Zhiren Mao, Yao Hu 0002, Zijian Zhang 0009, Xuetao Wei, Qidong Liu 0002
ICDM10
2024 ControlTraj: Controllable Trajectory Generation with Topology-Constrained Diffusion Model
abstract
Generating trajectory data is among promising solutions to addressing privacy concerns, collection costs, and proprietary restrictions usually associated with human mobility analyses. However, existing trajectory generation methods are still in their infancy due to the inherent diversity and unpredictability of human activities, grappling with issues such as fidelity, flexibility, and generalizability. To overcome these obstacles, we propose ControlTraj, a Controllable Trajectory generation framework with the topology-constrained diffusion model. Distinct from prior approaches, ControlTraj utilizes a diffusion model to generate high-fidelity trajectories while integrating the structural constraints of road network topology to guide the geographical outcomes. Specifically, we develop a novel road segment autoencoder to extract fine-grained road segment embedding. The encoded features, along with trip attributes, are subsequently merged into the proposed geographic denoising UNet architecture, named GeoUNet, to synthesize geographic trajectories from white noise. Through experimentation across three real-world data settings, ControlTraj demonstrates its ability to produce human-directed, high-fidelity trajectory generation with adaptability to unexplored geographical contexts.
Yuanshao Zhu, James Jian Qiao Yu, Xiangyu Zhao 0001, Qidong Liu 0002, Yongchao Ye, Wei Chen 0070, Zijian Zhang 0009, Xuetao Wei, Yuxuan Liang 0002
KDD4
2024 LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation
abstract
Sequential recommender systems (SRS) aim to predict users' subsequent choices based on their historical interactions and have found applications in diverse fields such as e-commerce and social media. However, in real-world systems, most users interact with only a handful of items, while the majority of items are seldom consumed. These two issues, known as the long-tail user and long-tail item challenges, often pose difficulties for existing SRS. These challenges can adversely affect user experience and seller benefits, making them crucial to address. Though a few works have addressed the challenges, they still struggle with the seesaw or noisy issues due to the intrinsic scarcity of interactions. The advancements in large language models (LLMs) present a promising solution to these problems from a semantic perspective. As one of the pioneers in this field, we propose the Large Language Models Enhancement framework for Sequential Recommendation (LLM-ESR). This framework utilizes semantic embeddings derived from LLMs to enhance SRS without adding extra inference load. To address the long-tail item challenge, we design a dual-view modeling framework that combines semantics from LLMs and collaborative signals from conventional SRS. For the long-tail user challenge, we propose a retrieval augmented self-distillation method to enhance user preference representation using more informative interactions from similar users. To verify the effectiveness and versatility of our proposed enhancement framework, we conduct extensive experiments on three real-world datasets using three popular SRS models. The results consistently show that our method surpasses existing baselines. The implementation code is available in Supplementary Material.
Qidong Liu 0002, Xian Wu 0001, Yejing Wang, Zijian Zhang 0009, Feng Tian 0002, Yefeng Zheng 0001, Xiangyu Zhao 0001
NeurIPS1
2024 When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications
abstract
The recent surge in Large Language Models (LLMs) has garnered significant attention across numerous fields. Fine-tuning is often required to fit general LLMs for a specific domain, like the web-based healthcare system. However, two problems arise during fine-tuning LLMs for medical applications. One is the task variety problem, which involves distinct tasks in real-world medical scenarios. The variety often leads to sub-optimal fine-tuning for data imbalance and seesaw problems. Besides, the large amount of parameters in LLMs leads to huge time and computation consumption by fine-tuning. To address these two problems, we propose a novel parameter efficient fine-tuning framework for multi-task medical applications, dubbed as MOELoRA. The designed framework aims to absorb both the benefits of mixture-of-expert (MOE) for multi-task learning and low-rank adaptation (LoRA) for parameter efficient fine-tuning. For unifying MOE and LoRA, we devise multiple experts as the trainable parameters, where each expert consists of a pair of low-rank matrices to retain the small size of trainable parameters. Then, a task-motivated gate function for all MOELoRA layers is proposed, which can control the contributions of each expert and produce distinct parameters for various tasks. We conduct experiments on a multi-task medical dataset, indicating MOELoRA outperforms the existing parameter efficient fine-tuning methods. The code is available online.
Qidong Liu 0002, Xian Wu 0001, Xiangyu Zhao 0001, Yuanshao Zhu, Derong Xu, Feng Tian 0002, Yefeng Zheng 0001
SIGIR1
2024 M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework
abstract
Multi-domain recommendation and multi-task recommendation have demonstrated their effectiveness in leveraging common information from different domains and objectives for comprehensive user modeling. Nonetheless, the practical recommendation usually faces multiple domains and tasks simultaneously, which cannot be well-addressed by current methods. To this end, we introduce M3oE, an adaptive Multi-domain Multi-task Mixture-of-Experts recommendation framework. M3oE integrates multi-domain information, maps knowledge across domains and tasks, and optimizes multiple objectives. We leverage three mixture-of-experts modules to learn common, domain-aspect, and task-aspect user preferences respectively to address the complex dependencies among multiple domains and tasks in a disentangled manner. Additionally, we design a two-level fusion mechanism for precise control over feature extraction and fusion across diverse domains and tasks. The framework's adaptability is further enhanced by applying AutoML technique, which allows dynamic structure optimization. To the best of the authors' knowledge, our M3oE is the first effort to solve multi-domain multi-task recommendation self-adaptively. Extensive experiments on two benchmark datasets against diverse baselines demonstrate M3oE's superior performance. The implementation code is available to ensure reproducibility.
Zijian Zhang 0009, Shuchang Liu 0001, Qingpeng Cai 0001, Xiangyu Zhao 0001, Chunxu Zhang, Ziru Liu, Qidong Liu 0002, Lantao Hu, Peng Jiang 0002, Kun Gai
SIGIR8
2023 Diffusion Augmentation for Sequential Recommendation
abstract
Sequential recommendation (SRS) has become the technical foundation in many applications recently, which aims to recommend the next item based on the user's historical interactions. However, sequential recommendation often faces the problem of data sparsity, which widely exists in recommender systems. Besides, most users only interact with a few items, but existing SRS models often underperform these users. Such a problem, named the long-tail user problem, is still to be resolved. Data augmentation is a distinct way to alleviate these two problems, but they often need fabricated training strategies or are hindered by poor-quality generated interactions. To address these problems, we propose a Diffusion Augmentation for Sequential Recommendation (DiffuASR) for a higher quality generation. The augmented dataset by DiffuASR can be used to train the sequential recommendation models directly, free from complex training procedures. To make the best of the generation ability of the diffusion model, we first propose a diffusion-based pseudo sequence generation framework to fill the gap between image and sequence generation. Then, a sequential U-Net is designed to adapt the diffusion noise prediction model U-Net to the discrete sequence generation task. At last, we develop two guide strategies to assimilate the preference between generated and origin sequences. To validate the proposed DiffuASR, we conduct extensive experiments on three real-world datasets with three sequential recommendation models. The experimental results illustrate the effectiveness of DiffuASR. As far as we know, DiffuASR is one pioneer that introduce the diffusion model to the recommendation.The implementation code is available online.
Qidong Liu 0002, Fan Yan, Xiangyu Zhao 0001, Zhaocheng Du, Huifeng Guo, Ruiming Tang, Feng Tian 0002
CIKM1
2023 PromptST: Prompt-Enhanced Spatio-Temporal Multi-Attribute Prediction
abstract
In the era of information explosion, spatio-temporal data mining serves as a critical part of urban management. Considering the various fields demanding attention, e.g., traffic state, human activity, and social event, predicting multiple spatio-temporal attributes simultaneously can alleviate regulatory pressure and foster smart city construction. However, current research can not handle the spatio-temporal multi-attribute prediction well due to the complex relationships between diverse attributes. The key challenge lies in how to address the common spatio-temporal patterns while tackling their distinctions. In this paper, we propose an effective solution for spatio-temporal multi-attribute prediction, PromptST. We devise a spatio-temporal transformer and a parameter-sharing training scheme to address the common knowledge among different spatio-temporal attributes. Then, we elaborate a spatio-temporal prompt tuning strategy to fit the specific attributes in a lightweight manner. Through the pretrain and prompt tuning phases, our PromptST is able to enhance the specific spatio-temoral characteristic capture by prompting the backbone model to fit the specific target attribute while maintaining the learned common knowledge. Extensive experiments on real-world datasets verify that our PromptST attains state-of-the-art performance. Furthermore, we also prove PromptST owns good transferability on unseen spatio-temporal attributes, which brings promising application potential in urban computing. The implementation code is available to ease reproducibility.
Zijian Zhang 0009, Xiangyu Zhao 0001, Qidong Liu 0002, Chunxu Zhang, Qian Ma 0012, Yiqi Wang 0001, Zitao Liu 0001
CIKM3
2023 Trustworthy Recommender Systems: Foundations and Frontiers
abstract
Recommender systems aim to provide personalized suggestions to users, helping them make effective decisions. However, recent evidence has revealed the untrustworthy aspects of advanced recommender systems, leading to harmful effects in safety-critical areas like finance and healthcare. This tutorial will offer a comprehensive overview of achieving trustworthy recommender systems. It will cover six important aspects: Safety & Robustness, Non-discrimination & Fairness, Explainability, Privacy, Environmental Well-being, and Accountability & Auditability. Each aspect will be defined and categorized, followed by a discussion of the latest research progress and notable works. Additionally, potential interactions among these aspects and future research directions for trustworthy recommender systems will be explored.
Wenqi Fan, Xiangyu Zhao 0001, Lin Wang 0040, Xiao Chen 0016, Jingtong Gao, Qidong Liu 0002, Shijie Wang 0002
KDD6
2023 STRec: Sparse Transformer for Sequential Recommendations
abstract
With the rapid evolution of transformer architectures, researchers are exploring their application in sequential recommender systems (SRSs) and presenting promising performance on SRS tasks compared with former SRS models. However, most existing transformer-based SRS frameworks retain the vanilla attention mechanism, which calculates the attention scores between all item-item pairs. With this setting, redundant item interactions can harm the model performance and consume much computation time and memory. In this paper, we identify the sparse attention phenomenon in transformer-based SRS models and propose Sparse Transformer for sequential Recommendation tasks (STRec) to achieve the efficient computation and improved performance. Specifically, we replace self-attention with cross-attention, making the model concentrate on the most relevant item interactions. To determine these necessary interactions, we design a novel sampling strategy to detect relevant items based on temporal information. Extensive experimental results validate the effectiveness of STRec, which achieves the state-of-the-art accuracy while reducing 54% inference time and 70% memory cost. We also provide massive extended experiments to further investigate the property of our framework.
Chengxi Li 0013, Yejing Wang, Qidong Liu 0002, Xiangyu Zhao 0001, Yiqi Wang 0001, Lixin Zou, Wenqi Fan, Qing Li 0001
RecSys3
2023 PLATE: A Prompt-Enhanced Paradigm for Multi-Scenario Recommendations
abstract
With the explosive growth of commercial applications of recommender systems, multi-scenario recommendation (MSR) has attracted considerable attention, which utilizes data from multiple domains to improve their recommendation performance simultaneously. However, training a unified deep recommender system (DRS) may not explicitly comprehend the commonality and difference among domains, whereas training an individual model for each domain neglects the global information and incurs high computation costs. Likewise, fine-tuning on each domain is inefficient, and recent advances that apply the prompt tuning technique to improve fine-tuning efficiency rely solely on large-sized transformers. In this work, we propose a novel prompt-enhanced paradigm for multi-scenario recommendation. Specifically, a unified DRS backbone model is first pre-trained using data from all the domains in order to capture the commonality across domains. Then, we conduct prompt tuning with two novel prompt modules, capturing the distinctions among various domains and users. Our experiments on Douban, Amazon, and Ali-CCP datasets demonstrate the effectiveness of the proposed paradigm with two noticeable strengths: (i) its great compatibility with various DRS backbone models, and (ii) its high computation and storage efficiency with only 6% trainable parameters in prompt tuning phase. The implementation code is available for easy reproduction.
Yuhao Wang 0006, Xiangyu Zhao 0001, Bo Chen 0023, Qidong Liu 0002, Huifeng Guo, Huanshuo Liu, Yichao Wang 0002, Rui Zhang 0003, Ruiming Tang
SIGIR4
2023 Disentangling interest and conformity for eliminating popularity bias in session-based recommendation
Qidong Liu 0002, Feng Tian 0002, Qianying Wang 0002
Knowl. Inf. Syst.1
2020 A New Representation Learning Method for Individual Treatment Effect Estimation: Split Covariate Representation Network
abstract
Individual treatment effect (ITE) estimation is widely used in many essential fields, such as medical and education. But two problems, unknown counterfactual outcome and confounder, are the barriers for making a good ITE estimation. Although some representation learning methods based on potential outcome framework have been proposed to solve the problems, we find that most of previous works assume all features (also named covariate) of a unit are confounders. However, this assumption is not easy to become true, because instrument variables, adjustment variables and irrelevant variables can also be included in features. Therefore, this paper proposes a simple method to split covariates, and then a network, Split Covariate Representation Network (SCRNet), is mentioned, which is used to estimate ITE by different kinds of variables. Experiment results show that our method outperforms other state-of-arts methods on IHDP, a semi-synthetic dataset, and Jobs, a real-world dataset.
Qidong Liu 0002, Feng Tian 0002, Weihua Ji
ACML1