VLDB 2026 Research / reviewers in the wild / expert
Pengyue Jia
dblp:313/9275
· DBLP profile ↗
18ranked-venue papers in the field
4as first author
18since 2021 · last 2026
0000-0003-4712-3676ORCID · verified
Domains — venue-derived; a paper can count in several
Information Retrieval & Web Search · 13 (3 first)Data Mining & Knowledge Discovery · 5 (1 first)
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Exploring Recommender System Evaluation: A Multi-Modal LLM Agent Framework for A/B TestingabstractdiningIn recommender systems, online A/B testing is a crucial method for evaluating the performance of different models. However, conducting online A/B testing often presents significant challenges, including substantial economic costs, user experience degradation, and considerable time requirements. With the Large Language Models' powerful capacity, LLM-based agent shows great potential to replace traditional online A/B testing. Nonetheless, current agents fail to simulate the perception process and interaction patterns, due to the lack of real environments and visual perception capability. To address these challenges, we introduce a multi-modal user agent for A/B testing (A/B Agent). Specifically, we construct a recommendation sandbox environment for A/B testing, enabling multimodal and multi-page interactions that align with real user behavior on online platforms. The designed agent leverages multimodal information perception, fine-grained user preferences, and integrates profiles, action memory retrieval, and a fatigue system to simulate complex human decision-making. We validated the potential of the agent as an alternative to traditional A/B testing from three perspectives: model, data, and features. Furthermore, we found that the data generated by A/B Agent can effectively enhance the capabilities of recommendation models. Our code is publicly available at https://github.com/Applied-Machine-Learning-Lab/ABAgent. © 2026 Owner/Author. Wenlin Zhang 0001, Xiangyang Li 0004, Qiyuan Ge, Kuicai Dong, Pengyue Jia, Xiaopeng Li 0014, Zijian Zhang 0009, Maolin Wang 0001, Yichao Wang 0002, Huifeng Guo, Ruiming Tang, Xiangyu Zhao 0001 |
KDD (1) | 5 |
| 2026 | Bridging Personalization and AI: From RAG to AgentabstractPersonalization is becoming a core capability of modern AI systems. It enables systems to adapt their responses and behaviors according to individual users' preferences, contexts, and goals. Recent research has focused on Retrieval-Augmented Generation (RAG) and its development toward more advanced agent-based frameworks to improve user satisfaction in personalized settings. In this tutorial, we provide a systematic overview of how personalization can be incorporated into the three main stages of RAG: pre-retrieval, retrieval, and generation. We then extend the discussion to personalized LLM-based agents, which build on RAG by adding agent capabilities such as user understanding, personalized planning and execution, and adaptive response generation. For both RAG-based and agent-based approaches, we present clear definitions, review recent research, and summarize commonly used datasets and evaluation metrics. We also discuss key challenges, current limitations, and potential future research directions. An updated list of related papers and resources is available at our GitHub repository. https://github.com/Applied-Machine-Learning-Lab/Awesome-Personalized-RAG-Agent. Further updates for this tutorial will be uploaded on the homepage. https://applied-machine-learning-lab.github.io/SIGIR2026_PRAG_Tutorial. Pengyue Jia, Xiaopeng Li 0014, Derong Xu, Yi Wen 0001, Yingyi Zhang 0001, Wenlin Zhang 0001, Yichao Wang 0002, Yong Liu 0020, Xiangyu Zhao 0001 |
SIGIR | 1 |
| 2026 | Personalized Deep Research: A User-Centric Framework, Dataset, and Hybrid Evaluation for Knowledge DiscoveryabstractDeep Research agents driven by LLMs have automated the scholarly discovery pipeline, from planning and query formulation to iterative web exploration. Yet they remain constrained by a static, ''one-size-fits-all'' retrieval paradigm. Current systems fail to adaptively adjust the depth and breadth of exploration based on the user's existing expertise or latent interests, frequently resulting in reports that are either redundant for experts or overly dense for novices. To address this, we introduce Personalized Deep Research (PDR), a framework that integrates dynamic user context into the core retrieval-reasoning loop. Rather than treating personalization as a post-hoc formatting step, PDR unifies user profile modeling with iterative query development, dual-stage (private/public) retrieval, and context-aware synthesis. This allows the system to autonomously align research sub-goals with user intent and optimize the stopping criteria for evidence collection. To facilitate benchmarking, we release the PDR Dataset, covering four realistic user tasks, and propose a hybrid evaluation framework combining lexical metrics with LLM-based judgments to assess factual accuracy and personalization alignment. Experimental results against commercial baselines demonstrate that PDR significantly improves retrieval utility and report relevance, effectively bridging the gap between generic information retrieval and personalized knowledge acquisition. The resource is available to the public at~ https://github.com/Applied-Machine-Learning-Lab/SIGIR2026_PDR. Xiaopeng Li 0014, Wenlin Zhang 0001, Yingyi Zhang 0001, Pengyue Jia, Yejing Wang, Yichao Wang 0002, Yong Liu 0020, Huifeng Guo, Xiangyu Zhao 0001 |
SIGIR | 4 |
| 2026 | LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase TrainingabstractCross-domain Sequential Recommendation (CDSR) has been proposed to enrich user-item interactions by incorporating information from various domains. Despite current progress, the domain imbalance issue and domain transition issue hinder further development of CDSR. The former presents a phenomenon where interactions in one domain dominate the entire behavior, leading to difficulty in capturing domain-specific features in the other domain. The latter points to the difficulty in capturing users' cross-domain preferences within the mixed interaction sequence, resulting in poor next-item prediction performance for specific domains. With world knowledge and powerful reasoning abilities, Large Language Models (LLMs) partially alleviate the above issues by functioning as both a generator and an encoder. However, current LLMs-enhanced CDSR methods are still under exploration, which fail to recognize the irrelevant noise and rough profiling problems. Thus, to address the aforementioned challenges, we propose an LLMs Enhanced Cross-domain Sequential Recommendation with Dual-phase Training (LLM-EDT). To address the domain imbalance issue while minimizing irrelevant noise, we propose the transferable item augmenter to adaptively generate possible cross-domain behaviors for users. Then, to alleviate the domain transition issue, we introduce a dual-phase training strategy to empower the domain-specific thread with a domain-shared background. As for the rough profiling problem, we devise a domain-aware profiling module to summarize the user's preference in each domain and adaptively aggregate them to generate comprehensive user profiles. The experiments on three public datasets validate the effectiveness of our proposed LLM-EDT. To ease reproducibility, we have released the detailed code online {https://github.com/Applied-Machine-Learning-Lab/SIGIR26_LLM-EDT}. © 2026 Copyright held by the owner/author(s). Ziwei Liu 0010, Qidong Liu 0002, Yejing Wang, Pengyue Jia, Tong Xu 0001, Wei Huang 0046, Chong Chen 0001, Xiangyu Zhao 0001 |
SIGIR | 5 |
| 2026 | ProEchoMem: Enhancing Long Video Understanding via Multi-Trace Probe-Echo MemoryabstractLarge vision-language models (LVLMs) have shown significant progress in video understanding, but they struggle to scale to long videos due to limited context windows. Existing methods reduce input dimensionality via frame sampling and feature compression, yet discard details and incur high computational cost for post-training. In contrast, retrieval-augmented generation (RAG) that indexes long videos for query retrieval and memory-based methods that maintain evolving long-term stores, offer a lighter and deployment-friendly solution. Nevertheless, they rely on shallow retrieval that selects only top-ranked segments and fails to integrate information across multiple relevant video episodes. Inspired by Multiple-Trace Theory in cognitive psychology, we revisit long video understanding from a probe-echo perspective, in which human episodic memories are activated and integrated in parallel. Building on this insight, we propose ProEchoMem, a cognitive-inspired framework that simulates the probe-echo mechanism: (1) Incremental Episodic Memory Construction builds structured knowledge graphs from video streams; (2) Probe-Driven Memory Activation generates probe signals from user queries to activate all stored traces simultaneously; (3) Memory Echo Synthesis integrates activated traces into a coherent and structured memory echo. Experiments on LongerVideos, LVBench, and cross-domain settings demonstrate the effectiveness of ProEchoMem, with multi-trace probing achieving up to 14.2% higher relevance and ablation studies validating the contribution of each module. The code is available at https://github.com/Applied-Machine-Learning-Lab/SIGIR26_ProEchoMem Derong Xu, Yanxin Chen, Pengyue Jia, Chao Zhang 0096, Maolin Wang 0001, Yiqi Wang 0001, Jipeng Qiang, Xuetao Wei, Hongzhi Yin, Tong Xu 0001, Xiangyu Zhao 0001 |
SIGIR | 4 |
| 2026 | BlossomRec: Block-level Fused Sparse Attention Mechanism for Sequential RecommendationsabstractTransformer structures have been widely used in sequential recommender systems (SRS). However, as user interaction histories increase, computational time and memory requirements also grow. This is mainly caused by the standard attention mechanism. Although there exist many methods employing efficient attention and SSM-based models, these approaches struggle to effectively model long sequences and may exhibit unstable performance on short sequences. To address these challenges, we design a sparse attention mechanism, BlossomRec, which models both long-term and short-term user interests through attention computation to achieve stable performance across sequences of varying lengths. Specifically, we categorize user interests in recommendation systems into long-term and short-term interests, and compute them using two distinct sparse attention patterns, with the results combined through a learnable gated output. Theoretically, it significantly reduces the number of interactions participating in attention computation. Extensive experiments on four public datasets demonstrate that BlossomRec, when integrated with state-of-the-art Transformer-based models, achieves comparable or even superior performance while significantly reducing memory usage, providing strong evidence of BlossomRec's efficiency and effectiveness. The code is available at https://github.com/Applied-Machine-Learning-Lab/WWW2026_BlossomRec. Mengyang Ma, Xiaopeng Li 0014, Zhaocheng Du, Jingtong Gao, Pengyue Jia, Yuyang Ye 0002, Yiqi Wang 0001, Yunpeng Weng, Weihong Luo, Xiao Han 0004, Xiangyu Zhao 0001 |
WWW | 6 |
| 2026 | To Search or Not to Search: Aligning the Decision Boundary of Deep Search Agents via Causal InterventionabstractDeep search agents, which autonomously iterate through multi-turn web-based reasoning, represent a promising paradigm for complex information-seeking tasks. However, current agents suffer from critical inefficiency: they conduct excessive searches as they cannot accurately judge when to stop searching and start answering. This stems from outcome-centric training that prioritize final results over the search process itself. We identify the root cause as misaligned decision boundaries, the threshold determining when accumulated information suffices to answer. This causes over-search (redundant searching despite sufficient knowledge) and under-search (premature termination yielding incorrect answers). To address these errors, we propose a comprehensive framework comprising two key components. First, we introduce causal intervention-based diagnosis that identifies boundary errors by comparing factual and counterfactual trajectories at each decision point. Second, we develop Decision Boundary Alignment for Deep Search agents (DAS), which constructs preference datasets from causal feedback and aligns policies via preference optimization. Experiments on public datasets demonstrate that decision boundary errors are pervasive across state-of-the-art agents. Our DAS method effectively calibrates these boundaries, mitigating both over-search and under-search to achieve substantial gains in accuracy and efficiency. Our code and data are publicly available at: https://github.com/Applied-Machine-Learning-Lab/WWW2026-DAS. © 2026 Owner/Author. Wenlin Zhang 0001, Kuicai Dong, Junyi Li 0001, Yingyi Zhang 0001, Xiaopeng Li 0014, Pengyue Jia, Yi Wen 0001, Derong Xu, Maolin Wang 0001, Yichao Wang 0002, Yong Liu 0020, Xiangyu Zhao 0001 |
WWW | 6 |
| 2026 | A Survey of Personalization: From RAG to AgentabstractPersonalization has become an essential capability in modern AI systems, enabling customized interactions that align with individual user preferences, contexts, and goals. Recent research has increasingly concentrated on Retrieval-Augmented Generation (RAG) frameworks and their evolution into more advanced agent-based architectures within personalized settings to enhance user satisfaction. Building on this foundation, this survey systematically examines personalization across the three core stages of RAG: pre-retrieval, retrieval, and generation. Beyond RAG, we further extend its capabilities into the realm of Personalized LLM-based Agents, which enhance traditional RAG systems with agentic functionalities, including user understanding, personalized planning and execution, and dynamic generation. For both personalization in RAG and agent-based personalization, we provide formal definitions, conduct a comprehensive review of recent literature, and summarize key datasets and evaluation metrics. Additionally, we discuss fundamental challenges, limitations, and promising research directions in this evolving field. Relevant papers and resources are continuously updated at the Github Repo ( https://github.com/Applied-Machine-Learning-Lab/Awesome-Personalized-RAG-Agent ). Xiaopeng Li 0014, Pengyue Jia, Derong Xu, Yi Wen 0001, Yingyi Zhang 0001, Wenlin Zhang 0001, Yichao Wang 0002, Zhaocheng Du, Xiangyang Li 0004, Yong Liu 0020, Huifeng Guo, Ruiming Tang, Xiangyu Zhao 0001 |
ACM Trans. Inf. Syst. | 2 |
| 2025 | Scenario-Wise Rec: A Multi-Scenario Recommendation BenchmarkabstractMulti-Scenario Recommendation (MSR) tasks, referring to building a unified model to enhance performance across all recommendation scenarios, have recently gained considerable attention. However, current research in MSR faces two significant challenges that hinder the field's development: the absence of uniform procedures for multi-scenario dataset processing, thus hindering fair comparisons, and most models being closed-source, which complicates comparisons with current SOTA models. Consequently, we introduce our benchmark, Scenario-Wise Rec, which comprises six public datasets and twelve baseline models, along with a training and evaluation pipeline. We further validate Scenario-Wise Rec on an industrial advertising dataset, underscoring its robustness. We hope the benchmark will give researchers clear insights into prior work, enabling them to develop novel models and thereby fostering a collaborative research ecosystem in MSR. Our source code is publicly available (https://github.com/Applied-Machine-Learning-Lab/Scenario-Wise-Rec). Xiaopeng Li 0014, Jingtong Gao, Pengyue Jia, Xiangyu Zhao 0001, Yichao Wang 0002, Yejing Wang, Yuhao Wang 0006, Huifeng Guo, Ruiming Tang |
CIKM | 3 |
| 2025 | SELF: Surrogate-light Feature Selection with Large Language Models in Deep Recommender SystemsabstractFeature selection is crucial in recommender systems for improving model efficiency and predictive performance. Conventional approaches typically employ surrogate models-such as decision trees or neural networks-to estimate feature importance. However, their effectiveness is inherently constrained, as these models may struggle under suboptimal training conditions, including feature collinearity, high-dimensional sparsity, and insufficient data. In this paper, we propose SELF, a SurrogatE-Light Feature selection method for deep recommender systems. SELF integrates semantic reasoning from Large Language Models (LLMs) with task-specific learning from surrogate models, enabling an automated and lightweight feature selection process. Specifically, LLMs first produce a semantically informed ranking of feature importance, which is subsequently refined by a surrogate model, effectively integrating general world knowledge with task-specific learning. Comprehensive experiments on three public datasets from real-world recommender platforms validate the effectiveness of SELF. To facilitate reproducibility, our code is publicly available. Pengyue Jia, Zhaocheng Du, Yichao Wang 0002, Xiangyu Zhao 0001, Xiaopeng Li 0014, Yuhao Wang 0006, Qidong Liu 0002, Huifeng Guo, Ruiming Tang |
CIKM | 1 |
| 2025 | Prompt Tuning as User Inherent Profile Inference MachineabstractLarge Language Models (LLMs) have exhibited significant promise in recommender systems by empowering user profiles with their extensive world knowledge and superior reasoning capabilities. However, LLMs face challenges like unstable instruction compliance, modality gaps, and high inference latency, leading to textual noise and limiting their effectiveness in recommender systems. To address these challenges, we propose UserIP-Tuning, which uses prompt-tuning to infer user profiles. It integrates the causal relationship between user profiles and behavior sequences into LLMs' prompts. It employs Expectation Maximization (EM) to infer the embedded latent profile, minimizing textual noise by fixing the prompt template. Furthermore, a profile quantization codebook bridges the modality gap by categorizing profile embeddings into collaborative IDs pre-stored for online deployment. This improves time efficiency and reduces memory usage. Experiments show that UserIP-Tuning outperforms state-of-the-art recommendation algorithms. An industry application confirms its effectiveness, robustness, and transferability. The presented solution has been deployed in Huawei AppGallery's Explore page since May 2025, serving 2 million daily active users, delivering significant improvements in real-world recommendation scenarios. The code is publicly available for replication at https://github.com/Applied-Machine-Learning-Lab/UserIP-Tuning. Yusheng Lu, Zhaocheng Du, Xiangyang Li 0004, Pengyue Jia, Yejing Wang, Weiwen Liu, Yichao Wang 0002, Huifeng Guo, Ruiming Tang, Zhenhua Dong, Yongrui Duan, Xiangyu Zhao 0001 |
CIKM | 4 |
| 2025 | Measure Domain's Gap: A Similar Domain Selection Principle for Multi-Domain RecommendationabstractMulti-Domain Recommendation (MDR) achieves the desirable recommendation performance by effectively utilizing the transfer information across different domains. Despite the great success, most existing MDR methods adopt a single structure to transfer complex domain-shared knowledge. However, the beneficial transferring information should vary across different domains. When there is knowledge conflict between domains or a domain is of poor quality, unselectively leveraging information from all domains will lead to a serious Negative Transfer Problem (NTP). Therefore, how to effectively model the complex transfer relationships between domains to avoid NTP is still a direction worth exploring. To address these issues, we propose a simple and dynamic Similar Domain Selection Principle (SDSP) for multi-domain recommendation in this paper. SDSP presents the initial exploration of selecting suitable domain knowledge for each domain to alleviate NTP. Specifically, we propose a novel prototype-based domain distance measure to effectively model the complexity relationship between domains. Thereafter, the proposed SDSP can dynamically find similar domains for each domain based on the supervised signals of the domain metrics and the unsupervised distance measure from the learned domain prototype. We emphasize that SDSP is a lightweight method that can be incorporated with existing MDR methods for better performance while not introducing excessive time overheads. To the best of our knowledge, it is the first solution that can explicitly measure domain-level gaps and dynamically select appropriate domains in the MDR field. Extensive experiments on three datasets demonstrate the effectiveness of our proposed method. Yi Wen 0001, Yue Liu 0008, Derong Xu, Huishi Luo, Pengyue Jia, Yiqing Wu, Siwei Wang 0001, Ke Liang 0006, Maolin Wang 0001, Yiqi Wang 0001, Fuzhen Zhuang, Xiangyu Zhao 0001 |
KDD (2) | 5 |
| 2025 | Large Language Model Enhanced Recommender Systems: Methods, Applications and TrendsabstractDue to exceptional reasoning and understanding abilities, the Large Language Model (LLM) has revolutionized the pattern of many fields, including recommender systems (RS). There has been a handful of research that focuses on empowering the RS by LLM. Recently, considering the latency and memory costs in real-world applications, LLM-Enhanced RS (LLMERS) is highlighted. This direction pushes the LLM into the online system with a large step by eliminating the utilization of LLM during inference. As a cutting-edge field, there is a clear need for a comprehensive survey to summarize this direction. In this survey, we systematically investigate the most up-to-date works of LLM-enhanced RS to boost this direction. Based on the component of an RS model that the LLM aims to augment, the basic taxonomy includes Knowledge Enhancement, Interaction Enhancement and Model Enhancement. Additionally, we identify several promising research directions. To facilitate access to the surveyed papers, we release a repository. Qidong Liu 0002, Xiangyu Zhao 0001, Yuhao Wang 0006, Yejing Wang, Zijian Zhang 0009, Xiang Li 0113, Maolin Wang 0001, Pengyue Jia, Chong Chen 0001, Wei Huang 0046, Feng Tian 0002 |
KDD (2) | 9 |
| 2025 | LSRP: A Leader-Subordinate Retrieval Framework for Privacy-Preserving Cloud-Device CollaborationabstractCloud-device collaboration leverages on-cloud Large Language Models (LLMs) for handling public user queries and on-device Small Language Models (SLMs) for processing private user data, collectively forming a powerful and privacy-preserving solution.However, existing approaches often fail to fully leverage the scalable problem-solving capabilities of on-cloud LLMs while underutilizing the advantage of on-device SLMs in accessing and processing personalized data.This leads to two interconnected issues: 1) Limited utilization of the problem-solving capabilities of on-cloud LLMs, which fail to align with personalized user-task needs, and 2) Inadequate integration of user data into on-device SLM responses, resulting in mismatches in contextual user information.In this paper, we propose a Leader-Subordinate Retrieval framework for Privacy-preserving cloud-device collaboration (LSRP), a novel solution that bridges these gaps by: 1) enhancing on-cloud * Contributed equally to this work. Yingyi Zhang 0001, Pengyue Jia, Xianneng Li, Derong Xu, Maolin Wang 0001, Yichao Wang 0002, Zhaocheng Du, Huifeng Guo, Yong Liu 0020, Ruiming Tang, Xiangyu Zhao 0001 |
KDD (2) | 2 |
| 2025 | AgentIR: 2nd Workshop on Agent-based Information RetrievalabstractInformation retrieval (IR) systems are essential in modern society, aiding users to efficiently locate relevant information through query expansion, document retrieval, ranking, and re-ranking. User feedback from ranked outputs forms a dynamic interaction loop with IR systems, which can be modeled as either one-time or sequential decision-making problems. Over the past decade, deep reinforcement learning (DRL) has emerged as a promising approach to decision-making, leveraging the high model capacity of deep learning for complex tasks. While significant research has explored the application of DRL to IR tasks, several fundamental challenges remain underexplored, including the underlying information theory in DRL settings, the limitations of reinforcement learning methods for industrial IR applications, and the simulation of DRL-based IR systems. Concurrently, the advent of large language models (LLMs) has introduced new opportunities for optimizing and simulating IR systems. Building on the success of the Agent-based IR Workshop at SIGIR 2024, we propose hosting the second Agent-based IR Workshop at SIGIR 2025. This workshop will continue to provide a platform for researchers and practitioners from academia and industry to present cutting-edge advances in DRL-based and LLM-based IR systems from an agent-based perspective. By building on the foundation laid in the first workshop, the 2025 edition aims to delve deeper into emerging research challenges, foster collaborations, and explore innovative applications. Through engaging discussions and insightful presentations, the workshop seeks to further expand the boundaries of IR research and solidify its role as a premier venue for advancing agent-based IR systems. Pengyue Jia, Qingpeng Cai 0001, Xiangyu Zhao 0001, Ling Pan, Xin Xin 0003, Jin Huang 0010, Weinan Zhang 0001, Li Zhao 0007, Dawei Yin 0001, Grace Hui Yang |
SIGIR | 1 |
| 2025 | Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language ModelsabstractSequential Recommendation (SR) aims to leverage the sequential patterns in users' historical interactions to accurately track their preferences. However, the primary reliance of existing SR methods on collaborative data results in challenges such as the cold-start problem and sub-optimal performance. Concurrently, despite the proven effectiveness of large language models (LLMs), their integration into commercial recommender systems is impeded by issues such as high inference latency, incomplete capture of all distribution statistics, and catastrophic forgetting. To address these issues, we introduce a novel Pre-train, Align, and Disentangle (PAD) framework to enhance SR models with LLMs. In particular, we initially pre-train both the SR and LLM models to obtain collaborative and textual embeddings. Subsequently, we propose a characteristic recommendation-anchored alignment loss using multi-kernel maximum mean discrepancy with Gaussian kernels. Lastly, a triple-experts architecture, comprising aligned and modality-specific experts with disentangled embeddings, is fine-tuned in a frequency-aware manner. Experimental results on three public datasets validate the efficacy of PAD, indicating substantial enhancements and compatibility with various SR backbone models, particularly for cold items. The code and datasets are accessible for reproduction: https://github.com/Applied-Machine-Learning-Lab/PAD. Yuhao Wang 0006, Junwei Pan, Pengyue Jia, Maolin Wang 0001, Zhixiang Feng, Jie Jiang 0015, Xiangyu Zhao 0001 |
SIGIR | 3 |
| 2025 | Agent4Ranking: Semantic Robust Ranking via Personalized Query Rewriting Using Multi-Agent LLMsabstractSearch engines are crucial as they provide an efficient and easy way to access vast amounts of information on the Internet for diverse information needs. User queries, even with a specific need, can differ significantly. Prior research has explored the resilience of ranking models against typical query variations like paraphrasing, misspellings, and order changes. Yet, these works overlook how diverse demographics uniquely formulate identical queries. For instance, older individuals tend to construct queries more naturally and in varied order compared to other groups. This demographic diversity necessitates enhancing the adaptability of ranking models to diverse query formulations. To this end, in this article, we propose a framework that integrates a novel rewriting pipeline that rewrites queries from various demographic perspectives and a novel framework to enhance ranking robustness. To be specific, we use Chain of Thought (CoT) technology to utilize Large Language Models (LLMs) as agents to emulate various demographic profiles, then use them for efficient query rewriting, and we innovate a Robust Multi-gate Mixture-of-Experts (R-MMoE) architecture coupled with a hybrid loss function, collectively strengthening the ranking models’ robustness. Our extensive experiments on both public and industrial datasets assesses the efficacy of our query rewriting approach and the enhanced accuracy and robustness of the ranking model. The findings highlight the sophistication and effectiveness of our proposed model. We release our code implementation publicly ( https://github.com/Applied-Machine-Learning-Lab/ROBR ). Xiaopeng Li 0014, Lixin Su, Pengyue Jia, Suqi Cheng, Junfeng Wang 0009, Dawei Yin 0001, Xiangyu Zhao 0001 |
ACM Trans. Inf. Syst. | 3 |
| 2024 | ERASE: Benchmarking Feature Selection Methods for Deep Recommender SystemsabstractDeep Recommender Systems (DRS) are increasingly dependent on a large number of feature fields for more precise recommendations. Effective feature selection methods are consequently becoming critical for further enhancing the accuracy and optimizing storage efficiencies to align with the deployment demands. This research area, particularly in the context of DRS, is nascent and faces three core challenges. Firstly, variant experimental setups across research papers often yield unfair comparisons, obscuring practical insights. Secondly, the existing literature's lack of detailed analysis on selection attributes, based on large-scale datasets and a thorough comparison among selection techniques and DRS backbones, restricts the generalizability of findings and impedes deployment on DRS. Lastly, research often focuses on comparing the peak performance achievable by feature selection methods. This approach is typically computationally infeasible for identifying the optimal hyperparameters and overlooks evaluating the robustness and stability of these methods. To bridge these gaps, this paper presents ERASE, a comprehensive bEnchmaRk for feAture SElection for DRS. ERASE comprises a thorough evaluation of eleven feature selection methods, covering both traditional and deep learning approaches, across four public datasets, private industrial datasets, and a real-world commercial platform, achieving significant enhancement. Our code is available online for ease of reproduction. Pengyue Jia, Yejing Wang, Zhaocheng Du, Xiangyu Zhao 0001, Yichao Wang 0002, Bo Chen 0023, Huifeng Guo, Ruiming Tang |
KDD | 1 |