Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Pengyue Jia

dblp:313/9275 · DBLP profile ↗
in reviewer pool ← Back
35ranked-venue papers
10as first author
35since 2021 · last 2026
0000-0003-4712-3676ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 23 · 7 first-author · 23 since 2021Databases, data management, data science and information retrieval · 18 · 4 first-author · 18 since 2021Graphics, computer vision, multimedia, augmented reality and games · 7 · 1 first-author · 7 since 2021Applied, interdisciplinary, general and emerging computing · 3 · 1 first-author · 3 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Databases, data mining, and information retrieval
20 papers
Information retrieval · 48% Recommender systems · 44% Data mining · 5%
Artificial intelligence
17 papers
Language models and text generation · 48% Efficient and distributed learning · 9% Reinforcement learning · 8%

Topics — the 30 heaviest of 68, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Information retrieval
retrieval-augmented generation
5.162026
A Survey of Personalization: From RAG to Agent · ACM Trans. Inf. Syst. 2026
ProEchoMem: Enhancing Long Video Understanding via Multi-Trace Probe-Echo Memory · SIGIR 2026
Bridging Personalization and AI: From RAG to Agent · SIGIR 2026
Recommender systems
sequential recommendation
3.742026
BlossomRec: Block-level Fused Sparse Attention Mechanism for Sequential Recommendations · WWW 2026
LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase Training · SIGIR 2026
Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models · SIGIR 2025
Natural language and speech › Language models and text generation
retrieval-augmented generation
1.722025
Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learning · NeurIPS 2025
LSRP: A Leader-Subordinate Retrieval Framework for Privacy-Preserving Cloud-Device Collaboration · KDD (2) 2025
Recommender systems
cross-domain recommendation
1.622025
Measure Domain's Gap: A Similar Domain Selection Principle for Multi-Domain Recommendation · KDD (2) 2025
D3: A Methodological Exploration of Domain Division, Modeling, and Balance in Multi-Domain Recommendations · AAAI 2024
Information retrieval › user interaction
personalization
1.322026
A Survey of Personalization: From RAG to Agent · ACM Trans. Inf. Syst. 2026
Bridging Personalization and AI: From RAG to Agent · SIGIR 2026
Natural language and speech › Language models and text generation › LLM agents
agentic search
1.012026
MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search · ACL (1) 2026
Natural language and speech › Information extraction and text analysis
emotion recognition
1.012026
Emotion and Intention Guided Multi-Modal Learning for Sticker Response Selection · AAAI 2026
Machine learning › Trustworthy machine learning
interpretability
1.012026
GeoArena: Evaluating Open-World Geographic Reasoning in Large Vision-Language Models · ACL (1) 2026
Natural language and speech › Language models and text generation
large language model fine-tuning
1.012026
RoSA: Enhancing Parameter-Efficient Fine-Tuning via RoPE-aware Selective Adaptation in Large Language Models · AAAI 2026
Computer vision › Video understanding and tracking
long video understanding
1.012026
ProEchoMem: Enhancing Long Video Understanding via Multi-Trace Probe-Echo Memory · SIGIR 2026
Machine learning › Reinforcement learning › partially observable reinforcement learning › memory-based reinforcement learning
memory-augmented agent
1.012026
MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search · ACL (1) 2026
Natural language and speech › Language models and text generation
memory-augmented language model
1.012026
Learning How and What to Memorize: Cognition-Inspired Two-Stage Optimization for Evolving Memory · ACL (1) 2026
Knowledge, reasoning and agents › Multi-agent systems › agent architecture
memory evolution
1.012026
Learning How and What to Memorize: Cognition-Inspired Two-Stage Optimization for Evolving Memory · ACL (1) 2026
Machine learning › Efficient and distributed learning
model merging
1.012026
MTA: A Merge-then-Adapt Framework for Personalized Large Language Models · ACL (1) 2026
Machine learning › Efficient and distributed learning
parameter-efficient fine-tuning
1.012026
RoSA: Enhancing Parameter-Efficient Fine-Tuning via RoPE-aware Selective Adaptation in Large Language Models · AAAI 2026
Natural language and speech › Language models and text generation › large language model › large language model adaptation
personalization
1.012026
MTA: A Merge-then-Adapt Framework for Personalized Large Language Models · ACL (1) 2026
Natural language and speech › Language models and text generation › large language model › large language model adaptation › personalization
personalized language model
1.012026
MTA: A Merge-then-Adapt Framework for Personalized Large Language Models · ACL (1) 2026
Natural language and speech › Language models and text generation › evaluation of language models › reasoning evaluation
reasoning chain evaluation
1.012026
GeoArena: Evaluating Open-World Geographic Reasoning in Large Vision-Language Models · ACL (1) 2026
Machine learning › Deep learning architectures and training
training optimization
1.012026
Learning How and What to Memorize: Cognition-Inspired Two-Stage Optimization for Evolving Memory · ACL (1) 2026
Information retrieval › evaluation › online evaluation
a/b testing
1.012026
Exploring Recommender System Evaluation: A Multi-Modal LLM Agent Framework for A/B Testing · KDD (1) 2026
Information retrieval
agentic search
1.012026
To Search or Not to Search: Aligning the Decision Boundary of Deep Search Agents via Causal Intervention · WWW 2026
Recommender systems › sequential recommendation
cross-domain sequential recommendation
1.012026
LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase Training · SIGIR 2026
Information retrieval
evaluation
1.012026
Exploring Recommender System Evaluation: A Multi-Modal LLM Agent Framework for A/B Testing · KDD (1) 2026
Recommender systems
large language model-based recommendation
1.012026
LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase Training · SIGIR 2026
Recommender systems › sequential recommendation › user behavior sequence modeling
long- and short-term interest modeling
1.012026
BlossomRec: Block-level Fused Sparse Attention Mechanism for Sequential Recommendations · WWW 2026
Information retrieval › query reformulation › query expansion
personalized query expansion
1.012026
Personalize Before Retrieve: LLM-based Personalized Query Expansion for User-Centric Retrieval · AAAI 2026
Information retrieval
personalized search
1.012026
Personalized Deep Research: A User-Centric Framework, Dataset, and Hybrid Evaluation for Knowledge Discovery · SIGIR 2026
Information retrieval › query reformulation
query expansion
1.012026
Personalize Before Retrieve: LLM-based Personalized Query Expansion for User-Centric Retrieval · AAAI 2026
Information retrieval › information filtering › technology-assisted review
stopping criteria
1.012026
To Search or Not to Search: Aligning the Decision Boundary of Deep Search Agents via Causal Intervention · WWW 2026
Data mining › multidimensional data analysis › multiway data analysis › tensor analysis
tensor factorization
1.012026
Renormalization Group Guided Tensor Network Structure Search · AAAI 2026

Methods — techniques the papers use, named apart from their topics

large language model · 10.5retrieval-augmented generation · 5.9renormalization group · 2.0multi-scale optimization · 2.0memory retrieval · 2.0edge gates · 2.0reinforcement learning · 1.9small language model · 1.7retrieval · 1.7reasoning-aligned memory · 1.0pseudo-relevance feedback · 1.0multimodal perception · 1.0multimodal fusion · 1.0multi-modal perception · 1.0low-rank adaptation · 1.0layer selection · 1.0human preference evaluation · 1.0graph-based structure alignment · 1.0
YearPublicationVenuePosition
2026 Emotion and Intention Guided Multi-Modal Learning for Sticker Response Selection
abstract
Stickers are widely used in online communication to convey emotions and implicit intentions. The Sticker Response Selection (SRS) task aims to select the most contextually appropriate sticker based on the dialogue. However, existing methods typically rely on semantic matching and model emotional and intentional cues separately, which can lead to mismatches when emotions and intentions are misaligned. To address this issue, we propose Emotion and Intention Guided Multi-Modal Learning (EIGML). This framework is the first to jointly model emotion and intention, effectively reducing the bias caused by isolated modeling and significantly improving selection accuracy. Specifically, we introduce Dual-Level Contrastive Framework to perform both intra-modality and inter-modality alignment, ensuring consistent representation of emotional and intentional features within and across modalities. In addition, we design an Intention-Emotion Guided Multi-Modal Fusion module that integrates emotional and intentional information progressively through three components: Emotion-Guided Intention Knowledge Selection, Intention-Emotion Guided Attention Fusion, and Similarity-Adjusted Matching Mechanism. This design injects rich, effective information into the model and enables a deeper understanding of the dialogue, ultimately enhancing sticker selection performance. Experimental results on two public datasets show that EIGML outperforms state-of-the-art baselines, achieving higher accuracy and a better understanding of emotional and intentional features.
Yuxuan Hu 0005, Jian Chen 0011, Yuhao Wang 0006, Zixuan Li 0001, Pengyue Jia, Wei Wang 0077, Chengming Li 0004, Xiangyu Zhao 0001
AAAI6
2026 RoSA: Enhancing Parameter-Efficient Fine-Tuning via RoPE-aware Selective Adaptation in Large Language Models
abstract
Fine-tuning large language models is essential for task-specific adaptation, yet it remains computationally prohibitive. Parameter-Efficient Fine-Tuning (PEFT) methods have emerged as a solution, but current approaches typically ignore the distinct roles of model components and the heterogeneous importance across layers, thereby limiting adaptation efficiency. Motivated by the observation that Rotary Position Embeddings (RoPE) induce critical activations in the low-frequency dimensions of attention states, we propose RoPE-aware Selective Adaptation (RoSA), a novel PEFT framework that allocates trainable parameters in a more targeted and effective manner. RoSA comprises a RoPE-aware Attention Enhancement (RoAE) module, which selectively enhances the low-frequency components of RoPE-influenced attention states, and a Dynamic Layer Selection (DLS) strategy that adaptively identifies and updates the most critical layers based on LayerNorm gradient norms. By combining dimension-wise enhancement with layer-wise adaptation, RoSA achieves more targeted and efficient fine-tuning. Extensive experiments on fifteen commonsense and arithmetic benchmarks demonstrate that RoSA outperforms mainstream PEFT methods under comparable trainable parameters.
Dayan Pan, Jingyuan Wang 0001, Yilong Zhou, Jiawei Cheng, Pengyue Jia, Xiangyu Zhao 0001
AAAI5
2026 Renormalization Group Guided Tensor Network Structure Search
abstract
Tensor network structure search (TN-SS) aims to automatically discover optimal network topologies and rank configurations for efficient tensor decomposition in high-dimensional data representation. Despite recent advances, existing TN-SS methods face significant limitations in computational tractability, structure adaptivity, and optimization robustness across diverse tensor characteristics. They struggle with three key challenges: single-scale optimization missing multi-scale structures, discrete search spaces hindering smooth structure evolution, and separated structure-parameter optimization causing computational inefficiency. We propose RGTN (Renormalization Group guided Tensor Network search), a physics-inspired framework transforming TN-SS via multi-scale renormalization group flows. Unlike fixed-scale discrete search methods, RGTN uses dynamic scale-transformation for continuous structure evolution across resolutions. Its core innovation includes learnable edge gates for optimization-stage topology modification and intelligent proposals based on physical quantities like node tension measuring local stress, and edge information flow quantifying connectivity importance. Starting from low-complexity coarse scales and refining to finer ones, RGTN finds compact structures while escaping local minima via scale-induced perturbations. Extensive experiments on light field data, high-order synthetic tensors, and video completion tasks show RGTN achieves state-of-the-art compression ratios and runs 4-600 times faster than existing methods, validating the effectiveness of our physics-inspired approach.
Maolin Wang 0001, Sheng Zhang 0028, Linjie Mi, Yiqi Wang 0001, Pengyue Jia, Xuetao Wei, Zenglin Xu, Ruocheng Guo, Xiangyu Zhao 0001
AAAI7
2026 Personalize Before Retrieve: LLM-based Personalized Query Expansion for User-Centric Retrieval
abstract
Retrieval-Augmented Generation (RAG) critically depends on effective query expansion to retrieve relevant information. However, existing expansion methods adopt uniform strategies that overlook user-specific semantics, ignoring individual expression styles, preferences, and historical context. In practice, identical queries in text can express vastly different intentions across users. This representational rigidity limits the ability of current RAG systems to generalize effectively in personalized settings. Specifically, we identify two core challenges for personalization: 1) user expression styles are inherently diverse, making it difficult for standard expansions to preserve personalized intent. 2) user corpora induce heterogeneous semantic structures—varying in topical focus and lexical organization—which hinders the effective anchoring of expanded queries within the user’s corpora space. To address these challenges, we propose Personalize Before Retrieve (PBR), a framework that incorporates user-specific signals into query expansion prior to retrieval. PBR consists of two components: P-PRF, which generates stylistically aligned pseudo feedback using user history for simulating user expression style, and P-Anchor, which performs graph-based structure alignment over user corpora to capture its structure. Together, they produce personalized query representations tailored for retrieval. Experiments on two personalized benchmarks show that PBR consistently outperforms strong baselines, with up to 10% gains on PersonaBench across retrievers. Our findings demonstrate the value of modeling personalization before retrieval to close the semantic gap in user-adaptive RAG systems.
Yingyi Zhang 0001, Pengyue Jia, Derong Xu, Yi Wen 0001, Xianneng Li, Yichao Wang 0002, Wenlin Zhang 0001, Xiaopeng Li 0014, Weinan Gan, Huifeng Guo, Yong Liu 0020, Xiangyu Zhao 0001
AAAI2
2026 GeoArena: Evaluating Open-World Geographic Reasoning in Large Vision-Language Models
abstract
Geographic reasoning is a fundamental cognitive capability that requires models to infer plausible locations by synthesizing visual evidence with spatial world knowledge. Despite recent advances in large vision-language models (LVLMs), existing evaluation paradigms remain largely outcome-centric, relying on static datasets and predefined labels that are conceptually misaligned with open-world geographic inference. Such outcome-centric evaluations often focus exclusively on label matching, leaving the underlying linguistic reasoning chains as unexamined black boxes. In this work, we introduce GeoArena, a dynamic, human-preference-based evaluation framework for benchmarking open-world geographic reasoning. GeoArena reframes evaluation as a pairwise reasoning alignment task on in-the-wild images, where human judges compare model-generated explanations based on reasoning quality, evidence synthesis, and plausibility. We deploy GeoArena as a public platform and benchmark 17 frontier LVLMs using thousands of human judgments, which complements existing benchmarks and supports the development of geographically grounded, human-aligned AI systems. We further provide detailed analyses of model behavior, including reliability of human preferences and factors influencing judgments of geographic reasoning quality.
Pengyue Jia, Yingyi Zhang 0001, Xiangyu Zhao 0001, Yixuan Li 0001
ACL (1)1
2026 MTA: A Merge-then-Adapt Framework for Personalized Large Language Models
abstract
Xiaopeng Li, Yuanjin Zheng, Wanyu Wang, Wenlin Zhang, Pengyue Jia, Yingyi Zhang, Haiying He, Mengyang Ma, Yiqi Wang, Maolin Wang, Xuetao Wei, Xiangyu Zhao. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026.
Xiaopeng Li 0014, Yuanjin Zheng, Wenlin Zhang 0001, Pengyue Jia, Yingyi Zhang 0001, Haiying He, Mengyang Ma, Yiqi Wang 0001, Maolin Wang 0001, Xuetao Wei, Xiangyu Zhao 0001
ACL (1)5
2026 Learning How and What to Memorize: Cognition-Inspired Two-Stage Optimization for Evolving Memory
abstract
Derong Xu, Shuochen Liu, Pengfei Luo, Pengyue Jia, Yingyi Zhang, Yi Wen, Yimin Deng, Wenlin Zhang, Enhong Chen, Xiangyu Zhao, Tong Xu. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026.
Derong Xu, Shuochen Liu, Pengfei Luo, Pengyue Jia, Yingyi Zhang 0001, Yi Wen 0001, Wenlin Zhang 0001, Enhong Chen, Xiangyu Zhao 0001, Tong Xu 0001
ACL (1)4
2026 MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search
abstract
Sheng Zhang, Junyi Li, Yingyi Zhang, Pengyue Jia, Yichao Wang, Xiaowei Qian, Wenlin Zhang, Maolin Wang, Yong Liu, Xiangyu Zhao. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026.
Sheng Zhang 0028, Junyi Li 0001, Yingyi Zhang 0001, Pengyue Jia, Yichao Wang 0002, Wenlin Zhang 0001, Maolin Wang 0001, Yong Liu 0020, Xiangyu Zhao 0001
ACL (1)4
2026 Exploring Recommender System Evaluation: A Multi-Modal LLM Agent Framework for A/B Testing
abstract
diningIn recommender systems, online A/B testing is a crucial method for evaluating the performance of different models. However, conducting online A/B testing often presents significant challenges, including substantial economic costs, user experience degradation, and considerable time requirements. With the Large Language Models' powerful capacity, LLM-based agent shows great potential to replace traditional online A/B testing. Nonetheless, current agents fail to simulate the perception process and interaction patterns, due to the lack of real environments and visual perception capability. To address these challenges, we introduce a multi-modal user agent for A/B testing (A/B Agent). Specifically, we construct a recommendation sandbox environment for A/B testing, enabling multimodal and multi-page interactions that align with real user behavior on online platforms. The designed agent leverages multimodal information perception, fine-grained user preferences, and integrates profiles, action memory retrieval, and a fatigue system to simulate complex human decision-making. We validated the potential of the agent as an alternative to traditional A/B testing from three perspectives: model, data, and features. Furthermore, we found that the data generated by A/B Agent can effectively enhance the capabilities of recommendation models. Our code is publicly available at https://github.com/Applied-Machine-Learning-Lab/ABAgent. © 2026 Owner/Author.
Wenlin Zhang 0001, Xiangyang Li 0004, Qiyuan Ge, Kuicai Dong, Pengyue Jia, Xiaopeng Li 0014, Zijian Zhang 0009, Maolin Wang 0001, Yichao Wang 0002, Huifeng Guo, Ruiming Tang, Xiangyu Zhao 0001
KDD (1)5
2026 Bridging Personalization and AI: From RAG to Agent
abstract
Personalization is becoming a core capability of modern AI systems. It enables systems to adapt their responses and behaviors according to individual users' preferences, contexts, and goals. Recent research has focused on Retrieval-Augmented Generation (RAG) and its development toward more advanced agent-based frameworks to improve user satisfaction in personalized settings. In this tutorial, we provide a systematic overview of how personalization can be incorporated into the three main stages of RAG: pre-retrieval, retrieval, and generation. We then extend the discussion to personalized LLM-based agents, which build on RAG by adding agent capabilities such as user understanding, personalized planning and execution, and adaptive response generation. For both RAG-based and agent-based approaches, we present clear definitions, review recent research, and summarize commonly used datasets and evaluation metrics. We also discuss key challenges, current limitations, and potential future research directions. An updated list of related papers and resources is available at our GitHub repository. https://github.com/Applied-Machine-Learning-Lab/Awesome-Personalized-RAG-Agent. Further updates for this tutorial will be uploaded on the homepage. https://applied-machine-learning-lab.github.io/SIGIR2026_PRAG_Tutorial.
Pengyue Jia, Xiaopeng Li 0014, Derong Xu, Yi Wen 0001, Yingyi Zhang 0001, Wenlin Zhang 0001, Yichao Wang 0002, Yong Liu 0020, Xiangyu Zhao 0001
SIGIR1
2026 Personalized Deep Research: A User-Centric Framework, Dataset, and Hybrid Evaluation for Knowledge Discovery
abstract
Deep Research agents driven by LLMs have automated the scholarly discovery pipeline, from planning and query formulation to iterative web exploration. Yet they remain constrained by a static, ''one-size-fits-all'' retrieval paradigm. Current systems fail to adaptively adjust the depth and breadth of exploration based on the user's existing expertise or latent interests, frequently resulting in reports that are either redundant for experts or overly dense for novices. To address this, we introduce Personalized Deep Research (PDR), a framework that integrates dynamic user context into the core retrieval-reasoning loop. Rather than treating personalization as a post-hoc formatting step, PDR unifies user profile modeling with iterative query development, dual-stage (private/public) retrieval, and context-aware synthesis. This allows the system to autonomously align research sub-goals with user intent and optimize the stopping criteria for evidence collection. To facilitate benchmarking, we release the PDR Dataset, covering four realistic user tasks, and propose a hybrid evaluation framework combining lexical metrics with LLM-based judgments to assess factual accuracy and personalization alignment. Experimental results against commercial baselines demonstrate that PDR significantly improves retrieval utility and report relevance, effectively bridging the gap between generic information retrieval and personalized knowledge acquisition. The resource is available to the public at~ https://github.com/Applied-Machine-Learning-Lab/SIGIR2026_PDR.
Xiaopeng Li 0014, Wenlin Zhang 0001, Yingyi Zhang 0001, Pengyue Jia, Yejing Wang, Yichao Wang 0002, Yong Liu 0020, Huifeng Guo, Xiangyu Zhao 0001
SIGIR4
2026 LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase Training
abstract
Cross-domain Sequential Recommendation (CDSR) has been proposed to enrich user-item interactions by incorporating information from various domains. Despite current progress, the domain imbalance issue and domain transition issue hinder further development of CDSR. The former presents a phenomenon where interactions in one domain dominate the entire behavior, leading to difficulty in capturing domain-specific features in the other domain. The latter points to the difficulty in capturing users' cross-domain preferences within the mixed interaction sequence, resulting in poor next-item prediction performance for specific domains. With world knowledge and powerful reasoning abilities, Large Language Models (LLMs) partially alleviate the above issues by functioning as both a generator and an encoder. However, current LLMs-enhanced CDSR methods are still under exploration, which fail to recognize the irrelevant noise and rough profiling problems. Thus, to address the aforementioned challenges, we propose an LLMs Enhanced Cross-domain Sequential Recommendation with Dual-phase Training (LLM-EDT). To address the domain imbalance issue while minimizing irrelevant noise, we propose the transferable item augmenter to adaptively generate possible cross-domain behaviors for users. Then, to alleviate the domain transition issue, we introduce a dual-phase training strategy to empower the domain-specific thread with a domain-shared background. As for the rough profiling problem, we devise a domain-aware profiling module to summarize the user's preference in each domain and adaptively aggregate them to generate comprehensive user profiles. The experiments on three public datasets validate the effectiveness of our proposed LLM-EDT. To ease reproducibility, we have released the detailed code online {https://github.com/Applied-Machine-Learning-Lab/SIGIR26_LLM-EDT}. © 2026 Copyright held by the owner/author(s).
Ziwei Liu 0010, Qidong Liu 0002, Yejing Wang, Pengyue Jia, Tong Xu 0001, Wei Huang 0046, Chong Chen 0001, Xiangyu Zhao 0001
SIGIR5
2026 ProEchoMem: Enhancing Long Video Understanding via Multi-Trace Probe-Echo Memory
abstract
Large vision-language models (LVLMs) have shown significant progress in video understanding, but they struggle to scale to long videos due to limited context windows. Existing methods reduce input dimensionality via frame sampling and feature compression, yet discard details and incur high computational cost for post-training. In contrast, retrieval-augmented generation (RAG) that indexes long videos for query retrieval and memory-based methods that maintain evolving long-term stores, offer a lighter and deployment-friendly solution. Nevertheless, they rely on shallow retrieval that selects only top-ranked segments and fails to integrate information across multiple relevant video episodes. Inspired by Multiple-Trace Theory in cognitive psychology, we revisit long video understanding from a probe-echo perspective, in which human episodic memories are activated and integrated in parallel. Building on this insight, we propose ProEchoMem, a cognitive-inspired framework that simulates the probe-echo mechanism: (1) Incremental Episodic Memory Construction builds structured knowledge graphs from video streams; (2) Probe-Driven Memory Activation generates probe signals from user queries to activate all stored traces simultaneously; (3) Memory Echo Synthesis integrates activated traces into a coherent and structured memory echo. Experiments on LongerVideos, LVBench, and cross-domain settings demonstrate the effectiveness of ProEchoMem, with multi-trace probing achieving up to 14.2% higher relevance and ablation studies validating the contribution of each module. The code is available at https://github.com/Applied-Machine-Learning-Lab/SIGIR26_ProEchoMem
Derong Xu, Yanxin Chen, Pengyue Jia, Chao Zhang 0096, Maolin Wang 0001, Yiqi Wang 0001, Jipeng Qiang, Xuetao Wei, Hongzhi Yin, Tong Xu 0001, Xiangyu Zhao 0001
SIGIR4
2026 BlossomRec: Block-level Fused Sparse Attention Mechanism for Sequential Recommendations
abstract
Transformer structures have been widely used in sequential recommender systems (SRS). However, as user interaction histories increase, computational time and memory requirements also grow. This is mainly caused by the standard attention mechanism. Although there exist many methods employing efficient attention and SSM-based models, these approaches struggle to effectively model long sequences and may exhibit unstable performance on short sequences. To address these challenges, we design a sparse attention mechanism, BlossomRec, which models both long-term and short-term user interests through attention computation to achieve stable performance across sequences of varying lengths. Specifically, we categorize user interests in recommendation systems into long-term and short-term interests, and compute them using two distinct sparse attention patterns, with the results combined through a learnable gated output. Theoretically, it significantly reduces the number of interactions participating in attention computation. Extensive experiments on four public datasets demonstrate that BlossomRec, when integrated with state-of-the-art Transformer-based models, achieves comparable or even superior performance while significantly reducing memory usage, providing strong evidence of BlossomRec's efficiency and effectiveness. The code is available at https://github.com/Applied-Machine-Learning-Lab/WWW2026_BlossomRec.
Mengyang Ma, Xiaopeng Li 0014, Zhaocheng Du, Jingtong Gao, Pengyue Jia, Yuyang Ye 0002, Yiqi Wang 0001, Yunpeng Weng, Weihong Luo, Xiao Han 0004, Xiangyu Zhao 0001
WWW6
2026 To Search or Not to Search: Aligning the Decision Boundary of Deep Search Agents via Causal Intervention
abstract
Deep search agents, which autonomously iterate through multi-turn web-based reasoning, represent a promising paradigm for complex information-seeking tasks. However, current agents suffer from critical inefficiency: they conduct excessive searches as they cannot accurately judge when to stop searching and start answering. This stems from outcome-centric training that prioritize final results over the search process itself. We identify the root cause as misaligned decision boundaries, the threshold determining when accumulated information suffices to answer. This causes over-search (redundant searching despite sufficient knowledge) and under-search (premature termination yielding incorrect answers). To address these errors, we propose a comprehensive framework comprising two key components. First, we introduce causal intervention-based diagnosis that identifies boundary errors by comparing factual and counterfactual trajectories at each decision point. Second, we develop Decision Boundary Alignment for Deep Search agents (DAS), which constructs preference datasets from causal feedback and aligns policies via preference optimization. Experiments on public datasets demonstrate that decision boundary errors are pervasive across state-of-the-art agents. Our DAS method effectively calibrates these boundaries, mitigating both over-search and under-search to achieve substantial gains in accuracy and efficiency. Our code and data are publicly available at: https://github.com/Applied-Machine-Learning-Lab/WWW2026-DAS. © 2026 Owner/Author.
Wenlin Zhang 0001, Kuicai Dong, Junyi Li 0001, Yingyi Zhang 0001, Xiaopeng Li 0014, Pengyue Jia, Yi Wen 0001, Derong Xu, Maolin Wang 0001, Yichao Wang 0002, Yong Liu 0020, Xiangyu Zhao 0001
WWW6
2026 A Survey of Personalization: From RAG to Agent
abstract
Personalization has become an essential capability in modern AI systems, enabling customized interactions that align with individual user preferences, contexts, and goals. Recent research has increasingly concentrated on Retrieval-Augmented Generation (RAG) frameworks and their evolution into more advanced agent-based architectures within personalized settings to enhance user satisfaction. Building on this foundation, this survey systematically examines personalization across the three core stages of RAG: pre-retrieval, retrieval, and generation. Beyond RAG, we further extend its capabilities into the realm of Personalized LLM-based Agents, which enhance traditional RAG systems with agentic functionalities, including user understanding, personalized planning and execution, and dynamic generation. For both personalization in RAG and agent-based personalization, we provide formal definitions, conduct a comprehensive review of recent literature, and summarize key datasets and evaluation metrics. Additionally, we discuss fundamental challenges, limitations, and promising research directions in this evolving field. Relevant papers and resources are continuously updated at the Github Repo ( https://github.com/Applied-Machine-Learning-Lab/Awesome-Personalized-RAG-Agent ).
Xiaopeng Li 0014, Pengyue Jia, Derong Xu, Yi Wen 0001, Yingyi Zhang 0001, Wenlin Zhang 0001, Yichao Wang 0002, Zhaocheng Du, Xiangyang Li 0004, Yong Liu 0020, Huifeng Guo, Ruiming Tang, Xiangyu Zhao 0001
ACM Trans. Inf. Syst.2
2025 SIGMA: Selective Gated Mamba for Sequential Recommendation
abstract
Sequential Recommender Systems (SRS) has stood out as a highly promising technique in numerous domains due to its impressive capability of capturing complex user preferences. Current SRS have employed transformer-based models to give the next-item prediction. Nevertheless, its quadratic computational complexity has often resulted in notable inefficiencies, posing a significant obstacle to real-time recommendation processes. Recently, Mamba has demonstrated its exceptional effectiveness in time series prediction, delivering substantial improvements in both efficiency and effectiveness. However, directly applying Mamba to SRS poses certain challenges. Its unidirectional structure may impede the ability to capture contextual information in user-item interactions, while its instability in state estimation may hinder the ability to capture short-term patterns in interaction sequences. To address these issues, we propose a novel framework called Selective Gated Mamba for Sequential Recommendation (SIGMA). By introducing the Partially Flipped Mamba (PF-Mamba), we construct a special bi-directional structure to address the context modeling challenge. Then, to consolidate PF-Mamba's performance, we employed an input-dependent Dense Selective Gate (DS Gate) to allocate the weights of the two directions and further filter the sequential information. Moreover, for short sequence modeling, we devise a Feature Extract GRU (FE-GRU) to capture the short-term dependencies. Experimental results demonstrate that SIGMA significantly outperforms existing baselines across five real-world datasets. Our implementation code is available in Supplementary Material to ease reproducibility.
Ziwei Liu 0010, Qidong Liu 0002, Yejing Wang, Pengyue Jia, Maolin Wang 0001, Zitao Liu 0001, Yi Chang 0001, Xiangyu Zhao 0001
AAAI5
2025 Stepwise Reasoning Disruption Attack of LLMs
abstract
Jingyu Peng, Maolin Wang, Xiangyu Zhao, Kai Zhang, Wanyu Wang, Pengyue Jia, Qidong Liu, Ruocheng Guo, Qi Liu. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Jingyu Peng, Maolin Wang 0001, Xiangyu Zhao 0001, Kai Zhang 0038, Pengyue Jia, Qidong Liu 0002, Ruocheng Guo, Qi Liu 0003
ACL (1)6
2025 Scenario-Wise Rec: A Multi-Scenario Recommendation Benchmark
abstract
Multi-Scenario Recommendation (MSR) tasks, referring to building a unified model to enhance performance across all recommendation scenarios, have recently gained considerable attention. However, current research in MSR faces two significant challenges that hinder the field's development: the absence of uniform procedures for multi-scenario dataset processing, thus hindering fair comparisons, and most models being closed-source, which complicates comparisons with current SOTA models. Consequently, we introduce our benchmark, Scenario-Wise Rec, which comprises six public datasets and twelve baseline models, along with a training and evaluation pipeline. We further validate Scenario-Wise Rec on an industrial advertising dataset, underscoring its robustness. We hope the benchmark will give researchers clear insights into prior work, enabling them to develop novel models and thereby fostering a collaborative research ecosystem in MSR. Our source code is publicly available (https://github.com/Applied-Machine-Learning-Lab/Scenario-Wise-Rec).
Xiaopeng Li 0014, Jingtong Gao, Pengyue Jia, Xiangyu Zhao 0001, Yichao Wang 0002, Yejing Wang, Yuhao Wang 0006, Huifeng Guo, Ruiming Tang
CIKM3
2025 SELF: Surrogate-light Feature Selection with Large Language Models in Deep Recommender Systems
abstract
Feature selection is crucial in recommender systems for improving model efficiency and predictive performance. Conventional approaches typically employ surrogate models-such as decision trees or neural networks-to estimate feature importance. However, their effectiveness is inherently constrained, as these models may struggle under suboptimal training conditions, including feature collinearity, high-dimensional sparsity, and insufficient data. In this paper, we propose SELF, a SurrogatE-Light Feature selection method for deep recommender systems. SELF integrates semantic reasoning from Large Language Models (LLMs) with task-specific learning from surrogate models, enabling an automated and lightweight feature selection process. Specifically, LLMs first produce a semantically informed ranking of feature importance, which is subsequently refined by a surrogate model, effectively integrating general world knowledge with task-specific learning. Comprehensive experiments on three public datasets from real-world recommender platforms validate the effectiveness of SELF. To facilitate reproducibility, our code is publicly available.
Pengyue Jia, Zhaocheng Du, Yichao Wang 0002, Xiangyu Zhao 0001, Xiaopeng Li 0014, Yuhao Wang 0006, Qidong Liu 0002, Huifeng Guo, Ruiming Tang
CIKM1
2025 Prompt Tuning as User Inherent Profile Inference Machine
abstract
Large Language Models (LLMs) have exhibited significant promise in recommender systems by empowering user profiles with their extensive world knowledge and superior reasoning capabilities. However, LLMs face challenges like unstable instruction compliance, modality gaps, and high inference latency, leading to textual noise and limiting their effectiveness in recommender systems. To address these challenges, we propose UserIP-Tuning, which uses prompt-tuning to infer user profiles. It integrates the causal relationship between user profiles and behavior sequences into LLMs' prompts. It employs Expectation Maximization (EM) to infer the embedded latent profile, minimizing textual noise by fixing the prompt template. Furthermore, a profile quantization codebook bridges the modality gap by categorizing profile embeddings into collaborative IDs pre-stored for online deployment. This improves time efficiency and reduces memory usage. Experiments show that UserIP-Tuning outperforms state-of-the-art recommendation algorithms. An industry application confirms its effectiveness, robustness, and transferability. The presented solution has been deployed in Huawei AppGallery's Explore page since May 2025, serving 2 million daily active users, delivering significant improvements in real-world recommendation scenarios. The code is publicly available for replication at https://github.com/Applied-Machine-Learning-Lab/UserIP-Tuning.
Yusheng Lu, Zhaocheng Du, Xiangyang Li 0004, Pengyue Jia, Yejing Wang, Weiwen Liu, Yichao Wang 0002, Huifeng Guo, Ruiming Tang, Zhenhua Dong, Yongrui Duan, Xiangyu Zhao 0001
CIKM4
2025 TAPO: Task-Referenced Adaptation for Prompt Optimization
abstract
Prompt engineering can significantly improve the performance of large language models (LLMs), with automated prompt optimization (APO) gaining significant attention due to the time-consuming and laborious nature of manual prompt design. However, much of the existing work in APO overlooks task-specific characteristics, resulting in prompts that lack domain specificity and are not well-suited for task-specific optimization. In this paper, we introduce TAPO, a multitask-aware prompt optimization framework composed of three key modules. First, a task-aware metric selection module is proposed to enhance task-specific prompt generation capabilities. Second, we present a multi-metrics evaluation module to jointly evaluate prompts from multiple perspectives. Third, an evolution-based optimization framework is introduced for automatic prompt refinement, which improves adaptability across various tasks. Extensive experiments on six datasets demonstrate the effectiveness of our approach, and our code is publicly available1.
Wenxin Luo, Weirui Wang, Xiaopeng Li 0014, Weibo Zhou, Pengyue Jia, Xiangyu Zhao 0001
ICASSP5
2025 Measure Domain's Gap: A Similar Domain Selection Principle for Multi-Domain Recommendation
abstract
Multi-Domain Recommendation (MDR) achieves the desirable recommendation performance by effectively utilizing the transfer information across different domains. Despite the great success, most existing MDR methods adopt a single structure to transfer complex domain-shared knowledge. However, the beneficial transferring information should vary across different domains. When there is knowledge conflict between domains or a domain is of poor quality, unselectively leveraging information from all domains will lead to a serious Negative Transfer Problem (NTP). Therefore, how to effectively model the complex transfer relationships between domains to avoid NTP is still a direction worth exploring. To address these issues, we propose a simple and dynamic Similar Domain Selection Principle (SDSP) for multi-domain recommendation in this paper. SDSP presents the initial exploration of selecting suitable domain knowledge for each domain to alleviate NTP. Specifically, we propose a novel prototype-based domain distance measure to effectively model the complexity relationship between domains. Thereafter, the proposed SDSP can dynamically find similar domains for each domain based on the supervised signals of the domain metrics and the unsupervised distance measure from the learned domain prototype. We emphasize that SDSP is a lightweight method that can be incorporated with existing MDR methods for better performance while not introducing excessive time overheads. To the best of our knowledge, it is the first solution that can explicitly measure domain-level gaps and dynamically select appropriate domains in the MDR field. Extensive experiments on three datasets demonstrate the effectiveness of our proposed method.
Yi Wen 0001, Yue Liu 0008, Derong Xu, Huishi Luo, Pengyue Jia, Yiqing Wu, Siwei Wang 0001, Ke Liang 0006, Maolin Wang 0001, Yiqi Wang 0001, Fuzhen Zhuang, Xiangyu Zhao 0001
KDD (2)5
2025 Large Language Model Enhanced Recommender Systems: Methods, Applications and Trends
abstract
Due to exceptional reasoning and understanding abilities, the Large Language Model (LLM) has revolutionized the pattern of many fields, including recommender systems (RS). There has been a handful of research that focuses on empowering the RS by LLM. Recently, considering the latency and memory costs in real-world applications, LLM-Enhanced RS (LLMERS) is highlighted. This direction pushes the LLM into the online system with a large step by eliminating the utilization of LLM during inference. As a cutting-edge field, there is a clear need for a comprehensive survey to summarize this direction. In this survey, we systematically investigate the most up-to-date works of LLM-enhanced RS to boost this direction. Based on the component of an RS model that the LLM aims to augment, the basic taxonomy includes Knowledge Enhancement, Interaction Enhancement and Model Enhancement. Additionally, we identify several promising research directions. To facilitate access to the surveyed papers, we release a repository.
Qidong Liu 0002, Xiangyu Zhao 0001, Yuhao Wang 0006, Yejing Wang, Zijian Zhang 0009, Xiang Li 0113, Maolin Wang 0001, Pengyue Jia, Chong Chen 0001, Wei Huang 0046, Feng Tian 0002
KDD (2)9
2025 LSRP: A Leader-Subordinate Retrieval Framework for Privacy-Preserving Cloud-Device Collaboration
abstract
Cloud-device collaboration leverages on-cloud Large Language Models (LLMs) for handling public user queries and on-device Small Language Models (SLMs) for processing private user data, collectively forming a powerful and privacy-preserving solution.However, existing approaches often fail to fully leverage the scalable problem-solving capabilities of on-cloud LLMs while underutilizing the advantage of on-device SLMs in accessing and processing personalized data.This leads to two interconnected issues: 1) Limited utilization of the problem-solving capabilities of on-cloud LLMs, which fail to align with personalized user-task needs, and 2) Inadequate integration of user data into on-device SLM responses, resulting in mismatches in contextual user information.In this paper, we propose a Leader-Subordinate Retrieval framework for Privacy-preserving cloud-device collaboration (LSRP), a novel solution that bridges these gaps by: 1) enhancing on-cloud * Contributed equally to this work.
Yingyi Zhang 0001, Pengyue Jia, Xianneng Li, Derong Xu, Maolin Wang 0001, Yichao Wang 0002, Zhaocheng Du, Huifeng Guo, Yong Liu 0020, Ruiming Tang, Xiangyu Zhao 0001
KDD (2)2
2025 GeoRanker: Distance-Aware Ranking for Worldwide Image Geolocalization
abstract
Worldwide image geolocalization—the task of predicting GPS coordinates from images taken anywhere on Earth—poses a fundamental challenge due to the vast diversity in visual content across regions. While recent approaches adopt a two-stage pipeline of retrieving candidates and selecting the best match, they typically rely on simplistic similarity heuristics and point-wise supervision, failing to model spatial relationships among candidates. In this paper, we propose **GeoRanker**, a distance-aware ranking framework that leverages large vision-language models to jointly encode query–candidate interactions and predict geographic proximity. In addition, we introduce a *multi-order distance loss* that ranks both absolute and relative distances, enabling the model to reason over structured spatial relationships. To support this, we curate GeoRanking, the first dataset explicitly designed for geographic ranking tasks with multimodal candidate information. GeoRanker achieves state-of-the-art results on two well-established benchmarks (IM2GPS3K and YFCC4K), significantly outperforming current best methods. We also release our code, checkpoint, and dataset online for ease of reproduction.
Pengyue Jia, Seongheon Park, Xiangyu Zhao 0001, Yixuan Li 0001
NeurIPS1
2025 Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learning
abstract
Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge, yet traditional RAG systems struggle with static workflows and limited adaptability for complex, multistep reasoning tasks. Agentic RAG systems, such as DeepResearch, address these issues through dynamic retrieval, iterative context refinement, and adaptive workflows. However, recent methods like Search-R1, which rely on outcome-based reinforcement learning, face challenges such as low exploration efficiency, gradient conflict, and sparse reward signals. To tackle these limitations, we introduce ReasonRAG, a novel method that leverages RAG-ProGUIDE—a high-quality dataset providing fine-grained, process-level rewards for query generation, evidence extraction, and answer generation. By employing process-supervised reinforcement learning, ReasonRAG enhances LLMs’ autonomous capabilities in search, query generation, evidence extraction, and answer synthesis. Experimental results show that ReasonRAG, utilizing RAG-ProGUIDE, outperforms existing approaches like Search-R1 and traditional RAG systems, achieving superior performance on five benchmark datasets with only 5k training instances—significantly fewer than the 90k required by Search-R1. Our code is available at https://github.com/Applied-Machine-Learning-Lab/ReasonRAG.
Wenlin Zhang 0001, Xiangyang Li 0004, Kuicai Dong, Yichao Wang 0002, Pengyue Jia, Xiaopeng Li 0014, Yingyi Zhang 0001, Derong Xu, Zhaocheng Du, Huifeng Guo, Ruiming Tang, Xiangyu Zhao 0001
NeurIPS5
2025 AgentIR: 2nd Workshop on Agent-based Information Retrieval
abstract
Information retrieval (IR) systems are essential in modern society, aiding users to efficiently locate relevant information through query expansion, document retrieval, ranking, and re-ranking. User feedback from ranked outputs forms a dynamic interaction loop with IR systems, which can be modeled as either one-time or sequential decision-making problems. Over the past decade, deep reinforcement learning (DRL) has emerged as a promising approach to decision-making, leveraging the high model capacity of deep learning for complex tasks. While significant research has explored the application of DRL to IR tasks, several fundamental challenges remain underexplored, including the underlying information theory in DRL settings, the limitations of reinforcement learning methods for industrial IR applications, and the simulation of DRL-based IR systems. Concurrently, the advent of large language models (LLMs) has introduced new opportunities for optimizing and simulating IR systems. Building on the success of the Agent-based IR Workshop at SIGIR 2024, we propose hosting the second Agent-based IR Workshop at SIGIR 2025. This workshop will continue to provide a platform for researchers and practitioners from academia and industry to present cutting-edge advances in DRL-based and LLM-based IR systems from an agent-based perspective. By building on the foundation laid in the first workshop, the 2025 edition aims to delve deeper into emerging research challenges, foster collaborations, and explore innovative applications. Through engaging discussions and insightful presentations, the workshop seeks to further expand the boundaries of IR research and solidify its role as a premier venue for advancing agent-based IR systems.
Pengyue Jia, Qingpeng Cai 0001, Xiangyu Zhao 0001, Ling Pan, Xin Xin 0003, Jin Huang 0010, Weinan Zhang 0001, Li Zhao 0007, Dawei Yin 0001, Grace Hui Yang
SIGIR1
2025 Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models
abstract
Sequential Recommendation (SR) aims to leverage the sequential patterns in users' historical interactions to accurately track their preferences. However, the primary reliance of existing SR methods on collaborative data results in challenges such as the cold-start problem and sub-optimal performance. Concurrently, despite the proven effectiveness of large language models (LLMs), their integration into commercial recommender systems is impeded by issues such as high inference latency, incomplete capture of all distribution statistics, and catastrophic forgetting. To address these issues, we introduce a novel Pre-train, Align, and Disentangle (PAD) framework to enhance SR models with LLMs. In particular, we initially pre-train both the SR and LLM models to obtain collaborative and textual embeddings. Subsequently, we propose a characteristic recommendation-anchored alignment loss using multi-kernel maximum mean discrepancy with Gaussian kernels. Lastly, a triple-experts architecture, comprising aligned and modality-specific experts with disentangled embeddings, is fine-tuned in a frequency-aware manner. Experimental results on three public datasets validate the efficacy of PAD, indicating substantial enhancements and compatibility with various SR backbone models, particularly for cold items. The code and datasets are accessible for reproduction: https://github.com/Applied-Machine-Learning-Lab/PAD.
Yuhao Wang 0006, Junwei Pan, Pengyue Jia, Maolin Wang 0001, Zhixiang Feng, Jie Jiang 0015, Xiangyu Zhao 0001
SIGIR3
2025 Agent4Ranking: Semantic Robust Ranking via Personalized Query Rewriting Using Multi-Agent LLMs
abstract
Search engines are crucial as they provide an efficient and easy way to access vast amounts of information on the Internet for diverse information needs. User queries, even with a specific need, can differ significantly. Prior research has explored the resilience of ranking models against typical query variations like paraphrasing, misspellings, and order changes. Yet, these works overlook how diverse demographics uniquely formulate identical queries. For instance, older individuals tend to construct queries more naturally and in varied order compared to other groups. This demographic diversity necessitates enhancing the adaptability of ranking models to diverse query formulations. To this end, in this article, we propose a framework that integrates a novel rewriting pipeline that rewrites queries from various demographic perspectives and a novel framework to enhance ranking robustness. To be specific, we use Chain of Thought (CoT) technology to utilize Large Language Models (LLMs) as agents to emulate various demographic profiles, then use them for efficient query rewriting, and we innovate a Robust Multi-gate Mixture-of-Experts (R-MMoE) architecture coupled with a hybrid loss function, collectively strengthening the ranking models’ robustness. Our extensive experiments on both public and industrial datasets assesses the efficacy of our query rewriting approach and the enhanced accuracy and robustness of the ranking model. The findings highlight the sophistication and effectiveness of our proposed model. We release our code implementation publicly ( https://github.com/Applied-Machine-Learning-Lab/ROBR ).
Xiaopeng Li 0014, Lixin Su, Pengyue Jia, Suqi Cheng, Junfeng Wang 0009, Dawei Yin 0001, Xiangyu Zhao 0001
ACM Trans. Inf. Syst.3
2024 D3: A Methodological Exploration of Domain Division, Modeling, and Balance in Multi-Domain Recommendations
abstract
To enhance the efficacy of multi-scenario services in industrial recommendation systems, the emergence of multi-domain recommendation has become prominent, which entails simultaneous modeling of all domains through a unified model, effectively capturing commonalities and differences among them. However, current methods rely on manual domain partitioning, which overlook the intricate domain relationships and the heterogeneity of different domains during joint optimization, hindering the integration of domain commonalities and differences. To address these challenges, this paper proposes a universal and flexible framework D3 aimed at optimizing the multi-domain recommendation pipeline from three key aspects. Firstly, an attention-based domain adaptation module is introduced to automatically identify and incorporate domain-sensitive features during training. Secondly, we propose a fusion gate module that enables the seamless integration of commonalities and diversities among domains, allowing for implicit characterization of intricate domain relationships. Lastly, we tackle the issue of joint optimization by deriving loss weights from two complementary viewpoints: domain complexity and domain specificity, alleviating inconsistencies among different domains during the training phase. Experiments on three public datasets demonstrate the effectiveness and superiority of our proposed framework. In addition, D3 has been implemented on a real-life, high-traffic internet platform catering to millions of users daily.
Pengyue Jia, Yichao Wang 0002, Shanru Lin, Xiaopeng Li 0014, Xiangyu Zhao 0001, Huifeng Guo, Ruiming Tang
AAAI1
2024 ERASE: Benchmarking Feature Selection Methods for Deep Recommender Systems
abstract
Deep Recommender Systems (DRS) are increasingly dependent on a large number of feature fields for more precise recommendations. Effective feature selection methods are consequently becoming critical for further enhancing the accuracy and optimizing storage efficiencies to align with the deployment demands. This research area, particularly in the context of DRS, is nascent and faces three core challenges. Firstly, variant experimental setups across research papers often yield unfair comparisons, obscuring practical insights. Secondly, the existing literature's lack of detailed analysis on selection attributes, based on large-scale datasets and a thorough comparison among selection techniques and DRS backbones, restricts the generalizability of findings and impedes deployment on DRS. Lastly, research often focuses on comparing the peak performance achievable by feature selection methods. This approach is typically computationally infeasible for identifying the optimal hyperparameters and overlooks evaluating the robustness and stability of these methods. To bridge these gaps, this paper presents ERASE, a comprehensive bEnchmaRk for feAture SElection for DRS. ERASE comprises a thorough evaluation of eleven feature selection methods, covering both traditional and deep learning approaches, across four public datasets, private industrial datasets, and a real-world commercial platform, achieving significant enhancement. Our code is available online for ease of reproduction.
Pengyue Jia, Yejing Wang, Zhaocheng Du, Xiangyu Zhao 0001, Yichao Wang 0002, Bo Chen 0023, Huifeng Guo, Ruiming Tang
KDD1
2024 MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion
abstract
Pengyue Jia, Yiding Liu, Xiangyu Zhao, Xiaopeng Li, Changying Hao, Shuaiqiang Wang, Dawei Yin. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.
Pengyue Jia, Xiangyu Zhao 0001, Xiaopeng Li 0014, Changying Hao, Shuaiqiang Wang, Dawei Yin 0001
NAACL-HLT1
2024 G3: An Effective and Adaptive Framework for Worldwide Geolocalization Using Large Multi-Modality Models
abstract
Worldwide geolocalization aims to locate the precise location at the coordinate level of photos taken anywhere on the Earth. It is very challenging due to 1) the difficulty of capturing subtle location-aware visual semantics, and 2) the heterogeneous geographical distribution of image data. As a result, existing studies have clear limitations when scaled to a worldwide context. They may easily confuse distant images with similar visual contents, or cannot adapt to various locations worldwide with different amounts of relevant data. To resolve these limitations, we propose **G3**, a novel framework based on Retrieval-Augmented Generation (RAG). In particular, G3 consists of three steps, i.e., **G**eo-alignment, **G**eo-diversification, and **G**eo-verification to optimize both retrieval and generation phases of worldwide geolocalization. During Geo-alignment, our solution jointly learns expressive multi-modal representations for images, GPS and textual descriptions, which allows us to capture location-aware semantics for retrieving nearby images for a given query. During Geo-diversification, we leverage a prompt ensembling method that is robust to inconsistent retrieval performance for different image queries. Finally, we combine both retrieved and generated GPS candidates in Geo-verification for location prediction. Experiments on two well-established datasets IM2GPS3k and YFCC4k verify the superiority of G3 compared to other state-of-the-art methods. Our code is available online [https://github.com/Applied-Machine-Learning-Lab/G3](https://github.com/Applied-Machine-Learning-Lab/G3) for reproduction.
Pengyue Jia, Xiaopeng Li 0014, Xiangyu Zhao 0001, Yuhao Wang 0006, Yantong Du, Xiao Han 0004, Xuetao Wei, Shuaiqiang Wang, Dawei Yin 0001
NeurIPS1
2024 Fine-Grained Population Mobility Data-Based Community-Level COVID-19 Prediction Model
abstract
Predicting the number of infections in the anti-epidemic process is extremely beneficial to the government in developing anti-epidemic strategies, especially in fine-grained geographic units. Previous works focus on low spatial resolution prediction, e.g., county-level, and preprocess data to the same geographic level, which loses some useful information. In this paper, we propose a fine-grained population mobility data-based model (FGC-COVID) utilizing data of two geographic levels for community-level COVID-19 prediction. We use the population mobility data between Census Block Groups (CBGs), which is a finer-grained geographic level than community, to build the graph and capture the dependencies between CBGs using graph neural networks (GNNs). To mine as finer-grained patterns as possible for prediction, a spatial weighted aggregation module is introduced to aggregate the embeddings of CBGs to community level based on their geographic affiliation and spatial autocorrelation. Extensive experiments on 300 days LA city COVID-19 data indicate our model outperforms existing forecasting models on community-level COVID-19 prediction.
Pengyue Jia, Dandan Lyu
Cybern. Syst.1