Unifying Search and Recommendation in LLMs via Gradient Multi-Subspace Tuning
Abstract
Search and recommendation (S&R) are two integral components of modern online platforms, both aiming to model and satisfy user information needs. This shared objective motivates a unified modeling paradigm that enables richer user modeling and improves the effectiveness of both tasks. Recent attempts to unify S&R formulate item ranking in both tasks as conditional generation. While this paradigm is promising, existing methods rely on full fine-tuning, which is computationally expensive and limits scalability. Parameter-efficient fine-tuning (PEFT) offers a more practical alternative but faces two critical challenges in unifying S&R: (1) gradient conflicts across tasks due to divergent optimization objectives, and (2) shifts in user intent understanding caused by overfitting to fine-tuning data, which distort general-domain knowledge and weaken LLM reasoning. To address these issues, we propose Gradient Multi-Subspace Tuning (GEMS), a novel framework that unifies S&R with LLMs while alleviating gradient conflicts and preserving general-domain knowledge. GEMS introduces (1) Multi-Subspace Decomposition, which disentangles shared and task-specific optimization signals into complementary low-rank subspaces, thereby reducing destructive gradient interference, and (2) Null-Space Projection, which constrains parameter updates to a subspace orthogonal to the general-domain knowledge space, mitigating shifts in user intent understanding. Extensive experiments on benchmark datasets show that GEMS consistently outperforms the state-of-the-art baselines across both search and recommendation tasks, and the gains remain consistent when scaling to billion-parameter LLMs.
Assigned reviewers
| # | Reviewer | Match | Why (closest evidence publications in the taxonomy) | |
|---|---|---|---|---|
| 1 | Yang Zhang 0072 | 58 | 60 Preliminary Study on Incremental Learning for Large Language Model-based Recommender Systems (2024) Efficiency and Deployment 60 Reason4Rec: Deliberative User Preference Alignment of Large Language Models for Recommendation (2026) Preference Alignment and Optimization 60 TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation (2023) Preference Alignment and Optimization |
|
| 2 | Chongming Gao | 56 | 63 Large Language Models are Learnable Planners for Long-Term Recommendation (2024) Preference Alignment and Optimization 61 DLCRec: A Novel Approach for Managing Diversity in LLM-Based Recommender Systems (2025) Preference Alignment and Optimization 61 MGFRec: Towards Reinforced Reasoning Recommendation with Multiple Groundings and Feedback (2026) Preference Alignment and Optimization |
|
| 3 | Gustavo Penha | 45 | 59 Bridging Search and Recommendation in Generative Retrieval: Does One Task Help the Other? (2024) Recommendation with Search and Ranking 59 Semantic IDs for Joint Generative Search and Recommendation (2025) Recommendation with Search and Ranking 58 Online learning to rank for sequential music recommendation (2019) Search and Recommendation Integration |
Area chair
| Area chair | Match | |
|---|---|---|
| Xiaoxue Zang | 51 |
Area-chair candidates (8)
| Jun Xu 0001 COI: co-author | 51 | 2 papers | |
| Xiaoxue Zang assigned | 51 | 4 papers | |
| Pengyue Jia | 48 | 10 papers | |
| Leyu Lin | 44 | 15 papers | |
| Kun Gai | 44 | 5 papers | |
| Xiaoyi Zeng | 44 | 11 papers | |
| Maolin Wang 0001 | 43 | 15 papers | |
| Yanan Niu | 43 | 15 papers |
Candidates from the panel ranked by match score
| # | Reviewer | Match | Load | Why | |
|---|---|---|---|---|---|
| 1 | Zhengyi Yang 0007 | 60 | 3 | 60 On Softmax Direct Preference Optimization for Recommendation (2024) Preference Alignment and Optimization 60 AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization (2025) Preference Alignment and Optimization |
|
| 2 | Yang Zhang 0072 assigned | 58 | 3 | 60 Preliminary Study on Incremental Learning for Large Language Model-based Recommender Systems (2024) Efficiency and Deployment 60 Reason4Rec: Deliberative User Preference Alignment of Large Language Models for Recommendation (2026) Preference Alignment and Optimization |
|
| 3 | Jizhi Zhang COI: co-author | 57 | 3 | 68 Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendation (2023) Preference Alignment and Optimization 60 Navigating Large Language Models for Recommendation: From Architecture to Learning Paradigms and Deployment (2025) Efficiency and Deployment |
|
| 4 | Chongming Gao assigned | 56 | 3 | 63 Large Language Models are Learnable Planners for Long-Term Recommendation (2024) Preference Alignment and Optimization 61 DLCRec: A Novel Approach for Managing Diversity in LLM-Based Recommender Systems (2025) Preference Alignment and Optimization |
|
| 5 | Bo Chen 0023 | 54 | 3 | 61 Large language models make sample-efficient recommender systems (2025) Efficiency and Deployment 61 How Can Recommender Systems Benefit from Large Language Models: A Survey (2025) Efficiency and Deployment |
|
| 6 | Jiancan Wu | 53 | 3 | 60 AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization (2025) Preference Alignment and Optimization 60 Towards Robust Alignment of Language Models: Distributionally Robustifying Direct Preference Optimization (2025) Preference Alignment and Optimization |
|
| 9 | Junjie Zhang 0009 | 49 | 3 | 60 Large Language Models are Zero-Shot Rankers for Recommender Systems (2024) Efficiency and Deployment 60 Tapping the Potential of Large Language Models as Recommender Systems: A Comprehensive Framework and Empirical Analysis (2025) Efficiency and Deployment |
|
| 10 | Hao Liu 0078 | 49 | 3 | 61 WeaveRec: An LLM-Based Cross-Domain Sequential Recommendation Framework with Model Merging (2026) Efficiency and Deployment 46 MCRPL: A Pretrain, Prompt, and Fine-tune Paradigm for Non-overlapping Many-to-one Cross-domain Recommendation (2024) Domain Adaptation and Disentangled Representation for CDR |
|
| 11 | Yang Song 0008 | 49 | 3 | 75 UniSAR: Modeling User Transition Behaviors between Search and Recommendation (2024) Recommendation with Search and Ranking 75 When Search Meets Recommendation: Learning Disentangled Search Representation for Recommendation (2023) Search and Recommendation Integration |
|
| 13 | Huifeng Guo | 47 | 3 | 61 LLMTreeRec: Unleashing the Power of Large Language Models for Cold-Start Recommendations (2025) Generative Recommendation and Item Tokenization 57 Prompt Tuning as User Inherent Profile Inference Machine (2025) Efficiency and Deployment |
|
| 14 | Bo Peng 0009 | 47 | 3 | 60 eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction Data (2024) Efficiency and Deployment 46 M2: Mixed Models With Preferences, Popularities and Transitions for Next-Basket Recommendation (2023) Efficient and Long-Sequence Sequential Recommendation |
|
| 15 | Yongqi Li 0001 COI: co-author | 47 | 3 | 61 Efficient Inference for Large Language Model-based Generative Recommendation (2025) Generative Retrieval and Ranking 61 EARN: Efficient Inference Acceleration for LLM-based Generative Recommendation by Register Tokens (2025) Generative Retrieval and Ranking |
|
| 16 | Jieming Zhu | 47 | 3 | 61 Can LLMs Outshine Conventional Recommenders? A Comparative Evaluation (2025) Efficiency and Deployment 60 Efficient and Deployable Knowledge Infusion for Open-World Recommendations via Large Language Models (2026) Knowledge Infusion and Open-World Augmentation |
|
| 17 | Xiao Zhang 0034 | 47 | 3 | 61 Similarity = Value? Consultation Value-Assessment and Alignment for Personalized Search (2025) Personalized and Context-Aware Retrieval 60 Large Language Models Enhanced Collaborative Filtering (2024) Preference Alignment and Optimization |
|
| 18 | Bowen Zheng 0005 | 46 | 3 | 56 Autonomous Reasoning-Retrieval for Large Language Model Based Recommendation (2025) Reasoning-Intensive Retrieval and Ranking 49 Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation (2024) Generative Recommendation and Item Tokenization |
|
| 19 | Han Li 0005 | 46 | 3 | 60 LEARN: Knowledge Adaptation from Large Language Model to Recommendation for Practical Industrial Application (2025) Efficiency and Deployment 50 Comprehensive List Generation for Multi-Generator Reranking (2025) Recommendation with Search and Ranking |
|
| 20 | Xuanhua Yang | 46 | 3 | 57 Breaking the Relevance-Diversity Seesaw: Hierarchical LLM Reasoning with RL for Industrial Novelty Recommendation (2026) Preference Alignment and Optimization 56 GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendation (2026) Generative Retrieval and Ranking |
|
| 21 | Ed H. Chi | 46 | 3 | 73 Zero-Shot Heterogeneous Transfer Learning from Recommender Systems to Cold-Start Search Retrieval (2020) Search and Recommendation Integration 59 PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendations (2026) Item Tokenization and Semantic IDs |
|
| 22 | Keqin Bao | 45 | 3 | 68 Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendation (2023) Preference Alignment and Optimization 60 TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation (2023) Preference Alignment and Optimization |
|
| 23 | Yupeng Hou | 45 | 3 | 63 Large Language Models are Zero-Shot Rankers for Recommender Systems (2024) Efficiency and Deployment 47 Inductive Generative Recommendation via Retrieval-based Speculation (2026) Item Tokenization and Semantic IDs |
|
| 24 | Min Hou 0004 | 45 | 3 | 70 RecCocktail: A Generalizable and Efficient Framework for LLM-Based Recommendation (2026) Preference Alignment and Optimization 61 WeaveRec: An LLM-Based Cross-Domain Sequential Recommendation Framework with Model Merging (2026) Efficiency and Deployment |
|
| 25 | Gustavo Penha assigned | 45 | 3 | 59 Bridging Search and Recommendation in Generative Retrieval: Does One Task Help the Other? (2024) Recommendation with Search and Ranking 59 Semantic IDs for Joint Generative Search and Recommendation (2025) Recommendation with Search and Ranking |
|
| 26 | Jianling Wang | 44 | 3 | 60 Fresh Content Recommendation at Scale: A Multi-funnel Solution and the Potential of LLMs (2024) Efficiency and Deployment 53 Balancing Fine-tuning and RAG: A Hybrid Strategy for Dynamic LLM Recommendation Updates (2025) RAG for Domain Applications |
|
| 27 | Wei Guo 0006 | 44 | 3 | 61 Can LLMs Outshine Conventional Recommenders? A Comparative Evaluation (2025) Efficiency and Deployment 48 Killing Two Birds with One Stone: Unifying Retrieval and Ranking with a Single Generative Recommendation Model (2025) Generative Retrieval and Ranking |
|
| 28 | Shuchang Liu 0001 | 44 | 3 | 60 DLCRec: A Novel Approach for Managing Diversity in LLM-Based Recommender Systems (2025) Preference Alignment and Optimization 50 Comprehensive List Generation for Multi-Generator Reranking (2025) Recommendation with Search and Ranking |
|
| 29 | Qijiong Liu | 44 | 3 | 59 Can LLMs Outshine Conventional Recommenders? A Comparative Evaluation (2025) Efficiency and Deployment 50 ONCE: Boosting Content-based Recommendation with Both Open- and Closed-source Large Language Models (2024) LLM-Derived Knowledge Infusion |
|
| 32 | Junwei Pan | 44 | 3 | 59 Incremental Learning for LLM-based Tokenization and Recommendation (2025) Item Tokenization and Semantic IDs 52 Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDs (2025) Generative Recommendation and Item Tokenization |
|
| 33 | Jiangxia Cao | 44 | 3 | 46 Contrastive Cross-Domain Sequential Recommendation (2022) Cross-Domain and Cross-Market Sequential Recommendation 46 Towards Universal Cross-Domain Recommendation (2023) Multi-Domain and Multi-Market Recommendation |
|
| 35 | Yong He 0009 | 44 | 3 | 59 Breaking the Length Barrier: LLM-Enhanced CTR Prediction in Long Textual User Behaviors (2024) Efficiency and Deployment 45 Mixture of Graph Enhanced Expert Networks for Multi-task Recommendation (2022) Multi-Task and Multi-Objective Optimization |
|
| 36 | Lichan Hong | 44 | 3 | 57 Balancing Fine-tuning and RAG: A Hybrid Strategy for Dynamic LLM Recommendation Updates (2025) RAG for Domain Applications 49 PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendations (2026) Generative Recommendation and Item Tokenization |