Hierarchical Denoising Entire Space Multi-Task Model for Post-Click Conversion Rate Prediction with Noisy Labels
Abstract
The post-click Conversion Rate (CVR) prediction plays a pivotal role in industrial recommender systems, directly serving as a decisive factor for ranking strategies and revenue optimization. While Entire Space Multi-Task Models (e.g., ESMM) have become the dominant framework by effectively addressing sample selection bias and data sparsity, they rely heavily on the assumption that the observed click and conversion labels perfectly reflect user preferences. In real-world scenarios, however, observed data is inevitably contaminated by label noise. Crucially, within the entire space modeling framework, this noise exhibits a complex hierarchical structure, where the superimposition of noise from antecedent click labels and subsequent conversion labels results in conventional single-task denoising methods being ineffective. To bridge this gap, we propose HiDe-ESMM (Hierarchical Denoising Entire Space Multi-Task Model), a unified framework designed to systematically mitigate hierarchical label noise. First, adopting the loss correction paradigm, we derive a statistically unbiased CTCVR loss via backward correction and identify the requisite noise rates based on the weak separability assumption. Second, to alleviate the numerical instability inherent in the unbiased loss approach, we introduce a robust forward correction strategy as an efficient alternative and theoretically prove the consistency of its optimal solution with the optimal solution on clean data. Extensive experiments on one semi-synthetic dataset and two real-world industrial datasets demonstrate that HiDe-ESMM significantly outperforms state-of-the-art baselines, validating its robustness in handling hierarchical noisy labels.
Assigned reviewers
| # | Reviewer | Match | Why (closest evidence publications in the taxonomy) | |
|---|---|---|---|---|
| 1 | Ke Fei | 79 | 76 Stable and Adaptive Fusion for Multi-domain Multi-task Recommendation (2026) Multi-Scenario and Multi-Domain CTR Prediction 70 Inverse Contrastive Representation Learning for Post-Click Conversion Rate Estimation (2026) CTR and Conversion Rate Prediction 70 Entire-Space Variational Information Exploitation for Post-Click Conversion Rate Prediction (2025) CTR and Conversion Rate Prediction |
|
| 2 | Junwei Pan | 70 | 100 Ads Recommendation in a Collapsed and Entangled World (2024) CTR and Conversion Rate Prediction 70 Understanding the Ranking Loss for Recommendation with Sparse User Feedback (2024) CTR and Conversion Rate Prediction 70 Cross-Task Knowledge Distillation in Multi-Task Recommendation (2022) Multi-Task and Multi-Objective Optimization |
|
| 3 | Yimeng Bai | 58 | 70 GradCraft: Elevating Multi-task Recommendations through Holistic Gradient Crafting (2024) Multi-Task and Multi-Objective Optimization 69 Unconstrained Monotonic Calibration of Predictions in Deep Ranking Systems (2025) CTR and Conversion Rate Prediction 44 LabelCraft: Empowering Short Video Recommendations with Automated Label Crafting (2024) Recommendation Systems and Evaluation |
Area chair
| Area chair | Match | |
|---|---|---|
| Yanan Niu | 56 |
Area-chair candidates (6)
| Yanan Niu assigned | 56 | 15 papers | |
| Kun Gai COI: co-author | 50 | 5 papers | |
| Xin Xin 0003 | 46 | 10 papers | |
| Xiaoyi Zeng COI: co-author | 45 | 11 papers | |
| Leyu Lin | 44 | 15 papers | |
| Xiaoxue Zang | 43 | 4 papers |
Candidates from the panel ranked by match score
| # | Reviewer | Match | Load | Why | |
|---|---|---|---|---|---|
| 1 | Ke Fei assigned | 79 | 3 | 76 Stable and Adaptive Fusion for Multi-domain Multi-task Recommendation (2026) Multi-Scenario and Multi-Domain CTR Prediction 70 Inverse Contrastive Representation Learning for Post-Click Conversion Rate Estimation (2026) CTR and Conversion Rate Prediction |
|
| 2 | Junwei Pan assigned | 70 | 3 | 100 Ads Recommendation in a Collapsed and Entangled World (2024) CTR and Conversion Rate Prediction 70 Understanding the Ranking Loss for Recommendation with Sparse User Feedback (2024) CTR and Conversion Rate Prediction |
|
| 3 | Yong He 0009 | 66 | 3 | 76 GFlow-FT: Pick a Child Network via Gradient Flow for Efficient Fine-Tuning in Recommendation Systems (2022) CTR and Conversion Rate Prediction 75 DCBT: A Simple But Effective Way for Unified Warm and Cold Recommendation (2023) CTR and Conversion Rate Prediction |
|
| 4 | Yimeng Bai assigned | 58 | 3 | 70 GradCraft: Elevating Multi-task Recommendations through Holistic Gradient Crafting (2024) Multi-Task and Multi-Objective Optimization 69 Unconstrained Monotonic Calibration of Predictions in Deep Ranking Systems (2025) CTR and Conversion Rate Prediction |
|
| 5 | Jinxin Hu | 57 | 3 | 100 Counterfactual Multi-task Learning for Delayed Conversion Modeling in E-commerce Sales Pre-Promotion (2026) CTR and Conversion Rate Prediction 72 LREA: Low-Rank Efficient Attention on Modeling Long-Term User Behaviors for CTR Prediction (2025) CTR and Conversion Rate Prediction |
|
| 6 | Xin Zhang 0091 | 57 | 3 | 76 Deep Session Heterogeneity-Aware Network for Click Through Rate Prediction (2024) CTR and Conversion Rate Prediction 76 Deep Dynamic Interest Learning With Session Local and Global Consistency for Click-Through Rate Predictions (2022) CTR and Conversion Rate Prediction |
|
| 8 | Lichan Hong | 56 | 3 | 70 DSelect-k: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learning (2021) Multi-Task and Multi-Objective Optimization 70 DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systems (2021) CTR and Conversion Rate Prediction |
|
| 9 | Jie Jiang 0015 | 56 | 3 | 70 STEM: Unleashing the Power of Embeddings for Multi-Task Recommendation (2024) Multi-Task and Multi-Objective Optimization 70 Deep Pattern Network for Click-Through Rate Prediction (2024) CTR and Conversion Rate Prediction |
|
| 10 | Yu Zhang 0206 | 53 | 3 | 76 Scenario-Adaptive Fine-Grained Personalization Network: Tailoring User Behavior Representation to the Scenario Context (2024) Multi-Scenario and Multi-Domain CTR Prediction 72 LREA: Low-Rank Efficient Attention on Modeling Long-Term User Behaviors for CTR Prediction (2025) CTR and Conversion Rate Prediction |
|
| 11 | Xuanhua Yang | 53 | 3 | 75 Hierarchical User Long-term Behavior Modeling for Click-Through Rate Prediction (2025) CTR and Conversion Rate Prediction 60 Gradient Coordination for Quantifying and Maximizing Knowledge Transference in Multi-Task Learning (2023) Advertising and Auction Mechanisms |
|
| 12 | Yi Zhang 0103 | 52 | 3 | 70 CETN: Contrast-enhanced Through Network for Click-Through Rate Prediction (2025) CTR and Conversion Rate Prediction 70 TF4CTR: Twin Focus Framework for CTR Prediction via Adaptive Sample Differentiation (2026) CTR and Conversion Rate Prediction |
|
| 13 | Wei Guo 0006 | 51 | 3 | 70 DLF: Enhancing Explicit-Implicit Interaction via Dynamic Low-Order-Aware Fusion for CTR Prediction (2025) CTR and Conversion Rate Prediction 70 Enhancing Explicit and Implicit Feature Interactions via Information Sharing for Parallel Deep CTR Models (2021) CTR and Conversion Rate Prediction |
|
| 14 | Qiang Luo 0004 | 51 | 3 | 71 One Model to Serve All: Star Topology Adaptive Recommender for Multi-Domain CTR Prediction (2021) CTR and Conversion Rate Prediction 71 MPFormer: Adaptive Framework for Industrial Multi-Task Personalized Sequential Retriever (2025) Multi-Task and Multi-Objective Optimization |
|
| 16 | Jiangxia Cao | 49 | 3 | 70 ChorusCVR: Chorus Supervision for Entire Space Post-Click Conversion Rate Modeling (2026) CTR and Conversion Rate Prediction 47 CDRNP: Cross-Domain Recommendation to Cold-Start Users via Neural Process (2024) Domain Adaptation and Disentangled Representation for CDR |
|
| 17 | Ed H. Chi COI: co-author | 49 | 3 | 70 DSelect-k: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learning (2021) Multi-Task and Multi-Objective Optimization 70 Co-optimize Content Generation and Consumption in a Large Scale Video Recommendation System (2024) Multi-Task and Multi-Objective Optimization |
|
| 18 | Shuchang Liu 0001 COI: co-author | 48 | 3 | 76 M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework (2024) Multi-Scenario and Multi-Domain CTR Prediction 66 Heterogeneous Multi-treatment Uplift Modeling for Trade-off Optimization in Short-Video Recommendation (2026) Explainable and Causal Recommendation |
|
| 19 | Yuta Saito | 47 | 3 | 73 Doubly Robust Estimator for Ranking Metrics with Post-Click Conversions (2020) CTR and Conversion Rate Prediction 49 Off-Policy Evaluation of Ranking Policies under Diverse User Behavior (2023) Recommendation with Search and Ranking |
|
| 20 | Jieming Zhu | 47 | 3 | 71 Data-free Knowledge Distillation for Reusing Recommendation Models (2023) CTR and Conversion Rate Prediction 68 TayFCS: Towards Light Feature Combination Selection for Deep Recommender Systems (2025) CTR and Conversion Rate Prediction |
|
| 21 | Bo Peng 0009 | 46 | 3 | 58 SWaT: Statistical Modeling of Video Watch Time through User Behavior Analysis (2025) User Behavior and Search Interaction 47 M2: Mixed Models With Preferences, Popularities and Transitions for Next-Basket Recommendation (2023) Efficient and Long-Sequence Sequential Recommendation |
|
| 23 | Hao Deng 0011 | 46 | 3 | 64 CSMF: Cascaded Selective Mask Fine-Tuning for Multi-Objective Embedding-Based Retrieval (2025) Multi-Task and Multi-Objective Optimization 46 HeterRec: Heterogeneous Information Transformer for Scalable Sequential Recommendation (2025) Item Tokenization and Semantic IDs |
|
| 25 | Ziru Liu | 45 | 3 | 72 M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework (2024) Multi-Task and Multi-Objective Optimization 59 Multi-Task Recommendations with Reinforcement Learning (2023) Offline RL for Recommendation |
|
| 26 | Yongjing Hao | 44 | 3 | 70 Exploiting Intra and Inter-field Feature Interaction with Self-Attentive Network for CTR Prediction (2021) CTR and Conversion Rate Prediction 45 Click is not equal to purchase: multi-task reinforcement learning for multi-behavior recommendation (2023) Multi-Behavior Recommendation |
|
| 27 | Qijiong Liu | 44 | 3 | 72 Boosting Deep CTR Prediction with a Plug-and-Play Pre-trainer for News Recommendation (2022) CTR and Conversion Rate Prediction 51 Can LLMs Outshine Conventional Recommenders? A Comparative Evaluation (2025) Efficiency and Deployment |
|
| 28 | Hao Liu 0078 | 44 | 3 | 47 MCRPL: A Pretrain, Prompt, and Fine-tune Paradigm for Non-overlapping Many-to-one Cross-domain Recommendation (2024) Domain Adaptation and Disentangled Representation for CDR 46 DA-DAN: A Dual Adversarial Domain Adaption Network for Unsupervised Non-overlapping Cross-domain Recommendation (2024) Domain Adaptation and Disentangled Representation for CDR |
|
| 29 | Yifan Wang 0017 | 44 | 3 | 63 Unbiased Delayed Feedback Label Correction for Conversion Rate Prediction (2023) Advertising and Auction Mechanisms 53 Improving Long-tail User CTR Prediction via Hierarchical Distribution Alignment (2025) Bias Mitigation Methods |
|
| 31 | Ching Law | 44 | 3 | 70 DPEO: Dynamic Preference Evolution Optimization for Self-Evolving CTR Prediction (2026) CTR and Conversion Rate Prediction 63 Stream Normalization for CTR Prediction (2025) Advertising and Auction Mechanisms |
|
| 33 | Lantao Hu COI: co-author | 43 | 3 | 46 Unsupervised Ranking Ensemble Model for Recommendation (2024) Recommendation with Search and Ranking 46 Comprehensive List Generation for Multi-Generator Reranking (2025) Recommendation with Search and Ranking |
|
| 34 | Min Hou 0004 | 43 | 3 | 71 Clustering based Behavior Sampling with Long Sequential Data for CTR Prediction (2022) CTR and Conversion Rate Prediction 47 GoRec: A Generative Cold-start Recommendation Framework (2023) Content-Based Transferable Recommendation |
|
| 35 | Fei Sun 0001 | 43 | 3 | 46 Personalized re-ranking for recommendation (2019) Recommendation with Search and Ranking 46 Multi-interest Diversification for End-to-end Sequential Recommendation (2022) Multi-Behavior and Multi-Interest Sequential Recommendation |
|
| 36 | Yang Song 0008 | 43 | 3 | 58 Learning and Optimization of Implicit Negative Feedback for Industrial Short-video Recommender System (2023) Multi-Behavior and Multi-Interest Sequential Recommendation 46 Mixed Attention Network for Cross-domain Sequential Recommendation (2024) Cross-Domain and Cross-Market Sequential Recommendation |