Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Chenyi Lei

dblp:150/8550 · DBLP profile ↗
← Back
29ranked-venue papers
6as first author
23since 2021 · last 2026
0000-0001-6287-3673ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Databases, data management, data science and information retrieval · 15 · 2 first-author · 13 since 2021Artificial intelligence and machine learning · 14 · 3 first-author · 12 since 2021Graphics, computer vision, multimedia, augmented reality and games · 12 · 4 first-author · 8 since 2021Applied, interdisciplinary, general and emerging computing · 6 · 1 first-author · 5 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Databases, data mining, and information retrieval
17 papers
Recommender systems · 64% Information retrieval · 34% Web and social media mining · 2%
Artificial intelligence
12 papers
Reinforcement learning · 20% Representation and self-supervised learning · 19% Generative modeling · 16%

Topics — the 30 heaviest of 53, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Recommender systems
click-through rate prediction
1.922026
COINS: Semantic Ids Enhanced Cold Item Representation for Click-through Rate Prediction in E-commerce Search · WWW 2026
Mitigating Redundancy in Deep Recommender Systems: A Field Importance Distribution Perspective · KDD (1) 2025
Recommender systems
cross-domain recommendation
1.732023
Self-Supervised Interest Transfer Network via Prototypical Contrastive Learning for Recommendation · AAAI 2023
E-Commerce Storytelling Recommendation Using Attentional Domain-Transfer Network and Adversarial Pre-Training · IEEE Trans. Multim. 2022
SEMI: A Sequential Multi-Modal Information Transfer Network for E-Commerce Micro-Video Recommendations · KDD 2021
Machine learning › Representation and self-supervised learning
contrastive learning
1.332023
Self-Supervised Interest Transfer Network via Prototypical Contrastive Learning for Recommendation · AAAI 2023
Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training · ACM Multimedia 2021
Enhancing Sequential Recommendation with Graph Contrastive Learning · IJCAI 2022
Machine learning › Reinforcement learning › policy optimization
group relative policy optimization
1.322026
GRADE: Personalized Multi-Task Fusion via Group-Relative Reinforcement Learning with Adaptive Dirichlet Exploration · WWW 2026
Towards Context-aware Reasoning-enhanced Generative Searching in E-commerce · WWW 2026
Recommender systems
sequential recommendation
1.332026
Enhancing Sequential Recommendation with Graph Contrastive Learning · IJCAI 2022
TiSSA: A Time Slice Self-Attention Approach for Modeling Sequential User Behaviors · WWW 2019
DiffusionGS: Generative Search with Query Conditioned Diffusion in Kuaishou · WWW 2026
Machine learning › Generative modeling › diffusion model
conditional diffusion model
1.012026
DiffusionGS: Generative Search with Query Conditioned Diffusion in Kuaishou · WWW 2026
Machine learning › Generative modeling
diffusion model
1.012026
DiffusionGS: Generative Search with Query Conditioned Diffusion in Kuaishou · WWW 2026
Machine learning › Reinforcement learning
policy optimization
1.012026
GRADE: Personalized Multi-Task Fusion via Group-Relative Reinforcement Learning with Adaptive Dirichlet Exploration · WWW 2026
Recommender systems › e-commerce recommendation
e-commerce query recommendation
1.012026
OneSug: The Unified End-to-End Generative Framework for E-commerce Query Suggestion · AAAI 2026
Information retrieval › retrieval models
generative retrieval
1.012026
Towards Context-aware Reasoning-enhanced Generative Searching in E-commerce · WWW 2026
Information retrieval
query suggestion
1.012026
OneSug: The Unified End-to-End Generative Framework for E-commerce Query Suggestion · AAAI 2026
Information retrieval
query understanding
1.012026
Towards Context-aware Reasoning-enhanced Generative Searching in E-commerce · WWW 2026
Recommender systems › interactive recommendation
search-based recommendation
1.012026
Towards Context-aware Reasoning-enhanced Generative Searching in E-commerce · WWW 2026
Recommender systems › generative recommendation
semantic ID
1.012026
COINS: Semantic Ids Enhanced Cold Item Representation for Click-through Rate Prediction in E-commerce Search · WWW 2026
Information retrieval › information filtering
document filtering
0.912025
InfoGain-RAG: Boosting Retrieval-Augmented Generation through Document Information Gain-based Reranking and Filtering · EMNLP 2025
Information retrieval
reranking
0.912025
InfoGain-RAG: Boosting Retrieval-Augmented Generation through Document Information Gain-based Reranking and Filtering · EMNLP 2025
Information retrieval
retrieval-augmented generation
0.912025
InfoGain-RAG: Boosting Retrieval-Augmented Generation through Document Information Gain-based Reranking and Filtering · EMNLP 2025
Machine learning › Optimization for machine learning
gradient conflict resolution
0.812024
GradCraft: Elevating Multi-task Recommendations through Holistic Gradient Crafting · KDD 2024
Machine learning › Learning paradigms
multi-task learning
0.812024
GradCraft: Elevating Multi-task Recommendations through Holistic Gradient Crafting · KDD 2024
Machine learning › Trustworthy machine learning › open-world recognition
open-set recognition
0.612022
CoHOZ: Contrastive Multimodal Prompt Tuning for Hierarchical Open-set Zero-shot Recognition · ACM Multimedia 2022
Machine learning › Transfer learning and domain adaptation
zero-shot learning
0.612022
CoHOZ: Contrastive Multimodal Prompt Tuning for Hierarchical Open-set Zero-shot Recognition · ACM Multimedia 2022
Machine learning › Graph learning › graph neural network
graph transformer
0.512021
Pre-training Graph Transformer with Multimodal Side Information for Recommendation · ACM Multimedia 2021
Machine learning › Representation and self-supervised learning › contrastive learning › multimodal contrastive learning
multi-modal contrastive pre-training
0.512021
Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training · ACM Multimedia 2021
Computer vision › Vision and language › vision-language pretraining
video-language pre-training
0.512021
Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training · ACM Multimedia 2021
Computer vision › Vision and language
video-language understanding
0.512021
Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training · ACM Multimedia 2021
Recommender systems
graph-based recommendation
0.512021
Pre-training Graph Transformer with Multimodal Side Information for Recommendation · ACM Multimedia 2021
Recommender systems › video recommendation
micro-video recommendation
0.512021
SEMI: A Sequential Multi-Modal Information Transfer Network for E-Commerce Micro-Video Recommendations · KDD 2021
Information retrieval
pre-trained graph transformer
0.512021
Pre-training Graph Transformer with Multimodal Side Information for Recommendation · ACM Multimedia 2021
Multimedia analysis and retrieval › similarity learning
contrastive learning
0.512021
SEMI: A Sequential Multi-Modal Information Transfer Network for E-Commerce Micro-Video Recommendations · KDD 2021
Computer vision › Video understanding and tracking
video question answering
0.412020
Multi-Question Learning for Visual Question Answering · AAAI 2020

Methods — techniques the papers use, named apart from their topics

reinforcement learning · 4.0contrastive learning · 3.2supervised fine-tuning · 2.0dirichlet exploration · 2.0diffusion model · 2.0debiased GRPO · 2.0attention mechanism · 2.0reward-weighted ranking · 1.0prefix2query representation · 1.0encoder-decoder generative model · 1.0gradient projection · 0.8gradient magnitude balancing · 0.8multi-view interest modeling · 0.7sequential modeling · 0.5learning-to-rank · 0.2diffusion graph feature extraction · 0.2
YearPublicationVenuePosition
2026 OneSug: The Unified End-to-End Generative Framework for E-commerce Query Suggestion
abstract
Query suggestion plays a crucial role in enhancing user experience in e-commerce search systems by providing relevant query recommendations that align with users' initial input. This module helps users navigate towards personalized preference needs and reduces typing effort, thereby improving search experience. Traditional query suggestion modules usually adopt multi-stage cascading architectures, for making a well trade-off between system response time and business conversion. But they often suffer from inefficiencies and suboptimal performance due to inconsistent optimization objectives across stages. To address these, we propose OneSug, the first end-to-end generative framework for e-commerce query suggestion. OneSug incorporates a prefix2query representation enhancement module to enrich prefixes using semantically and interactively related queries to bridge content and business characteristics, an encoder-decoder generative model that unifies the query suggestion process, and a reward-weighted ranking strategy with behavior-level weights to capture fine-grained user preferences. Extensive evaluations on large-scale industry datasets demonstrate OneSug's ability for effective and efficient query suggestion. Furthermore, OneSug has been successfully deployed for the entire traffic on the e-commerce search engine in TEST platform for over 1 month, with statistically significant improvements in user top click position (-9.33%), CTR (+2.01%), Order (+2.04%), and Revenue (+1.69%) over the online multi-stage strategy, showing great potential in e-commercial conversion.
Ben Chen 0004, Siyuan Wang 0014, Mingyue Cheng 0004, Chenyi Lei, Yuqing Ding, Han Li 0005
AAAI6
2026 UniDGF: A Unified Detection-to-Generation Framework for Hierarchical Object Visual Recognition
abstract
Achieving visual semantic understanding requires a unified framework that simultaneously handles object detection, category prediction, and attribute recognition. However, current advanced approaches rely on global similarity and struggle to capture fine-grained category distinctions and category-specific attribute diversity, especially in large-scale e-commerce scenarios. To overcome these challenges, we introduce a detection-guided generative framework that predicts hierarchical category and attribute tokens. For each detected object, we extract refined ROI-level features and employ a BART-based generator to produce semantic tokens in a coarse-to-fine sequence covering category hierarchies and property–value pairs, with support for property-conditioned attribute recognition. Experiments on both large-scale proprietary e-commerce datasets and open-source datasets demonstrate that our approach significantly outperforms existing similarity-based pipelines and multi-stage classification systems, achieving stronger fine-grained recognition and more coherent unified inference.
Xinyu Nan, Lingtao Mao, Huangyu Dai, Zexin Zheng, Zihan Liang 0001, Ben Chen 0004, Chenyi Lei
ICMR8
2026 GRADE: Personalized Multi-Task Fusion via Group-Relative Reinforcement Learning with Adaptive Dirichlet Exploration
Tingfeng Hong, Pingye Ren, Xinlong Xiao, Chao Wang 0049, Chenyi Lei, Wenwu Ou, Han Li 0005
WWW5
2026 DiffusionGS: Generative Search with Query Conditioned Diffusion in Kuaishou
abstract
Personalized search ranking systems are critical for driving engagement and revenue in modern e-commerce platforms. Existing methods primarily model users' broad interests from historical behaviors but often fail to explicitly align these with real-time intent expressed in user queries. In this paper, we propose DiffusionGS, a scalable generative framework that treats user queries as explicit intent anchors to extract user interests from long-term, noisy behavior histories. Specifically, we formulate interest extraction as a conditional denoising task, where the user's query guides a conditional diffusion process to produce a robust, user intent-aware representation from their behavioral sequence. A User-aware Denoising Layer (UDL) further refines attention distribution using user-specific profiles. By reframing queries as intent priors and leveraging diffusion-based denoising, our method provides a powerful mechanism for capturing dynamic user interest shifts. Extensive offline and online experiments demonstrate the superiority of DiffusionGS over state-of-the-art methods. © 2026 Copyright held by the owner/author(s).
Qinyao Li, Qihang Zhao, Ke Xu 0010, Chao Wang 0049, Chenyi Lei, Han Li 0005, Wenwu Ou
WWW7
2026 Towards Context-aware Reasoning-enhanced Generative Searching in E-commerce
abstract
Search-based recommendation is one of the most critical application scenarios in e-commerce platforms. Users' complex search contexts—such as spatiotemporal factors, historical interactions, and current query's information—constitute an essential part of their decision-making, reflecting implicit preferences that complement explicit query terms. Modeling such rich contextual signals and their intricate associations with candidate items remains a key challenge. Although numerous efforts have been devoted to building more effective search methods, existing approaches still show limitations in integrating contextual information, which hinders their ability to fully capture user intent. To address these challenges, we propose a context-aware reasoning-enhanced generative search framework for better understanding the complicated context. Specifically, the framework first unifies heterogeneous user and item contexts into textual representations or text-based semantic identifiers and aligns them. To overcome the lack of explicit reasoning trajectories, we introduce a self-evolving post-training paradigm that iteratively combines supervised fine-tuning and reinforcement learning to progressively enhance the model's reasoning capability. In addition, we identify potential biases in existing RL algorithms when applied to search scenarios and present a debiased variant of GRPO to improve ranking performance. Extensive experiments on search log data collected from a real-world e-commerce platform demonstrate that our approach achieves superior performance compared with strong baselines, validating its effectiveness for search-based recommendation.
Zhiding Liu, Ben Chen 0004, Mingyue Cheng 0004, Enhong Chen, Li Li 0110, Chenyi Lei, Wenwu Ou, Han Li 0005, Kun Gai
WWW6
2026 COINS: Semantic Ids Enhanced Cold Item Representation for Click-through Rate Prediction in E-commerce Search
abstract
With the rise of modern search and recommendation platforms, insufficient collaborative information of cold-start items exacerbates the Matthew effect of existing platform items, challenging platform diversity and becoming a longstanding issue. Existing methods align items' side content with collaborative information to transfer collaborative signals from high-popularity items to cold-start items. However, these methods fail to account for the asymmetry between collaboration and content, nor the fine-grained differences among items. To address these issues, we propose COINS, an item representation enhancement approach based on fused alignment of semantic IDs. Specifically, we use RQ-OPQ encoding to quantize item content and collaborative information, followed by a two-step alignment: RQ encoding transfers shared collaborative signals across items, while OPQ encoding learns items' differentiated information. Comprehensive offline experiments on large-scale industrial datasets demonstrate COINS's superiority, and rigorous online A/B tests confirm statistically significant improvements.
Qihang Zhao, Siyuan Wang 0014, Zihan Liang 0001, Mingcan Peng, Ben Chen 0004, Chenyi Lei
WWW9
2026 Pseudo kinetics-driven federated diffusion hemodynamic framework for breast tumor segmentation in pre-contrast MRI
Tianxu Lv, Chenyi Lei, Jiansong Fan, Yuan Liu 0021, Lihua Li 0002
Expert Syst. Appl.4
2025 Multi-Source Knowledge Pruning for Retrieval-Augmented Generation: A Benchmark and Empirical Study
abstract
Retrieval-augmented generation (RAG) is increasingly recognized as an effective approach to mitigating the hallucination of large language models (LLMs) through the integration of external knowledge. While numerous efforts, most studies focus on a single type of external knowledge source. However, in real-world applications, most situations involve diverse knowledge from various sources, yet this area has been less explored. The main dilemma is the lack of a suitable dataset containing multiple knowledge sources and pre-exploration of the associated issues. To address these challenges, we standardize a benchmark dataset that combines structured and unstructured knowledge across diverse and complementary domains. Based on this dataset, we further develop a plug-and-play RAG framework, PruningRAG, whose main characteristic is the use of multi-granularity pruning strategies to optimize the integration of relevant information while minimizing misleading context. It consistently improves performance across various existing RAG variants, demonstrating its robustness and broad applicability. Building upon the standardized dataset and PruningRAG, we also report a series of experimental results, as well as insightful findings. Our dataset and code are publicly available. https://github.com/USTCAGI/PruningRAG, with the aim of advancing future research in the RAG community.
Shuo Yu 0007, Mingyue Cheng 0004, Qi Liu 0003, Daoyu Wang, Jiqian Yang, Yucong Luo, Chenyi Lei, Enhong Chen
CIKM8
2025 H-PRM: A Pluggable Hotword Pre-Retrieval Module for Various Speech Recognition Systems
Huangyu Dai, Lingtao Mao, Ben Chen 0004, Zihan Liang 0001, Chenyi Lei, Han Li 0005
CIKM7
2025 UniECS: Unified Multimodal E-Commerce Search Framework with Gated Cross-modal Fusion
abstract
The growth of e-commerce has created substantial demand for multimodal search systems that process diverse visual and textual inputs. Current e-commerce multimodal retrieval systems face two key limitations: they optimize for specific tasks with fixed modality pairings, and lack comprehensive benchmarks for evaluating unified retrieval approaches. To address these challenges, we introduce UniECS, a unified multimodal e-commerce search framework that handles all retrieval scenarios across image, text, and their combinations. Our work makes three key contributions. First, we propose a flexible architecture with a novel gated multimodal encoder that uses adaptive fusion mechanisms. This encoder integrates different modality representations while handling missing modalities. Second, we develop a comprehensive training strategy to optimize learning. It combines cross-modal alignment loss (CMAL), cohesive local alignment loss (CLAL), intra-modal contrastive loss (IMCL), and adaptive loss weighting. Third, we create M-BEER, a carefully curated multimodal benchmark containing 50K product pairs for e-commerce search evaluation. Extensive experiments demonstrate that UniECS consistently outperforms existing methods across four e-commerce benchmarks with fine-tuning or zero-shot evaluation. On our M-BEER bench, UniECS achieves substantial improvements in cross-modal tasks (up to 28% gain in R@10 for text-to-image retrieval) while maintaining parameter efficiency (0.2B parameters) compared to larger models like GME-Qwen2VL (2B) and MM-Embed (8B). Furthermore, we deploy UniECS in the e-commerce search platform of Kuaishou Inc. across two search scenarios, achieving notable improvements in Click-Through Rate (+2.74%) and Revenue (+8.33%). The comprehensive evaluation demonstrates the effectiveness of our approach in both experimental and real-world settings. Corresponding codes, models and datasets will be made publicly available at https://github.com/qzp2018/UniECS.
Zihan Liang 0001, Yufei Ma 0011, Zhipeng Qian, Huangyu Dai, Ben Chen 0004, Chenyi Lei, Yuqing Ding, Han Li 0005
CIKM7
2025 InfoGain-RAG: Boosting Retrieval-Augmented Generation through Document Information Gain-based Reranking and Filtering
abstract
Zihan Wang, Zihan Liang, Zhou Shao, Yufei Ma, Huangyu Dai, Ben Chen, Lingtao Mao, Chenyi Lei, Yuqing Ding, Han Li. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.
Zihan Liang 0001, Zhou Shao, Yufei Ma 0011, Huangyu Dai, Ben Chen 0004, Lingtao Mao, Chenyi Lei, Yuqing Ding, Han Li 0005
EMNLP8
2025 Mitigating Redundancy in Deep Recommender Systems: A Field Importance Distribution Perspective
abstract
In the realm of recommender systems, accurately predicting Click-Through Rate (CTR) is a critical task that involves learning user-item interaction features. Many researchers propose novel models to mine interaction signals, but they neglect that redundancy itself causes high computational cost and leads to suboptimal performance. Some tried to remove redundancy by dropping useless features, or shrinking the size of embedding table. However, current feature selection methods are vulnerable to training stochasticity and data dynamics, while embedding size assignment techniques neglect the importance relationships between feature fields. The simple combination of the two optimization ways will also yield poor performance due to the inherent gap in their optimization targets. Hence, there is no effective paradigm that can optimize feature fields from the two aspects in a simultaneous and coordinated way. In this paper, we identify the core issue as the lack of a practical score to measure the contribution of feature fields, and propose a distribution-based field optimization framework that adopts importance distribution to provide a comprehensive view for both methods. We innovatively design a learner for each field to acquire the stable and comprehensive importance situation. Then, based on this, we eliminate noise features, and assign adaptive embedding sizes for different feature fields according to the similarity of importance. With this field optimization, our proposed framework has extremely low pre-training overhead, greatly reduces training and inference time, and even achieves more accurate prediction results with fewer feature fields.
Xianquan Wang, Likang Wu, Zhi Li 0057, Haitao Yuan 0002, Shuanghong Shen, Huibo Xu, Yu Su 0002, Chenyi Lei
KDD (1)8
2025 Lasso: Large Language Model-based User Simulator for Cross-Domain Recommendation
Susen Yang, Chao Wang 0049, Mingyue Cheng 0004, Chenyi Lei, Han Li 0005
RecSys6
2024 Text-To-AMP: Antimicrobial Peptide Design Guided by Natural Text
abstract
Antimicrobial peptides (AMPs) are vital components of the natural immune system. With their broad-spectrum antibacterial properties, low resistance, and multifunctionality, they are considered important molecules for addressing the problem of bacterial resistance. At the same time, with the rapid development of large language models, their powerful intelligence has made natural language an increasingly important bridge for human-machine interaction, bringing new perspectives to AMP design. By integrating natural language with protein language, we can significantly reduce the complexity of tasks, enhance intuitiveness and operational convenience, and deeply incorporate expert knowledge, thus providing new insights for exploring and understanding peptide design. Based on these benefits, we propose Text-to-AMP, an innovative framework that uses natural language descriptions to directly guide AMP sequence generation. Through the integration of multimodal implicit alignment, explicit alignment, and autoregressive sequence generation, Text-to-AMP establishes a semantic connection between natural language and peptide sequences, enabling precise and interpretable peptide design. Comprehensive experimental evaluations demonstrate that our model outperforms baseline methods on most metrics in AMP activity prediction tasks. In zero-shot text-guided sequence generation tasks, the model surpasses benchmarks, including the GPT series, by generating novel peptide sequences with enhanced antimicrobial activity and reduced toxicity. Furthermore, case studies validate the model’s capability to meet fine-grained structural and functional design criteria. In conclusion, Text-to-AMP introduces a advanced paradigm for AMP design by significantly lowering technical barriers and accelerating the discovery of antimicrobial peptides.
Alexander Teng, Yiyao Yu, Chenyi Lei, Zhangyang Gao, Cheng Tan 0012
BIBM6
2024 GradCraft: Elevating Multi-task Recommendations through Holistic Gradient Crafting
abstract
Recommender systems require the simultaneous optimization of multiple objectives to accurately model user interests, necessitating the application of multi-task learning methods. However, existing multi-task learning methods in recommendations overlook the specific characteristics of recommendation scenarios, falling short in achieving proper gradient balance. To address this challenge, we set the target of multi-task learning as attaining the appropriate magnitude balance and the global direction balance, and propose an innovative methodology named GradCraft in response. GradCraft dynamically adjusts gradient magnitudes to align with the maximum gradient norm, mitigating interference from gradient magnitudes for subsequent manipulation. It then employs projections to eliminate gradient conflicts in directions while considering all conflicting tasks simultaneously, theoretically guaranteeing the global resolution of direction conflicts. GradCraft ensures the concurrent achievement of appropriate magnitude balance and global direction balance, aligning with the inherent characteristics of recommendation scenarios. Both offline and online experiments attest to the efficacy of GradCraft in enhancing multi-task performance in recommendations. The source code for GradCraft can be accessed at https://github.com/baiyimeng/GradCraft.
Yimeng Bai, Yang Zhang 0072, Fuli Feng, Xiaoxue Zang, Chenyi Lei, Yang Song 0008
KDD6
2023 Self-Supervised Interest Transfer Network via Prototypical Contrastive Learning for Recommendation
abstract
Cross-domain recommendation has attracted increasing attention from industry and academia recently. However, most existing methods do not exploit the interest invariance between domains, which would yield sub-optimal solutions. In this paper, we propose a cross-domain recommendation method: Self-supervised Interest Transfer Network (SITN), which can effectively transfer invariant knowledge between domains via prototypical contrastive learning. Specifically, we perform two levels of cross-domain contrastive learning: 1) instance-to-instance contrastive learning, 2) instance-to-cluster contrastive learning. Not only that, we also take into account users' multi-granularity and multi-view interests. With this paradigm, SITN can explicitly learn the invariant knowledge of interest clusters between domains and accurately capture users' intents and preferences. We conducted extensive experiments on a public dataset and a large-scale industrial dataset collected from one of the world's leading e-commerce corporations. The experimental results indicate that SITN achieves significant improvements over state-of-the-art recommendation methods. Additionally, SITN has been deployed on a micro-video recommendation platform, and the online A/B testing results further demonstrate its practical value. Supplement is available at: https://github.com/fanqieCoffee/SITN-Supplement.
Yibin Shen, Sijin Zhou, Xiang Chen 0017, Hongyan Liu 0001, Chunming Wu 0001, Chenyi Lei, Xianhui Wei, Fei Fang 0002
AAAI7
2022 Scenario-Adaptive and Self-Supervised Model for Multi-Scenario Personalized Recommendation
abstract
Multi-scenario recommendation is dedicated to retrieve relevant items for users in multiple scenarios, which is ubiquitous in industrial recommendation systems. These scenarios enjoy portions of overlaps in users and items, while the distribution of different scenarios is different. The key point of multi-scenario modeling is to efficiently maximize the use of whole-scenario information and granularly generate adaptive representations both for users and items among multiple scenarios. we summarize three practical challenges which are not well solved for multi-scenario modeling: (1) Lacking of fine-grained and decoupled information transfer controls among multiple scenarios. (2) Insufficient exploitation of entire space samples. (3) Item's multi-scenario representation disentanglement problem. In this paper, we propose a Scenario-Adaptive and Self-Supervised (SASS) model to solve the three challenges mentioned above. Specifically, we design a Multi-Layer Scenario Adaptive Transfer (ML-SAT) module with scenario-adaptive gate units to select and fuse effective transfer information from whole scenario to individual scenario in a quite fine-grained and decoupled way. To sufficiently exploit the power of entire space samples, a two-stage training process including pre-training and fine-tune is introduced. The pre-training stage is based on a scenario-supervised contrastive learning task with the training samples drawn from labeled and unlabeled data spaces. The model is created symmetrically both in user side and item side, so that we can get distinguishing representations of items in different scenarios. Extensive experimental results on public and industrial datasets demonstrate the superiority of the SASS model over state-of-the-art methods. This model also achieves more than 8.0% improvement on Average Watching Time Per User in online A/B tests. SASS has been successfully deployed on multi-scenario short video recommendation platform of Taobao in Alibaba.
Yuanliang Zhang, Jinxin Hu, Chenyi Lei, Fei Fang 0002
CIKM5
2022 Enhancing Sequential Recommendation with Graph Contrastive Learning
abstract
The sequential recommendation systems capture users' dynamic behavior patterns to predict their next interaction behaviors. Most existing sequential recommendation methods only exploit the local context information of an individual interaction sequence and learn model parameters solely based on the item prediction loss. Thus, they usually fail to learn appropriate sequence representations. This paper proposes a novel recommendation framework, namely Graph Contrastive Learning for Sequential Recommendation (GCL4SR). Specifically, GCL4SR employs a Weighted Item Transition Graph (WITG), built based on interaction sequences of all users, to provide global context information for each interaction and weaken the noise information in the sequence data. Moreover, GCL4SR uses subgraphs of WITG to augment the representation of each interaction sequence. Two auxiliary learning objectives have also been proposed to maximize the consistency between augmented representations induced by the same interaction sequence on WITG, and minimize the difference between the representations augmented by the global context on WITG and the local representation of the original sequence. Extensive experiments on real-world datasets demonstrate that GCL4SR consistently outperforms state-of-the-art sequential recommendation methods.
Yong Liu 0020, Chenyi Lei, Wei He 0020, Li-Zhen Cui 0001, Chunyan Miao
IJCAI5
2022 CoHOZ: Contrastive Multimodal Prompt Tuning for Hierarchical Open-set Zero-shot Recognition
abstract
Practical image recognition often encounters samples whose labels either are totally unknown or belong to new classes outside the training set. The first problem refers to the open-set recognition (OSR), in which unknown classes are recognized as one with no more semantic information. While the latter is called zero-shot learning (ZSL), in which new classes are usually predefined. The existing literature mostly addresses these two problems separately. In this paper, we take the ambition for solving the combination of these two problems to fulfill semantically recognizing the unknown classes detected in OSR by zero-shot prediction. We propose the Contrastive multimodal prompt tuning for Hierarchical Open-set Zero-shot recognition (CoHOZ). Specifically, we firstly build a global and compatible hierarchical label tree with all downstream datasets aligned, which lays foundations for other modules. To detect unknown classes, we propose the contrastive continuous prompt tuning, which introduces additional negative classes from the fine level of the built hierarchy for prompt learning. To generate candidate classes for zero-shot prediction on the unknown data using prompt, we combine the built hierarchy to collect candidate classes from coarse to fine. In our experiments, when following the standard OSR protocol regarding all the unknown classes as a single class, CoHOZ achieves a new state-of-the-art performance both in unknown detection and open-set recognition. Few-shot tuning by the CoHOZ also shows competitive performance on them. In addition, the detailed semantic information of unknown classes are well explored, which has also been verified in experiments.
Ning Liao, Chenyi Lei, Guoxin Wang 0002, Xian-Sheng Hua 0001, Junchi Yan
ACM Multimedia4
2022 E-Commerce Storytelling Recommendation Using Attentional Domain-Transfer Network and Adversarial Pre-Training
abstract
In e-commerce platforms, there is an emerging type of content that tells a “story” about some merchandise in the form of multimedia (text, images, video), which is namedstorytelling. Well told stories, like advertisements, can inspire users to purchase the related products. Thus, e-commerce service provider is keen to disseminate storytelling items to potentially interested users. We address this requirement by a cross-domain personalized recommendation approach. Because storytelling is a new type of content, its related user actions are much less, more sparse than product-related user actions, thus we propose to use product-domain user actions to assist the identification of user preferences and to make storytelling recommendations. Our method has two technical contributions. First, since the user behavior patterns are different across the storytelling domain and the product domain, we propose an attentional domain-transfer network, which effectively selects the relevant items in the two domains to characterize user preferences. Second, although storytelling is about product, between the two domains there is a large gap: product description is objective and categorical, like “keywords,” but storytelling is close to human language. To bridge the domain gap, we propose a dual-domain contrastive adversarial learning method to pre-train the feature extractors for storytelling and product simultaneously. We conduct experiments on two industrial datasets, and the results demonstrate the advantage of our proposed method that consistently outperforms the state-of-the-art methods. Besides, our method can be used to recommend storytelling to products, which is a desired functionality for product providers. Our code and models are publicly available.
Xusong Chen, Chenyi Lei, Dong Liu 0002, Guoxin Wang 0002, Haihong Tang, Zhengjun Zha, Houqiang Li
IEEE Trans. Multim.2
2021 SEMI: A Sequential Multi-Modal Information Transfer Network for E-Commerce Micro-Video Recommendations
abstract
The micro-video recommendation system becomes an essential part of the e-commerce platform, which helps disseminate micro-videos to potentially interested users. Existing micro-video recommendation methods only focus on users' browsing behaviors on micro-videos, but ignore their purchasing intentions in the e-commerce environment. Thus, they usually achieve unsatisfied e-commerce micro-video recommendation performances. To address this problem, we design a sequential multi-modal information transfer network (SEMI), which utilizes product-domain user behaviors to assist micro-video recommendations. SEMI effectively selects relevant items (i.e., micro-videos and products) with multi-modal features in the micro-video domain and product domain to characterize users' preferences. Moreover, we also propose a cross-domain contrastive learning (CCL) algorithm to pre-train sequence encoders for modeling users' sequential behaviors in these two domains. The objective of CCL is to maximize a lower bound of the mutual information between different domains. We have performed extensive experiments on a large-scale dataset collected from Taobao, a world-leading e-commerce platform. Experimental results show that the proposed method achieves significant improvements over state-of-the-art recommendation methods. Moreover, the proposed method has also been deployed on Taobao, and the online A/B testing results further demonstrate its practical value.
Chenyi Lei, Yong Liu 0020, Lingzi Zhang, Guoxin Wang 0002, Haihong Tang, Houqiang Li, Chunyan Miao
KDD1
2021 Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training
abstract
The pre-trained neural models have recently achieved impressive performance in understanding multimodal content. However, it is still very challenging to pre-train neural models for video and language understanding, especially for Chinese video-language data, due to the following reasons. Firstly, existing video-language pre-training algorithms mainly focus on the co-occurrence of words and video frames, but ignore other valuable semantic and structure information of video-language content, e.g., sequential order and spatiotemporal relationships. Secondly, there exist conflicts between video sentence alignment and other proxy tasks. Thirdly, there is a lack of large-scale and high-quality Chinese video-language datasets (eg. including 10 million unique videos), which are the fundamental success conditions for pre-training techniques. In this work, we propose a novel video-language understanding framework named Victor, which stands for VIdeo-language understanding via Contrastive mulTimOdal pRe-training. Besides general proxy tasks such as masked language modeling, Victor constructs several novel proxy tasks under the contrastive learning paradigm, making the model be more robust and able to capture more complex multimodal semantic and structural relationships from different perspectives. Victor is trained on a large-scale Chinese video-language dataset, including over 10 million complete videos with corresponding high-quality textual descriptions. We apply the pre-trained Victor model to a series of downstream applications and demonstrate its superior performance, comparing against the state-of-the-art pre-training methods such as VideoBERT and UniVL.
Chenyi Lei, Shixian Luo, Yong Liu 0020, Wanggui He, Jiamang Wang, Guoxin Wang 0002, Haihong Tang, Chunyan Miao, Houqiang Li
ACM Multimedia1
2021 Pre-training Graph Transformer with Multimodal Side Information for Recommendation
abstract
Side information of items, e.g., images and text description, has shown to be effective in contributing to accurate recommendations. Inspired by the recent success of pre-training models on natural language and images, we propose a pre-training strategy to learn item representations by considering both item side information and their relationships. We relate items by common user activities, e.g., co-purchase, and construct a homogeneous item graph. This graph provides a unified view of item relations and their associated side information in multimodality. We develop a novel sampling algorithm named MCNSampling to select contextual neighbors for each item. The proposed Pre-trained Multimodal Graph Transformer (PMGT) learns item representations with two objectives: 1) graph structure reconstruction, and 2) masked node feature reconstruction. Experimental results on real datasets demonstrate that the proposed PMGT model effectively exploits the multimodality side information to achieve better accuracies in downstream tasks including item recommendation and click-through ratio prediction. In addition, we also report a case study of testing PMGT in an online setting with 600 thousand users.
Yong Liu 0020, Susen Yang, Chenyi Lei, Guoxin Wang 0002, Haihong Tang, Juyong Zhang, Aixin Sun, Chunyan Miao
ACM Multimedia3
2020 Multi-Question Learning for Visual Question Answering
abstract
Visual Question Answering (VQA) raises a great challenge for computer vision and natural language processing communities. Most of the existing approaches consider video-question pairs individually during training. However, we observe that there are usually multiple (either sequentially generated or not) questions for the target video in a VQA task, and the questions themselves have abundant semantic relations. To explore these relations, we propose a new paradigm for VQA termed Multi-Question Learning (MQL). Inspired by the multi-task learning, MQL learns from multiple questions jointly together with their corresponding answers for a target video sequence. The learned representations of video-question pairs are then more general to be transferred for new questions. We further propose an effective VQA framework and design a training procedure for MQL, where the specifically designed attention network models the relation between input video and corresponding questions, enabling multiple video-question pairs to be co-trained. Experimental results on public datasets show the favorable performance of the proposed MQL-VQA framework compared to state-of-the-arts.
Chenyi Lei, Lei Wu 0017, Dong Liu 0002, Zhao Li 0007, Guoxin Wang 0002, Haihong Tang, Houqiang Li
AAAI1
2020 Attention with Long-Term Interval-Based Gated Recurrent Units for Modeling Sequential User Behaviors
Zhao Li 0007, Chenyi Lei, Pengcheng Zou, Donghui Ding, Shichang Hu, Zehong Hu, Shouling Ji, Jianliang Gao
DASFAA (1)2
2019 BERT4SessRec: Content-Based Video Relevance Prediction with Bidirectional Encoder Representations from Transformer
abstract
This paper describes our solution for the Content-Based Video Relevance Prediction (CBVRP) challenge, where the task is to predict user click-through behavior on new TV series or new movies according to the user's historical behavior. We consider the task as a session-based recommendation problem and we focus on the modeling of the session. Thus, we use the Bidirectional Encoder Representations from Transformer (BERT) methodology and propose a BERT for session-based recommendation (BERT4SessRec) method. Our method has two stages: in the pre-training stage, we use all sessions as training data and train the bidirectional session encoder with the masking trick; in the fine-tuning stage, we use the provided click-through data and train the click-through prediction network. Our method achieves session representations with the help of BERT, which effectively captures the bidirectional correlation in each session. In addition, the pre-training stage makes full use of all sessions, overcoming the positive-negative imbalance problem of the click-through data. We report the results of using different kinds of features on the test set of the challenge, which verify the effectiveness of our method.
Xusong Chen, Dong Liu 0002, Chenyi Lei, Zhengjun Zha, Zhiwei Xiong
ACM Multimedia3
2019 TiSSA: A Time Slice Self-Attention Approach for Modeling Sequential User Behaviors
abstract
Modeling user behaviors as sequences provides critical advantages in predicting future user actions, such as predicting the next product to purchase or the next song to listen to, for personalized search and recommendation. Recently, recurrent neural networks (RNNs) have been adopted to leverage their power in modeling sequences. However, most of the previous RNN-based work suffers from the complex dependency problem, which may lose the integrity of highly correlated behaviors and may introduce noises derived from unrelated behaviors. In this paper, we propose to integrate a novel Time Slice Self-Attention (TiSSA) mechanism into RNNs for better modeling sequential user behaviors, which utilizes the time-interval-based gated recurrent units to exploit the temporal dimension when encoding user actions, and has a specially designed time slice hierarchical self-attention function to characterize both local and global dependency of user actions, while the final context-aware user representations can be used for downstream applications. We have performed experiments on a huge dataset collected from one of the largest e-commerce platforms in the world. Experimental results show that the proposed TiSSA achieves significant improvement over the state-of-the-art. TiSSA is also adopted in this large e-commerce platform, and the results of online A/B test further indicate its practical value.
Chenyi Lei, Shouling Ji, Zhao Li 0007
WWW1
2016 Comparative Deep Learning of Hybrid Representations for Image Recommendations
abstract
In many image-related tasks, learning expressive and discriminative representations of images is essential, and deep learning has been studied for automating the learning of such representations. Some user-centric tasks, such as image recommendations, call for effective representations of not only images but also preferences and intents of users over images. Such representations are termed hybrid and addressed via a deep learning approach in this paper. We design a dual-net deep network, in which the two sub-networks map input images and preferences of users into a same latent semantic space, and then the distances between images and users in the latent space are calculated to make decisions. We further propose a comparative deep learning (CDL) method to train the deep network, using a pair of images compared against one user to learn the pattern of their relative distances. The CDL embraces much more training data than naive deep learning, and thus achieves superior performance than the latter, with no cost of increasing network complexity. Experimental results with real-world data sets for image recommendations have shown the proposed dual-net network and CDL greatly outperform other state-of-the-art image recommendation solutions.
Chenyi Lei, Dong Liu 0002, Weiping Li 0003, Zhengjun Zha, Houqiang Li
CVPR1
2016 Social Diffusion Analysis With Common-Interest Model for Image Annotation
abstract
Automatic image annotation has been extensively studied, mostly from a content-based approach, whose effectiveness is restricted by the “semantic gap” between low-level image features and semantic annotations, and by the irrelevance of annotations to image content. We propose a social diffusion analysis approach to image annotation, which exploits abundant social diffusion records about how images are disseminated within online social networks. Specifically, we propose a common-interest model to analyze social diffusion records, with the assumption that the diffusion pattern of an image in social networks is highly related to the relevance between image annotations and user preferences. In our proposed model, user preferences are represented as common interests of pairwise users instead of individual user interests. We find the notion of common interests not only facilitates the analysis of social diffusion patterns, but also leads to more accurate profiling of user preferences compared to individual interests. Based on the common-interest model, we design an image annotation framework via social diffusion analysis, which consists of the mining of common interests from social diffusion records, the feature extraction from diffusion graphs and common interests, and the automatic annotation by the learning-to-rank method. Experimental results on real-world data sets show that our proposed common-interest based approach outperforms individual-interest based methods, and also achieves superior performance than state-of-the-art content-based image annotation methods.
Chenyi Lei, Dong Liu 0002, Weiping Li 0003
IEEE Trans. Multim.1