An Action-Aware Generative Sequence Modeling for Short Video Recommendation
Abstract
With the rapid development of the Internet, users have increasingly higher expectations for the recommendation accuracy of online content consumption platforms (e.g., short video platforms). However, short videos often contain diverse segments, and users may not hold the same attitude toward all of them (e.g., music enthusiasts may not enjoy all songs in a medley). Traditional binary-classification recommendation models, which treat a video as a single holistic entity, face limitations in accurately capturing such nuanced preferences. Considering that user consumption is a temporal process, this paper demonstrates that the timing of user actions can represent diverse intentions through statistical analysis and examination of action patterns. Based on this insight, we propose a novel modeling paradigm: Action-Aware Gen erative Sequence Network (A2Gen ), which refines user actions (e.g., Like and Follow, etc.) along the temporal dimension and chains them into sequences for unified processing and prediction. First, we introduce the Context-aware Attention Module (CAM) to model action sequences enriched with item-specific contextual features. Building upon this, we develop the Hierarchical Sequence Encoder (HSE) to learn temporal action patterns from users' historical actions. Finally, through leveraging CAM, we design a module for action sequence generation: the Action-seq Autoregressive Generator (AAG). Extensive offline experiments on the Kuaishou's dataset and the Tmall public dataset demonstrate the superiority of our proposed model. Furthermore, through large-scale online A/B testing deployed on Kuaishou's platform, our model achieves significant improvements over baseline methods in multi-task prediction by leveraging sequential information. Specifically, it yields increases of 0.34% in user watch time, 8.1% in interaction rate, and 0.162% in overall user retention (LifeTime-7), leading to successful deployment across all traffic, serving over 400 million users every day.
Assigned reviewers
| # | Reviewer | Match | Why (closest evidence publications in the taxonomy) | |
|---|---|---|---|---|
| 1 | Qiang Luo 0004 | 57 | 72 MPFormer: Adaptive Framework for Industrial Multi-Task Personalized Sequential Retriever (2025) Multi-Task and Multi-Objective Optimization 62 DiffGRM: Diffusion-based Generative Recommendation Model (2026) Diffusion and Flow Recommenders 60 OneLoc: Geo-Aware Generative Recommender Systems for Local Life Service (2026) Item Tokenization and Semantic IDs |
|
| 2 | Yang Song 0008 | 54 | 63 When Search Meets Recommendation: Learning Disentangled Search Representation for Recommendation (2023) Search and Recommendation Integration 62 Learning and Optimization of Implicit Negative Feedback for Industrial Short-video Recommender System (2023) Multi-Behavior and Multi-Interest Sequential Recommendation 62 Understanding and Modeling Passive-Negative Feedback for Short-video Sequential Recommendation (2023) Multi-Behavior Recommendation |
|
| 3 | Wei Guo 0006 | 53 | 64 Killing Two Birds with One Stone: Unifying Retrieval and Ranking with a Single Generative Recommendation Model (2025) Generative Retrieval and Ranking 61 Multi-Behavior Sequential Transformer Recommender (2022) Multi-Behavior and Multi-Interest Sequential Recommendation 59 Full Retraining, Incremental Fine-tuning, and Hybrid Serving: Model Updating and Serving for Industrial Generative Recommender Systems (2026) Generative Retrieval and Ranking |
Area chair
| Area chair | Match | |
|---|---|---|
| Yanan Niu | 58 |
Area-chair candidates (7)
| Yanan Niu assigned | 58 | 15 papers | |
| Kun Gai | 57 | 5 papers | |
| Xin Xin 0003 | 54 | 10 papers | |
| Leyu Lin COI: co-author | 53 | 15 papers | |
| Maolin Wang 0001 | 48 | 15 papers | |
| Xiaoyi Zeng | 48 | 11 papers | |
| Weiming Liu 0005 | 47 | 8 papers |
Candidates from the panel ranked by match score
| # | Reviewer | Match | Load | Why | |
|---|---|---|---|---|---|
| 1 | Fei Sun 0001 COI: co-author | 62 | 3 | 64 Contrastive Learning for Sequential Recommendation (2022) Contrastive and Self-Supervised Sequential Recommendation 63 LoRec: Combating Poisons with Large Language Model for Robust Sequential Recommendation (2024) Robustness to Noise and Distribution Shift |
|
| 3 | Qiang Luo 0004 assigned | 57 | 3 | 72 MPFormer: Adaptive Framework for Industrial Multi-Task Personalized Sequential Retriever (2025) Multi-Task and Multi-Objective Optimization 62 DiffGRM: Diffusion-based Generative Recommendation Model (2026) Diffusion and Flow Recommenders |
|
| 5 | Lantao Hu COI: co-author | 55 | 3 | 65 Modeling User Fatigue for Sequential Recommendation (2024) Contrastive and Self-Supervised Sequential Recommendation 65 MODEM: Decoupling User Behavior for Shared-Account Video Recommendations on Large Screen Devices (2024) Graph Contrastive and Self-Supervised Learning |
|
| 7 | Jianling Wang | 54 | 3 | 64 Learning to Augment for Casual User Recommendation (2022) Contrastive and Self-Supervised Sequential Recommendation 58 A Hierarchical Self-Attentive Model for Recommending User-Generated Item Lists (2019) Efficient and Long-Sequence Sequential Recommendation |
|
| 8 | Bo Peng 0009 | 54 | 3 | 58 M2: Mixed Models With Preferences, Popularities and Transitions for Next-Basket Recommendation (2023) Efficient and Long-Sequence Sequential Recommendation 57 Multi-modality meets re-learning: mitigating negative transfer in sequential recommendation (2025) Sequential Recommendation with Side and Multimodal Information |
|
| 9 | Hao Deng 0011 | 54 | 3 | 64 RCLRec: Reverse Curriculum Learning for Modeling Sparse Conversions in Generative Recommendation (2026) Generative Retrieval and Ranking 64 REG4Rec: Reasoning-Enhanced Generative Model for Large-Scale Recommendation Systems (2026) Item Tokenization and Semantic IDs |
|
| 10 | Yang Song 0008 assigned | 54 | 3 | 63 When Search Meets Recommendation: Learning Disentangled Search Representation for Recommendation (2023) Search and Recommendation Integration 62 Learning and Optimization of Implicit Negative Feedback for Industrial Short-video Recommender System (2023) Multi-Behavior and Multi-Interest Sequential Recommendation |
|
| 11 | Wei Guo 0006 assigned | 53 | 3 | 64 Killing Two Birds with One Stone: Unifying Retrieval and Ranking with a Single Generative Recommendation Model (2025) Generative Retrieval and Ranking 61 Multi-Behavior Sequential Transformer Recommender (2022) Multi-Behavior and Multi-Interest Sequential Recommendation |
|
| 13 | Hao Liu 0078 | 53 | 3 | 61 Mitigating Distribution Shifts in Sequential Recommendation: An Invariance Perspective (2025) Contrastive and Self-Supervised Sequential Recommendation 51 WeaveRec: An LLM-Based Cross-Domain Sequential Recommendation Framework with Model Merging (2026) Efficiency and Deployment |
|
| 14 | Bowen Zheng 0005 | 53 | 3 | 60 Generative Recommender with End-to-End Learnable Item Tokenization (2025) Item Tokenization and Semantic IDs 54 Reciprocal Sequential Recommendation (2023) Sequential Recommendation with User Modeling and Profiling |
|
| 15 | Qijiong Liu | 53 | 3 | 74 Accelerating Generative Recommendation via Simple Categorical User Sequence Compression (2026) Generative Retrieval and Recommendation Architectures 73 RecBase: Generative Foundation Model Pretraining for Zero-Shot Recommendation (2025) Generative Retrieval and Recommendation Architectures |
|
| 16 | Shuchang Liu 0001 COI: co-author | 52 | 3 | 73 Fading to Grow: Growing Preference Ratios via Preference Fading Discrete Diffusion for Recommendation (2025) Diffusion and Flow Recommenders 61 Distinguished Quantized Guidance for Diffusion-based Sequence Recommendation (2025) Diffusion and Flow Recommenders |
|
| 17 | Han Li 0005 COI: co-author | 51 | 3 | 76 OneSug: The Unified End-to-End Generative Framework for E-commerce Query Suggestion (2026) Recommendation with Search and Ranking 60 DiffusionGS: Generative Search with Query Conditioned Diffusion in Kuaishou (2026) Diffusion and Flow Recommenders |
|
| 18 | Yongxin Ni | 51 | 3 | 67 Bridging NIP and MLM: A Unified Meta-Learning Framework for Sequential Recommendation (2026) Meta-Learning for Cold-Start Recommendation 53 Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendation (2023) Multimodal Generative Recommendation |
|
| 19 | Jinxin Hu | 51 | 3 | 64 RCLRec: Reverse Curriculum Learning for Modeling Sparse Conversions in Generative Recommendation (2026) Generative Retrieval and Ranking 57 REG4Rec: Reasoning-Enhanced Generative Model for Large-Scale Recommendation Systems (2026) Item Tokenization and Semantic IDs |
|
| 20 | Xuanhua Yang | 51 | 3 | 73 Towards Personalized Bundle Creative Generation with Contrastive Non-Autoregressive Decoding (2022) Diffusion and Flow Recommenders 59 GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendation (2026) Generative Retrieval and Ranking |
|
| 21 | Jieming Zhu | 51 | 3 | 73 EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration (2024) Item Tokenization and Semantic IDs 54 FANS: Fast Non-Autoregressive Sequence Generation for Item List Continuation (2023) Efficient and Long-Sequence Sequential Recommendation |
|
| 22 | Yongjing Hao | 51 | 3 | 64 Feature-Level Deeper Self-Attention Network With Contrastive Learning for Sequential Recommendation (2023) Contrastive and Self-Supervised Sequential Recommendation 59 Learnable Model Augmentation Contrastive Learning for Sequential Recommendation (2024) Contrastive and Self-Supervised Sequential Recommendation |
|
| 23 | Chunyang Wang 0001 | 50 | 3 | 57 MESA: Plugin Meta-Modulation for Transformer-Based Cold-Start Sequential Recommendation (2026) Sequential Recommendation with User Modeling and Profiling 54 Contrastive Multi-view Interest Learning for Cross-domain Sequential Recommendation (2024) Graph Contrastive and Self-Supervised Learning |
|
| 24 | Jiangxia Cao | 50 | 3 | 59 From Agnostic to Specific: Latent Preference Diffusion for Multi-Behavior Sequential Recommendation (2026) Diffusion and Flow Recommenders 56 CDSRNP: Cross-Domain Sequential Recommendation via Neural Process (2025) Cross-Domain Sequential Recommendation |
|
| 25 | Xiao Zhang 0034 | 49 | 3 | 66 When Search Meets Recommendation: Learning Disentangled Search Representation for Recommendation (2023) Recommendation with Search and Ranking 60 GenSAR: Unifying Balanced Search and Recommendation with Generative Retrieval (2025) Recommendation with Search and Ranking |
|
| 26 | Chen Wang 0052 | 49 | 3 | 64 Confidence-Aware Fine-Tuning of Sequential Recommendation Systems Via Conformal Prediction (2025) Contrastive and Self-Supervised Sequential Recommendation 56 Cluster-Aware Item Prompt Learning for Session-Based Recommendation (2025) LLM-Enhanced Sequential Recommendation |
|
| 27 | Lichan Hong | 49 | 3 | 60 Recommender Systems with Generative Retrieval (2023) Item Tokenization and Semantic IDs 52 Enhancing Online Ranking Systems via Multi-Surface Co-Training for Content Understanding (2025) Content-Based Transferable Recommendation |
|
| 28 | Seongmin Park 0002 | 49 | 3 | 57 Temporal Linear Item-Item Model for Sequential Recommendation (2025) Efficient and Long-Sequence Sequential Recommendation 54 MergeRec: Model Merging for Data-Isolated Cross-Domain Sequential Recommendation (2026) Cross-Domain and Cross-Market Sequential Recommendation |
|
| 29 | Bo Chen 0023 | 49 | 3 | 70 Generative Representational Learning of Foundation Models for Recommendation (2026) Generative Retrieval and Ranking 52 ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation (2024) Sequential and Session-based Recommendation |
|
| 30 | Yupeng Hou | 49 | 3 | 65 Multi-Behavior Generative Recommendation (2024) Item Tokenization and Semantic IDs 64 Inductive Generative Recommendation via Retrieval-based Speculation (2026) Item Tokenization and Semantic IDs |
|
| 31 | Junwei Pan | 49 | 3 | 59 Cross-Scale Collaboration between LLMs and Lightweight Sequential Recommenders with Domain-Specific Latent Reasoning (2026) Generative Recommendation and Item Tokenization 54 Multi-Sequence Attentive User Representation Learning for Side-information Integrated Sequential Recommendation (2024) Sequential Recommendation with Side and Multimodal Information |
|
| 32 | Ke Wang 0038 | 49 | 3 | 65 Contrastive Multi-view Interest Learning for Cross-domain Sequential Recommendation (2024) Contrastive and Self-Supervised Sequential Recommendation 50 A Preference Learning Decoupling Framework for User Cold-Start Recommendation (2023) Meta-Learning for Cold-Start Recommendation |
|
| 34 | Ed H. Chi | 48 | 3 | 50 Zero-Shot Heterogeneous Transfer Learning from Recommender Systems to Cold-Start Search Retrieval (2020) Search and Recommendation Integration 50 Recommender Systems with Generative Retrieval (2023) Item Tokenization and Semantic IDs |
|
| 35 | Yong He 0009 | 48 | 3 | 50 Task Similarity Aware Meta Learning for Cold-Start Recommendation (2022) Meta-Learning for Cold-Start Recommendation 50 An Industrial Framework for Cold-Start Recommendation in Zero-Shot Scenarios (2022) Content and Attribute-Based Cold-Start Recommendation |