Recently, many efforts have been devoted to building effective sequential recommenders.Despite their effectiveness, these methods typically develop a single model to serve all users.However, our empirical studies reveal that different sequential encoders have intrinsic architectural biases and tend to focus on specific behavioral patterns, i.e., particular frequency range of user behavior sequences.For example, the Self-Attention module is essentially a low-pass filter, focusing on low-frequency information while neglecting the high-frequency details.This evidently limits their ability to capture diverse user patterns, leading to suboptimal recommendations.To tackle this problem, we present FamouSRec, a Frequency-Augmented Mixture-of-Heterogeneous-Experts Framework for personalized Recommendations.Our approach builds an MoEbased recommender system, integrating the strengths of various experts to achieve diversified user modeling.For developing the MoE framework, as the key to our approach, we instantiate experts with various model architectures, aiming to leverage their inherent architectural biases and capture diverse behavioral patterns.For selecting appropriate experts to serve individuals, we introduce a frequency-augmented router.It first identifies frequency components in user behavior sequences that are suited for expert encoding, and then conducts customized routing based on the informativeness of these components.Building on this framework, we further propose two novel contrastive tasks to enhance expert

With the widespread deployment of recommender systems on various online platforms, researchers are striving to develop transferable recommendation algorithms that can effectively adapt to new task scenarios without requiring the re-training of new recommenders. However, there have been challenges in dealing with explicit ID modeling in this context. Recently, researchers have drawn inspiration from the achievements of pre-trained language models (PLMs), making it possible to acquire ID-agnostic representations by utilizing the corresponding texts of items. These representations have shown to be transferable across diverse domains. However, while these methods demonstrate generalization, they are less proficient in making personalized recommendations as they learn universal representation. In light of this issue, we present a review-enhanced universal sequence representation learning approach named RUNSRec . Our goal is to not only comprehend universal user behavioral patterns across different domains but also capture their inherent preferences to make recommendations. Our approach makes three technical advancements toward this objective. Firstly, we introduce a lightweight item encoding architecture based on parametric whitening and mixture-of-experts enhanced adapter. It learns discriminative item textual representations by encoding their corresponding identity text and review text, with a discriminative keyword extraction method to enhance the representation identifiability. Secondly, we propose a universal sequence representation learning method that enables the training of transferable recommenders across diverse domains, based on two novel contrastive learning tasks. Furthermore, we introduce a personalized adapter tuning mechanism that enables the universal recommender to capture user personal preferences in a parameter-efficient way. By incorporating universal behavioral patterns learned during the pre-training stage and personalized user tastes captured through adapter tuning, our approach achieves a better balance between generalization and personalization in transferable recommender systems. Extensive experiments conducted on five real-world datasets have demonstrated the effectiveness of our proposed approach.

Next-basket Recommendation (NBR) refers to the task of predicting a set of items that a user will purchase in the next basket. However, most of existing works merely focus on the correlations between user preferences and predicted items, ignoring the essential correlations among items in the next basket, which often results in over-homogenization of predicted items. In this work, we presents a Generative next-basket Recommendation model (GenRec), a novel NBR paradigm that generates the recommended items one by one to form the next basket via an autoregressive decoder. This generative NBR paradigm contributes to capturing and considering item correlations inside each baskets in both training and serving. Moreover, we jointly consider user’s both item- and basket-level contextual information to better capture user’s multi-granularity preferences. Extensive experiments on three real-world datasets demonstrate the effectiveness of our model.

In order to support the study of recent advances in recommender systems, this paper presents an extended recommendation library consisting of eight packages for up-to-date topics and architectures. First of all, from a data perspective, we consider three important topics related to data issues (ie sparsity, bias and distribution shift ), and develop five packages accordingly, including meta-learning, data augmentation, debiasing, fairness and cross-domain recommendation. Furthermore, from a model perspective, we develop two benchmarking packages for Transformer-based and graph neural network~(GNN)-based models, respectively. All the packages (consisting of 65 new models) are developed based on a popular recommendation framework RecBole, ensuring that both the implementation and interface are unified. For each package, we provide complete implementations from data loading, experimental setup, evaluation and algorithm implementation. This library provides a valuable resource to facilitate the up-to-date research in recommender systems. The project is released at the link: \urlhttps://github.com/RUCAIBox/RecBole2.0.