Short videos have gained immense popularity, necessitating effective recommender systems that cater to individual preferences. The platforms use advanced algorithms to analyze user engagement and provide videos that satisfy users. A critical factor in user satisfaction is immersion , defined as the feeling of being deeply engaged in an activity. However, existing recommendation algorithms in the short video scenario have largely disregarded user immersion. Our study integrates user immersion into recommendation systems, aiming to predict immersion from user interactions and recommend items to enhance the overall viewing experience. Based on the user study of collecting and analyzing user immersion, we integrate immersion into the recommendations for both lab and large-scale scenarios. We adapt user-annotated immersion to large-scale real-world datasets without immersion labels. Specifically, we propose ImmersRec , an immersion-aware recommendation framework with immersion prediction fine-tuning, immersion knowledge alignment, and immersion-enhanced recommendation. Extensive experiments on two short video platforms indicate that our approach achieves significant enhancements among various context-aware recommender backbones. We investigate the predicted immersion and find it impacts not only short-term utility but also long-term user engagement. This research pioneers the incorporation of user immersion in short video recommendation algorithms, emphasizing its potential for improving recommendations with minimal data. The code can be available at https://github.com/hezy18/ImmersRec .

The rapid growth of short videos has necessitated effective recommender systems to match users with content tailored to their evolving preferences. Current video recommendation models primarily treat each video as a whole, overlooking the dynamic nature of user preferences with specific video segments. In contrast, our research focuses on segment-level user interest modeling, which is crucial for understanding how users' preferences evolve during video browsing. To capture users' dynamic segment interests, we propose an innovative model that integrates a hybrid representation module, a multi-modal user-video encoder, and a segment interest decoder. Our model addresses the challenges of capturing dynamic interest patterns, missing segment-level labels, and fusing different modalities, achieving precise segment-level interest prediction.

With an increasing number of music tracks available online, music recommender systems have become popular and ubiquitous. Previous research indicates that people’s preferences, especially in music, dynamically change with various factors, such as surrounding situations and emotional status. However, few existing public recommendation datasets contain such situation or emotion information. Therefore, we constructed SiTunes, a situational music recommendation dataset with rich physiological and psychological signals. We collected the data through a three-stage user study, including: (1) recorded users’ inherent music preference in a lab setting (Stage 1), (2) recorded physiological and environmental situations by smart wristband devices in users’ daily life, and provided psychological and rating feedback for music recommended by traditional recommenders (Stage 2) and (3) by situation-aware recommenders (Stage 3). The experiments were conducted with strict privacy concerns and ethical approval. The dataset contains over 2000 listening logs from 30 users on over 300 music tracks. SiTunes serves as a valuable resource for future studies on situational recommenders and user understanding in recommendation. The dataset is available at https://github.com/JiayuLi-997/SiTunes_dataset/.

With the applications of recommendation systems rapidly expanding, an increasing number of studies have focused on every aspect of recommender systems with different data inputs, models, and task settings. Therefore, a flexible library is needed to help researchers implement the experimental strategies they require. Existing open libraries for recommendation scenarios have enabled reproducing various recommendation methods and provided standard implementations. However, these libraries often impose certain restrictions on data and seldom support the same model to perform different tasks and input formats, limiting users from customized explorations. To fill the gap, we propose ReChorus2.0, a modular and task-flexible library for recommendation researchers. Based on ReChorus, we upgrade the supported input formats, models, and training&evaluation strategies to help realize more recommendation tasks with more data types. The main contributions of ReChorus2.0 include: (1) Realization of complex and practical tasks, including re-ranking and CTR prediction tasks; (2) Inclusion of various context-aware and re-ranking recommenders; (3) Extension of existing and new models to support different tasks with the same models; (4) Support of highly-customized input with impression logs, negative items, or click labels, as well as user, item, and situation contexts. To summarize, ReChorus2.0 serves as a comprehensive and flexible library that better addresses the practical problems in the recommendation scenario and caters to more diverse research needs. The implementation and detailed tutorials of ReChorus2.0 can be found at https://github.com/THUwangcy/ReChorus.

In recent years, short video platforms have gained widespread popularity, making the quality of video recommendations crucial for retaining users. Existing recommendation systems primarily rely on behavioral data, which faces limitations when inferring user preferences due to issues such as data sparsity and noise from accidental interactions or personal habits. To address these challenges and provide a more comprehensive understanding of user affective experience and cognitive activity, we propose EEG-SVRec, the first EEG dataset with User Multidimensional Affective Engagement Labels in Short Video Recommendation. The study involves 30 participants and collects 3,657 interactions, offering a rich dataset that can be used for a deeper exploration of user preference and cognitive activity. By incorporating self-assessment techniques and real-time, low-cost EEG signals, we offer a more detailed understanding user affective experiences (valence, arousal, immersion, interest, visual and auditory) and the cognitive mechanisms behind their behavior. We establish benchmarks for rating prediction by the recommendation algorithm, showing significant improvement with the inclusion of EEG signals. Furthermore, we demonstrate the potential of this dataset in gaining insights into the affective experience and cognitive activity behind user behaviors in recommender systems. This work presents a novel perspective for enhancing short video recommendation by leveraging the rich information contained in EEG signals and multidimensional affective engagement scores, paving the way for future research in short video recommendation systems.

Short video~(SV) online streaming has been one of the most popular Internet applications in recent years. When browsing SVs, users gradually immerse themselves and derive relaxation or knowledge. Whereas prolonged browsing will lead to a decline in positive feelings, users continue due to inertia, resulting in decreased satisfaction. Immersion is shown to be an essential factor for users' positive experience and highly related to users' interactions in film, games, and virtual reality. However, immersion in SV interaction is still unexplored, which differs from the previously studied scenarios essentially because SV delivery is fragmented, discrete, and with limited time for each video.

In recent years, context information has played an increasingly significant role in recommendation systems. With the rapid growth of portable sensor devices, lifelog data, such as mood, location, and daily activity, has been recorded and used for ubiquitous recommendation tasks. However, since the multi-modal lifelog data contains objective context information and subjective user labeling, it is challenging to record the lifelog thoroughly and perform personalized recommendations in real-time. In this work, we design a mobile application (App), LifeRec, to record multi-modal lifelog data and perform personalized recommendations by communicating with the remote server. The App helps users collect various lifelog information (e.g., location, diet, activity, and mood) and receive real-time recommendation with privacy protection and little effort. It is useful for lifelog data collection, user status monitoring, and various ubiquitous recommendation tasks. We examine LifeRec in a one-week field study with seven subjects. The users’ experience feedback and recording results show great usability and task completeness with our App.