Graph Contrastive Learning (GCL) methods for recommendation learn representations by propagating signals over user-item interaction graphs. However, modeling these graphs with homogeneous edges can lead to semantic-structural misalignment, where information is exchanged between structurally adjacent but semantically dissimilar items, adversely affecting retrieval quality. Existing solutions typically rely on auxiliary encoders or additional supervision, increasing model complexity and training cost. We propose ACE (Affective Contrastive Embeddings), a framework that improves representation alignment by incorporating affective semantics into contrastive learning. ACE encodes the affective dimensions of valence and arousal as a topological prior, encouraging consistency between learned embeddings and an affective semantic space distilled from large language models. To operationalize this alignment, we introduce a Semantically Weighted Noise Contrastive Estimation (SW-NCE) loss that modulates contrastive gradients according to users' affective preferences. Experiments on Amazon, Last.fm, and SiTunes demonstrate that ACE consistently improves top-K retrieval performance over 11 baselines while reducing computational overhead. These results indicate that affective geometric alignment is an effective and efficient mechanism for enhancing graph-based retrieval models.

Graph models that manipulate the frequency spectrum of user-item interactions to separate preference signals from noise often report significant improvements, but concerns about evaluation rigor and reproducibility persist. We conduct a reproducibility and replicability study that examines three major families: (i) spectral denoising methods, (ii) graph signal processing (GSP) models, and (iii) spectral propagation approaches. Reproducing published pipelines reveals a polarized landscape: while several works are fully reproducible, others rely on flawed metric implementations and incomplete hyperparameter disclosures. In particular, we observe systematic inflation of Recall in the spectral denoising methods due to an implementation error, and theoretically invalid ranking metrics in GSP models due to unordered prediction lists; conversely, the graph filtering models are consistently reproducible. Beyond reproduction, we establish a unified evaluation protocol on four datasets with consistent splits and hyperparameter optimization for all baselines, showing that strong classical methods (e.g., SLIM, Item-kNN) remain highly competitive and that no single spectral model dominates across domains. We further analyze robustness under varying data sparsity and assess beyond-accuracy properties, finding that spectral filtering often improves catalog exploration even when accuracy gains are marginal. Our code is available at https://github.com/sisinflab/Mind_the_Metric_SIGIR-26.

• We stress the overlooked role of feature extraction and processing phase in the standard multimodal recommendation pipeline. • Research often follows limited experimental settings, ignoring powerful new extraction models with careful selection their hyper-parameters, new datasets from uncommon domains, and usually-untested modalities. • We provide a new, end-to-end framework for standardized benchmarking which, unlike other recent benchmarking studies in multimodal recommendation, incorporates Ducho (a feature extraction framework), and Elliot / MMRec (two popular frameworks for reproducible multimodal recommendation); we highlight the implementative challenges to make all these separate frameworks interact under the same experimental pipeline. • We run ∼ 4,000 experiments spanning 8 datasets, 8 multimodal extractors, 15 (multimodal) recommender systems, under 5 different experimental settings. • Our comprehensive pipeline allows extensive and diversified benchmarks in multimodal recommendation. We observe (in most cases) performance improvements with more recent multimodal extractors, whose outcomes are validated under various domains, modalities, and extractors hyper-parameters. With the advent of deep learning and, more recently, large models, recommendation systems have greatly refined their capability of profiling users’ preferences and interests that, in most cases, are complex to disentangle. This is especially true for those recommendation algorithms that rely heavily on external side information, such as multimodal recommender systems. In specific domains like fashion, music, and movie recommendation, the multi-faceted features characterizing products and services may influence each customer on online platforms differently, paving the way to novel multimodal recommendation models that can learn from such multimodal content. According to the literature, the common multimodal recommendation pipeline involves (i) extracting multimodal features, (ii) refining their high-level representations to suit the recommendation task, (iii) optionally fusing all multimodal features, and (iv) predicting the user-item score. Although great effort has been put into designing optimal solutions for (ii-iv), to the best of our knowledge, very little attention has been devoted to exploring procedures for (i) in a rigorous way. In this respect, the existing literature outlines the large availability of multimodal datasets and the ever-growing number of large models accounting for multimodal-aware tasks, but (at the same time) an unjustified adoption of limited standardized solutions. As very recent works from the literature have begun to conduct empirical studies to assess the contribution of multimodality in recommendation, we decide to follow and complement this same research direction. To this end, this paper settles as the first attempt to offer a large-scale benchmarking for multimodal recommender systems, with a specific focus on multimodal extractors. Specifically, we take advantage of three popular and recent frameworks for multimodal feature extraction and reproducibility in recommendation, Ducho , and MMRec / Elliot , respectively, to offer a unified and ready-to-use experimental environment able to run extensive benchmarking analyses leveraging novel multimodal feature extractors. Results, largely validated under different extractors, hyper-parameters of the extractors, domains, and modalities, provide important insights on how to train and tune the next generation of multimodal recommendation algorithms.

Visual compatibility modeling is central to modern fashion recommendation systems. A key task is complementary item retrieval , where the goal is to identify a garment that harmonizes with a reference item, such as retrieving a compatible bottom for a given top. Recent generative approaches synthesize candidate garments to guide retrieval, but they either treat generation as an auxiliary signal or rely on computationally demanding architectures, limiting their practicality in large-scale deployments. In this work, we introduce GeCo , a generative–compositional framework that couples image synthesis and retrieval within an effective, two-stage design. In the first stage, a conditional GAN generates visually coherent bottom templates from top images; in the second stage, the generated template and top form a composed visual query for compatibility-based retrieval. This decoupled design avoids the heavy optimization pipelines used in prior generative approaches, resulting in stable training and low computational cost, while allowing the generated images to guide compatibility modeling. Experiments on three benchmarks, including the new FashionTaobaoTB dataset released with this work, show that GeCo offers competitive retrieval accuracy with a low memory footprint. Human evaluations further indicate that its generated items are perceived as realistic and stylistically compatible, supporting its suitability for practical, resource-constrained fashion recommendation scenarios. • GeCo : generative fashion compatibility model and complementary item retrieval. • GeCo uses a two-stage GAN under realistic hardware limits. • Human studies find its garments realistic and stylistically coherent. • FashionTaobaoTB and benchmarking codebase have been released.

Generative modeling for 3D brain MRI is challenged by a trade-off between anatomical fidelity, sample diversity, and computational efficiency. Diffusion-based approaches achieve strong visual quality but typically require hundreds to thousands of sampling steps, while latent-space compression can introduce reconstruction artifacts and degrade fine-grained anatomy. We introduce FlowLet, a conditional generative framework that performs Flow Matching in an invertible 3D wavelet domain. This representation enables multi-scale generation without learned latent compression, while deterministic ODE sampling allows fast inference. Age conditioning is modeled through complementary feature-wise modulation and spatially adaptive cross-attention, enabling explicit control over age-related morphological variation. Across multi-site neuroimaging datasets, FlowLet achieves competitive and, in several settings, superior global fidelity compared to diffusion-based baselines using as few as 10 sampling steps. Region-based evaluation across 95 cortical and subcortical brain regions demonstrates improved local anatomical plausibility beyond what is captured by global similarity metrics alone. In a downstream brain age prediction study, models augmented with FlowLet-generated data consistently reduce prediction error relative to real-only training and other generative baselines. Rather than focusing on a single dominant metric improvement, these results highlight a consistent trade-off between efficiency, controllability, and anatomically meaningful 3D brain MRI generation. The proposed framework is released as open-source to support reproducibility.

Multimodal recommender systems (RSs) represent items in the catalog through multimodal data (e.g., product images and descriptions) that, in some cases, might be noisy or (even worse) missing. In those scenarios, the common practice is to drop items with missing modalities and train the multimodal RSs on a subsample of the original dataset. To date, the problem of missing modalities in multimodal recommendation has still received limited attention in the literature, lacking a precise formalisation as done with missing information in traditional machine learning. In this work, we first provide a problem formalisation for missing modalities in multimodal recommendation. Second, by leveraging the user-item graph structure, we re-cast the problem of missing multimodal information as a problem of graph features interpolation on the item-item co-purchase graph. On this basis, we propose four training-free approaches that propagate the available multimodal features throughout the item-item graph to impute the missing features. Extensive experiments on popular multimodal recommendation datasets demonstrate that our solutions can be seamlessly plugged into any existing multimodal RS and benchmarking framework while still preserving (or even widen) the performance gap between multimodal and traditional RSs. Moreover, we show that our graph-based techniques can perform better than traditional imputations in machine learning under different missing modalities settings. Finally, we analyse (for the first time in multimodal RSs) how feature homophily calculated on the item-item graph can influence our graph-based imputations.

Dario Di Palma, Alessandro De Bellis, Giovanni Servedio, Vito Walter Anelli, Fedelucio Narducci, Tommaso Di Noia. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.

Factual hallucinations are a major challenge for Large Language Models (LLMs). They undermine reliability and user trust by generating inaccurate or fabricated content. Recent studies suggest that when generating false statements, the internal states of LLMs encode information about truthfulness. However, these studies often rely on synthetic datasets that lack realism, which limits generalization when evaluating the factual accuracy of text generated by the model itself. In this paper, we challenge the findings of previous work by investigating truthfulness encoding capabilities, leading to the generation of a more realistic and challenging dataset. Specifically, we extend previous work by introducing: (1) a strategy for sampling plausible true-false factoid sentences from tabular data and (2) a procedure for generating realistic, LLM-dependent true-false datasets from Question Answering collections. Our analysis of two open-source LLMs reveals that while the findings from previous studies are partially validated, generalization to LLM-generated datasets remains challenging. This study lays the groundwork for future research on factuality in LLMs and offers practical guidelines for more effective evaluation.

Multimodal Recommender Systems aim to improve recommendation accuracy by integrating heterogeneous content, such as images and textual metadata. While effective, it remains unclear whether their gains stem from true multimodal understanding or increased model complexity. This work investigates the role of multimodal item embeddings, emphasizing the semantic informativeness of the representations. Initial experiments reveal that embeddings from standard extractors (e.g., ResNet50, Sentence-Bert) enhance performance, but rely on modality-specific encoders and ad hoc fusion strategies that lack control over cross-modal alignment. To overcome these limitations, we leverage Large Vision-Language Models (LVLMs) to generate multimodal-by-design embeddings via structured prompts. This approach yields semantically aligned representations without requiring any fusion. Experiments across multiple settings show notable performance improvements. Furthermore, LVLMs embeddings offer a distinctive advantage: they can be decoded into structured textual descriptions, enabling direct assessment of their multimodal comprehension. When such descriptions are incorporated as side content into recommender systems, they improve recommendation performance, empirically validating the semantic alignment encoded in LVLMs outputs. Our study highlights the importance of semantically rich representations and positions LVLMs as a compelling foundation to build robust and meaningful multimodal representations in recommendation tasks.

Alessandro De Bellis, Salvatore Bufi, Giovanni Servedio, Vito Walter Anelli, Tommaso Di Noia, Eugenio Di Sciascio. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.

Pre-trained language models (PLMs) are widely used to derive semantic representations from item metadata in recommendation and search.In sequential recommendation, PLMs enhance ID-based embeddings through textual metadata, while in product search, they align item characteristics with user intent.Recent studies suggest task and domain-specific fine-tuning are needed to improve representational power.This paper challenges this assumption for e-commerce applications, showing that Generalist Text Embedding Models (GTEs), pre-trained on large-scale corpora, can guarantee strong zero-shot performance without specialized adaptation.Our experiments on popular e-commerce benchmarks demonstrate that GTEs outperform traditional and fine-tuned models in both sequential recommendation and product search.We attribute this to a superior representational power, as they distribute features more evenly across the embedding space.Finally, we show that compressing embedding dimensions by focusing on the most informative directions (e.g., via PCA) effectively reduces noise and improves the performance of specialized models.To ensure reproducibility, we provide our repository at https://github.com/sisinflab/GTE-Zero- Shot-Recsys.

In the realm of music recommendation, sequential recommenders have shown promise in capturing the dynamic nature of music consumption. A key characteristic of this domain is repetitive listening, where users frequently replay familiar tracks. To capture these repetition patterns, recent research has introduced Personalised Popularity Scores (PPS), which quantify user-specific preferences based on historical frequency. While PPS enhances relevance in recommendation, it often reinforces already-known content, limiting the system’s ability to surface novel or serendipitous items—key elements for fostering long-term user engagement and satisfaction. To address this limitation, we build upon RecJPQ, a Transformer-based framework initially developed to improve scalability in large-item catalogues through sub-item decomposition. We repurpose RecJPQ’s sub-item architecture to model personalised popularity at a finer granularity. This allows us to capture shared repetition patterns across sub-embeddings—latent structures not accessible through item-level popularity alone. We propose a novel integration of sub-ID-level personalised popularity within the RecJPQ framework, enabling explicit control over the trade-off between accuracy and personalised novelty. Our sub-ID-level PPS method (sPPS) consistently outperforms item-level PPS by achieving significantly higher personalised novelty without compromising recommendation accuracy. Code and experiments are publicly available at https://github.com/sisinflab/Sub-id-Popularity.

Recommendation pipelines involve several stages that can critically affect performance and reproducibility. However, early pipeline stages remain under-standardized, limiting comparability and interoperability across studies. This tutorial addresses this gap by providing both theoretical insights and hands-on experience with tools and practices for standardized data processing in recommender systems. In the first part, we introduce DataRec, a Python library for reproducible and interoperable data management, and discuss data filtering, splitting, and topological analysis techniques. In the second part, we explore multimodal feature extraction in domains such as fashion, music, and movies, focusing on the challenges of meaningful multimodal integration. We introduce Ducho, a unified framework for extracting audio, visual, and textual features using modern backends, and demonstrate its integration with the evaluation framework Elliot. The tutorial targets researchers and practitioners with an interest in recommender systems, data preprocessing, and multimodal modeling. All materials, including slides, code, datasets, and recordings, will be openly available on a dedicated tutorial website: https://sites.google.com/view/dd4rec-tutorial/.

Conversational Information Access systems have experienced widespread diffusion thanks to the natural and effortless interactions they enable with the user. In particular, they represent an effective interaction interface for conversational search (CS) and conversational recommendation (CR) scenarios. Despite their commonalities, CR and CS systems are often devised, developed, and evaluated as isolated components. Integrating these two elements would allow for handling complex information access scenarios, such as exploring unfamiliar recommended product aspects, enabling richer dialogues, and improving user satisfaction. As of today, the scarce availability of integrated datasets - focused exclusively on either of the tasks - limits the possibilities for evaluating by-design integrated CS and CR systems. To address this gap, we propose CoSRec, the first dataset for joint Conversational Search and Recommendation (CSR) evaluation. The CoSRec test set includes 20 high-quality conversations, with human-made annotations for the quality of conversations, and manually crafted relevance judgments for products and documents. Additionally, we provide supplementary training data comprising partially annotated dialogues and raw conversations to support diverse learning paradigms. CoSRec is the first resource to model CR and CS tasks in a unified framework, enabling the training and evaluation of systems that must shift between answering queries and making suggestions dynamically.

Recommender systems have demonstrated a significant impact across diverse domains, yet ensuring the reproducibility of experimental findings remains a persistent challenge.A primary obstacle lies in the fragmented and often opaque data management strategies employed during the preprocessing stage, where decisions about dataset selection, filtering, and splitting can substantially influence outcomes.To address these limitations, we introduce DataRec, an open-source Python-based library specifically designed to unify and streamline data handling in recommender system research.By providing reproducible routines for dataset preparation, data versioning, and seamless integration with other frameworks, DataRec promotes methodological standardization, interoperability, and comparability across different experimental setups.Our design is informed by an in-depth review of 55 stateof-the-art recommendation studies, ensuring that DataRec adopts best practices while addressing common pitfalls in data management.Ultimately, our contribution facilitates fair benchmarking, enhances reproducibility, and fosters greater trust in experimental results within the broader recommender systems community.The DataRec library, documentation, and examples are freely available at https://github.com/sisinflab/DataRec.

Large Language Models (LLMs) have become increasingly central to recommendation scenarios due to their remarkable natural language understanding and generation capabilities. Although significant research has explored the use of LLMs for various recommendation tasks, little effort has been dedicated to verifying whether they have memorized public recommendation dataset as part of their training data. This is undesirable because memorization reduces the generalizability of research findings, as benchmarking on memorized datasets does not guarantee generalization to unseen datasets. Furthermore, memorization can amplify biases, for example, some popular items may be recommended more frequently than others.

High Flow Nasal Cannula (HFNC) therapy is commonly used in infants hospitalized with bronchiolitis, but its early indication remains challenging. This study proposes an explainable machine learning framework to predict the need for HFNC at admission using real-world clinical data from 109 pediatric patients. After preprocessing, class balancing with SMOTE, and feature selection via RFECV, four classifiers were trained and compared. The Multi-Layer Perceptron (MLP) achieved the best performance, significantly outperforming other models in terms of F1-score. To ensure interpretability, SHAP values were used to identify key predictive features such as SpO2, CRP levels, and hospital stay duration while counterfactual explanations highlighted actionable decision boundaries. The proposed model combines predictive accuracy with clinical transparency, offering a promising tool to support early respiratory management in pediatric bronchiolitis

Data minimization, required by recent data privacy regulations, is crucial for user privacy, but its impact on recommender systems remains largely unclear.The core problem lies in the fact that reducing or altering the training data of these systems can drastically affect their performance.While previous research has explored how data minimization affects recommendation accuracy, a critical gap remains: How does data minimization impact consumers' and providers' fairness?This study addresses this gap by systematically examining how data minimization influences multiple objectives in recommender systems, i.e., the trade-offs between accuracy, user fairness, and provider fairness.Our investigation includes (i) an analysis of how the data minimization strategies affect RS performance across these objectives, (ii) an assessment of data minimization techniques to determine those that can balance better the trade-off among the considered objectives, and (iii) an evaluation of the robustness of different recommendation models under diverse minimization strategies to identify those that best maintain performance.The findings reveal that data minimization can sometimes undermine provider fairness, albeit enhancing groupbased consumer fairness to the detriment of accuracy.Additionally, different strategies can offer diverse trade-offs for the assessed objectives.The source code supporting this study is available at https://github.com/salvatore-bufi/DataMinimizationFairness.

Diffusion models have recently unlocked new possibilities in editing images of real-world objects. Yet, transforming objects in non-rigid ways, such as modifying poses or applying image-based conditioning, continues to present significant challenges. Retaining the unique identity of objects during these edits is a complex task, and current techniques often fall short of delivering the precision needed for industrial settings, where consistency is non-negotiable. Additionally, adapting diffusion models demands custom training data, which is often unavailable in real-world scenarios. To address these gaps, we present FashionRepose , a novel, training-free pipeline designed to handle non-rigid pose adjustments specifically for the fashion industry. This approach combines pretrained off-the-shelf models to modify the poses of long-sleeve garments while safeguarding their identity and branding characteristics. By adopting a zero-shot methodology, FashionRepose enables near real-time edits, entirely eliminating the requirement for specialized training data. FashionRepose has been deployed for a global fashion firm, OVS, handling more than 30,000 long-sleeve garments.

The investigation of neural correlates of mental imagery and perception has been a pivotal area of research in cognitive neuroscience, offering significant insights into how the brain represents both imagined and perceived experiences. While previous studies have successfully identified electrophysiological markers associated with motor and perceptual imagery, the neural signatures of motivational imagery—encompassing desires, needs, and cravings—remain underexplored. This study employs different machine learning classifiers applied to EEG data to classify and compare neural representations of twelve distinct motivational states under perception and imagery conditions. We conducted experiments using 14-channel and 18-channel EEG configurations to capture and analyze the neural responses of participants exposed to various stimuli. Our primary aims were to evaluate classification performance, measured by accuracy, and assess the impact of electrode density on performance. The results indicate that perception conditions generally yield higher accuracy in distinguishing motivational states than imagery conditions. Specifically, primary needs and somatosensory states exhibited strong and clear neural patterns in perception, with a peak accuracy of 88% in the 18-channel setup, while the accuracy for imagined states was more variable. Comparisons between 14-channel and 18-channel configurations revealed that higher electrode density slightly improved performance but was not significantly superior.

This work takes a critical stance on previous studies concerning fairness evaluation in Large-Language Model (LLM)-based recommender systems, which have primarily assessed consumer fairness by comparing recommendation lists generated with and without sensitive user attributes. Such approaches implicitly treat discrepancies in recommended items as biases, overlooking whether these changes might stem from genuine personalization aligned with true preferences of users. Moreover, these earlier studies typically address single sensitive attributes in isolation, neglecting the complex interplay of intersectional identities. In response to these shortcomings, we introduce CFaiRLLM , an enhanced evaluation framework that not only incorporates true preference alignment but also rigorously examines intersectional fairness by considering overlapping sensitive attributes. Additionally, CFaiRLLM introduces diverse user profile sampling strategies— random , top-rated , and recency-focused —to better understand the impact of profile generation fed to LLMs in light of inherent token limitations in these systems. Given that fairness depends on accurately understanding users’ tastes and preferences, these strategies provide a more realistic assessment of fairness within RecLLMs. To validate the efficacy of CFaiRLLM, we conducted extensive experiments using MovieLens and LastFM datasets, applying various sampling strategies and sensitive attribute configurations. The evaluation metrics include both item similarity measures and true preference alignment considering both hit and ranking (Jaccard Similarity and PRAG), thereby conducting a multi-faceted analysis of recommendation fairness. The results demonstrated that true preference alignment offers a more personalized and fair assessment compared to similarity-based measures, revealing significant disparities when sensitive and intersectional attributes are incorporated. Notably, our study finds that intersectional attributes amplify fairness gaps more prominently, especially in less structured domains such as music recommendations in LastFM. These findings suggest that future fairness evaluations in RecLLMs should incorporate true preference alignment to ensure equitable and genuinely personalized recommendations.

Recommender systems (RSs) provide customers with a personalized navigation experience within the vast catalogs of products and services offered on popular online platforms. Despite the substantial success of traditional RSs, recommendation remains a highly challenging task, especially in specific scenarios and domains. For example, human affinity for items described through multimedia content (e.g., images, audio, and text), such as fashion products, movies, and music, is multi-faceted and primarily driven by their diverse characteristics. Therefore, by leveraging all available signals in such scenarios, multimodality enables us to tap into richer information sources and construct more refined user/item profiles for recommendations. Despite the growing number of multimodal techniques proposed for multimedia recommendation, the existing literature lacks a shared and universal schema for modeling and solving the recommendation problem through the lens of multimodality. Given the recent advances in multimodal deep learning for other tasks and scenarios where precise theoretical and applicative procedures exist, we also consider it imperative to formalize a general multimodal schema for multimedia recommendation. In this work, we first provide a comprehensive literature review of multimodal approaches for multimedia recommendation from the last eight years. Second, we outline the theoretical foundations of a multimodal pipeline for multimedia recommendation by identifying and formally organizing recurring solutions/patterns; at the same time, we demonstrate its rationale by conceptually applying it to selected state-of-the-art approaches in multimedia recommendation. Third, we conduct a benchmarking analysis of recent algorithms for multimedia recommendation within Elliot, a rigorous framework for evaluating recommender systems, where we re-implement such multimedia recommendation approaches. Finally, we highlight the significant unresolved challenges in multimodal deep learning for multimedia recommendation and suggest possible avenues for addressing them. The primary aim of this work is to provide guidelines for designing and implementing the next generation of multimodal approaches in multimedia recommendation.

Generally, items with missing modalities are dropped in multimodal recommendation. However, with this work, we question this procedure, highlighting that it would further damage the pipeline of any multimodal recommender system. First, we show that the lack of (some) modalities is, in fact, a widely-diffused phenomenon in multimodal recommendation. Second, we propose a pipeline that imputes missing multimodal features in recommendation by leveraging traditional imputation strategies in machine learning. Then, given the graph structure of the recommendation data, we also propose three more effective imputation solutions that leverage the item-item co-purchase graph and the multimodal similarities of co-interacted items. Our method can be plugged into any multimodal RSs in the literature working as an untrained pre-processing phase, showing (through extensive experiments) that any data pre-filtering is not only unnecessary but also harmful to the performance.

In the realm of music recommendation, sequential recommender systems have shown promise in capturing the dynamic nature of music consumption. Nevertheless, traditional Transformer-based models, such as SASRec and BERT4Rec, while effective, encounter challenges due to the unique characteristics of music listening habits. In fact, existing models struggle to create a coherent listening experience due to rapidly evolving preferences. Moreover, music consumption is characterized by a prevalence of repeated listening, i.e. users frequently return to their favourite tracks, an important signal that could be framed as individual or personalized popularity. This paper addresses these challenges by introducing a novel approach that incorporates personalized popularity information into sequential recommendation. By combining user-item popularity scores with model-generated scores, our method effectively balances the exploration of new music with the satisfaction of user preferences. Experimental results demonstrate that a Personalized Most Popular recommender, a method solely based on user-specific popularity, outperforms existing state-of-the-art models. Furthermore, augmenting Transformer-based models with personalized popularity awareness yields superior performance, showing improvements ranging from 25.2% to 69.8%. The code for this paper is available at https://github.com/sisinflab/personalized-popularity-awareness.

Recently, graph neural networks (GNNs)-based recommender systems have encountered great success in recommendation. As the number of GNNs approaches rises, some works have started questioning the theoretical and empirical reasons behind their superior performance. Nevertheless, this investigation still disregards that GNNs treat the recommendation data as a topological graph structure. Building on this assumption, in this work, we provide a novel evaluation perspective on GNNs-based recommendation, which investigates the impact of the graph topology on the recommendation performance. To this end, we select some (topological) properties of the recommendation data and three GNNs-based recommender systems (i.e., LightGCN, DGCF, and SVD-GCN). Then, starting from three popular recommendation datasets (i.e., Yelp2018, Gowalla, and Amazon-Book) we sample them to obtain 1,800 size-reduced datasets that still resemble the original ones but can encompass a wider range of topological structures. We use this procedure to build a large pool of samples for which data characteristics and recommendation performance of the selected GNNs models are measured. Through an explanatory framework, we find strong correspondences between graph topology and GNNs performance, offering a novel evaluation perspective on these models.

Cardiovascular disease (CVD) is a general term referring to several heart or blood vessels abnormality. Heart failure (HF), directly associated to (CVD), is a significant global health problem as well as the leading cause of morbidity and mortality. The early detection of this condition is crucial for patient health. Traditional diagnostic methods for HF, such as history taking and physical examination, are often insufficient and require the use of advanced techniques such as Electrocardiogram (ECG). This study aims to extract temporal and morphological features from (ECG) signals and compare different Machine Learning (ML) classification models to enable rapid diagnosis and provide interpretable predictions. Specifically, we propose a Light Gradient Boosting (LGBM) model that can discriminate Normal Sinus Rhythm (NSR) and Arrhythmia (ARR) with a high accuracy of 0.99, achieving a Precision of 1.00, Recall of 0.99, and f1-score of 0.99 in the (NSR) class, and Precision of 0.99, Recall of 1.00, and f1-score of 0.99 in the (ARR) class, respectively. In addition, eXplainable Artificial Intelligence (XAI) analysis is performed to explain the model predictions.

Information Retrieval (IR) and Recommender Systems (RSs) tasks are moving from computing a ranking of final results based on a single metric to multi-objective problems. Solving these problems leads to a set of Pareto-optimal solutions, known as Pareto frontier, in which no objective can be further improved without hurting the others. In principle, all the points on the Pareto frontier are potential candidates to represent the best model selected with respect to the combination of two, or more, metrics. To our knowledge, there are no well-recognized strategies to decide which point should be selected on the frontier in IR and RSs. In this paper, we propose a novel, post-hoc, theoretically-justified technique, named "Population Distance from Utopia" (PDU), to identify and select the one-best Pareto-optimal solution. PDU considers fine-grained utopia points, and measures how far each point is from its utopia point, allowing to select solutions tailored to user preferences, a novel feature we call "calibration". We compare PDU against state-of-the-art strategies through extensive experiments on tasks from both IR and RS, showing that PDU combined with calibration notably impacts the solution selection.

In multimodal-aware recommendation, the extraction of meaningful multimodal features is at the basis of high-quality recommendations. Generally, each recommendation framework implements its multimodal extraction procedures with specific strategies and tools. This is limiting for two reasons: (i) different extraction strategies do not ease the interdependence among multimodal recommendation frameworks; thus, they cannot be efficiently and fairly compared; (ii) given the large plethora of pre-trained deep learning models made available by different open source tools, model designers do not have access to shared interfaces to extract features. Motivated by the outlined aspects, we propose Ducho, a unified framework for the extraction of multimodal features in recommendation. By integrating three widely-adopted deep learning libraries as backends, namely, TensorFlow, PyTorch, and Transformers, we provide a shared interface to extract and process features where each backend's specific methods are abstracted to the end user. Noteworthy, the extraction pipeline is easily configurable with a YAML-based file where the user can specify, for each modality, the list of models (and their specific backends/parameters) to perform the extraction. Finally, to make Ducho accessible to the community, we build a public Docker image equipped with a ready-to-use CUDA environment and propose three demos to test its functionalities for different scenarios and tasks. The GitHub repository and the documentation are accessible at this link: https://github.com/sisinflab/Ducho.

The success of graph neural network-based models (GNNs) has significantly advanced recommender systems by effectively modeling users and items as a bipartite, undirected graph. However, many original graph-based works often adopt results from baseline papers without verifying their validity for the specific configuration under analysis. Our work addresses this issue by focusing on the replicability of results. We present a code that successfully replicates results from six popular and recent graph recommendation models (NGCF, DGCF, LightGCN, SGL, UltraGCN, and GFCF) on three common benchmark datasets (Gowalla, Yelp 2018, and Amazon Book). Additionally, we compare these graph models with traditional collaborative filtering models that historically performed well in offline evaluations. Furthermore, we extend our study to two new datasets (Allrecipes and BookCrossing) that lack established setups in existing literature. As the performance on these datasets differs from the previous benchmarks, we analyze the impact of specific dataset characteristics on recommendation accuracy. By investigating the information flow from users’ neighborhoods, we aim to identify which models are influenced by intrinsic features in the dataset structure. The code to reproduce our experiments is available at: https://github.com/sisinflab/Graph-RSs-Reproducibility.

Knowledge graphs (KG) have been proven to be a powerful source of side information to enhance the performance of recommendation algorithms. Their graph-based structure paves the way for the adoption of graph-aware learning models such as Graph Neural Networks (GNNs). In this respect, state-of-the-art models achieve good performance and interpretability via user-level combinations of intents leading users to their choices. Unfortunately, such results often come from and end-to-end learnings that considers a combination of the whole set of features contained in the KG without any analysis of the user decisions. In this paper, we introduce KGTORe, a GNN-based model that exploits KG to learn latent representations for the semantic features, and consequently, interpret the user decisions as a personal distillation of the item feature representations. Differently from previous models, KGTORe does not need to process the whole KG at training time but relies on a selection of the most discriminative features for the users, thus resulting in improved performance and personalization. Experimental results on three well-known datasets show that KGTORe achieves remarkable accuracy performance and several ablation studies demonstrate the effectiveness of its components. The implementation of KGTORe is available at: https://github.com/sisinflab/KGTORe.

Providing effective suggestions is of predominant importance for successful Recommender Systems (RSs). Nonetheless, the need of accounting for additional multiple objectives has become prominent, from both the final users’ and the item providers’ points of view. This need has led to a new class of RSs, called Multi-Objective Recommender Systems (MORSs). These systems are designed to provide suggestions by considering multiple (conflicting) objectives simultaneously, such as diverse, novel, and fairness-aware recommendations. In this work, we reproduce a state-of-the-art study on MORSs that exploits a reinforcement learning agent to satisfy three objectives, i.e., accuracy, diversity, and novelty of recommendations. The selected study is one of the few MORSs where the source code and datasets are released to ensure the reproducibility of the proposed approach. Interestingly, we find that some challenges arise when replicating the results of the original work, due to the nature of multiple-objective problems. We also extend the evaluation of the approach to analyze the impact of improving user-centered objectives of recommendations (i.e., diversity and novelty) in terms of algorithmic bias. To this end, we take into consideration both popularity and category of the items. We discover some interesting trends in the recommendation performance according to different evaluation metrics. In addition, we see that the multi-objective reinforcement learning approach is responsible for increasing the bias disparity in the output of the recommendation algorithm for those items belonging to positively/negatively biased categories. We publicly release datasets and codes in the following GitHub repository: https://github.com/sisinflab/MORS_reproducibility.

Although beyond-accuracy metrics have gained attention in the last decade, the accuracy of recommendations is still considered the gold standard to evaluate Recommender Systems (RSs). This approach prioritizes the accuracy of recommendations, neglecting the quality of suggestions to enhance user needs, such as diversity and novelty, as well as trustworthiness regulations in RSs for user and provider fairness. As a result, single metrics determine the success of RSs, but this approach fails to consider other criteria simultaneously. A downside of this method is that the most accurate model configuration may not excel in addressing the remaining criteria. This study seeks to broaden RS evaluation by introducing a multi-objective evaluation that considers all model configurations simultaneously under several perspectives. To achieve this, several hyper-parameter configurations of an RS model are trained, and the Pareto-optimal ones are retrieved. The Quality Indicators (QI) of Pareto frontiers, which are gaining interest in Multi-Objective Optimization research, are adapted to RSs. QI enables evaluating the model’s performance by considering various configurations and giving the same importance to each metric. The experiments show that this multi-objective evaluation overturns the ranking of performance among RSs, paving the way to revisit the evaluation approaches of the RecSys research community. We release codes and datasets in the following GitHub repository: https://github.com/sisinflab/RecMOE.

While the integration of product images enhances the recommendation performance of visual-based recommender systems (VRSs), this can make the model vulnerable to adversaries that can produce noised images capable to alter the recommendation behavior. Recently, stronger and stronger adversarial attacks have emerged to raise awareness of these risks; however, effective defense methods are still an urgent open challenge. In this work, we propose "Adversarial Image Denoiser" (AiD), a novel defense method that cleans up the item images by malicious perturbations. In particular, we design a training strategy whose denoising objective is to minimize both the visual differences between clean and adversarial images and preserve the ranking performance in authentic settings. We perform experiments to evaluate the efficacy of AiD using three state-of-the-art adversarial attacks mounted against standard VRSs. Code and datasets at https://github.com/sisinflab/Denoise-to-protect-VRS.

Brain-computer interfaces are widely used to control machines using Electroencephalography (EEG) signals. Several low-cost electroencephalographs are available on the market that achieves good-quality EEG signals. One of the most intriguing issues for developing biofeedback systems is classifying users' emotional states using EEG signals and Machine Learning (ML) methods. In our study, we propose a novel ML-based biofeedback tool using a BCI to detect two different users' mental states: Focus, and Relaxation. We compared several ML algorithms achieving an average accuracy on the Test Set of 0.90 by using SVM. Finally, we propose a prototype for music generation according to the classification output that could be adopted in neurorehabilitation scenarios.

Mild Cognitive Impairment (MCI) is a syndrome charac-terized by cognitive impairment that is greater than expected for a subject's age and level of education. Nevertheless, it does not interfere with daily activity. Prevalence in epidemiological and population-based studies ranges from 3% to 19% in adults older than 65 years. A very interesting approach in this area is related to the identification of an Artificial Intelligence (Al)-based model and a subset of relevant features to predict the MCI clinical outcome. In our study, we propose a Pareto-optimality-based approach to identify the best model for predicting MCI. In fact, the best model achieves an Accuracy and Recall on Yes MCI of 71 % and 80% respectively. With this approach, it is possible to select the best model in order to predict Yes MCI (highest risk class). Our study presents a new best model selection approach that can be applied in identifying the best model that can be applied in various disease classification problems.

Collaborative filtering models have undoubtedly dominated the scene of recommender systems in recent years. However, due to the little use of content information, they narrowly focus on accuracy, disregarding a higher degree of personalization. Meanwhile, knowledge graphs are arousing considerable interest in recommendation models thanks to their ability to enrich the system with content features that captures subtle user-item relations. Nevertheless, with many high-quality features, the models become more complex and challenging to train. We extend KGFlex [ 16 ], a hybrid model that analyzes historical data to understand the semantic features the user decisions depend on. KGFlex represents item features as embeddings, and it models user-item interactions as a factorized entropy-driven combination of the item attributes relevant to the user, thus reducing the complexity and raising the degree of personalization. The method does not neglect long tail items, reducing the popularity bias and ensuring a high level of fairness. The user-item prediction is mediated by the user’s personal views of the embeddings that grant a high degree of expressiveness. This extension analyzes different entropy measurement strategies, an enhanced user negative decision modeling, and assesses the fairness of KGFlex and the impact of its hyperparameters. KGFlex is available at https://split.to/kgflex .

The advent of pretrained language have renovated the ways of handling natural languages, improving the quality of systems that rely on them. BERT played a crucial role in revolutionizing the Natural Language Processing (NLP) area. However, the deep learning framework it implements lacks interpretability. Thus, recent research efforts aimed to explain what BERT learns from the text sources exploited to pre-train its linguistic model. In this paper, we analyze the latent vector space resulting from the BERT context-aware word embeddings. We focus on assessing whether regions of the BERT vector space hold an explicit meaning attributable to a Knowledge Graph (KG). First, we prove the existence of explicitly meaningful areas through the Link Prediction (LP) task. Then, we demonstrate these regions being linked to explicit ontology concepts of a KG by learning classification patterns. To the best of our knowledge, this is the first attempt at interpreting the BERT learned linguistic knowledge through a KG relying on its pretrained context-aware word embeddings.

Due to their economic and significant importance, fault detection tasks in intelligent electrical grids are vital. Although numerous smart grid (SG) applications, such as fault detection and load forecasting, have adopted data-driven approaches, the robustness and security of these data-driven algorithms have not been widely examined. One of the greatest obstacles in the research of the security of smart grids is the lack of publicly accessible datasets that permit testing the system's resilience against various types of assault. In this paper, we present IEEE13-AdvAttack, a large-scaled simulated dataset based on the IEEE-13 test node feeder suitable for supervised tasks under SG. The dataset includes both conventional and renewable energy resources. We examine the robustness of fault type classification and fault zone classification systems to adversarial attacks. Through the release of datasets, benchmarking, and assessment of smart grid failure prediction systems against adversarial assaults, we seek to encourage the implementation of machine-learned security models in the context of smart grids. The benchmarking data and code for fault prediction are made publicly available on https://bit.ly/3NT5jxG.

Brain-Computer Interfaces allow controlling machines through signals coming from Electroencephalography (EEG) analysis. Nowadays, there are several cheap electroencephalographs available on the market that guarantee good quality EEG signals. A very interesting approach in this area is related to detecting the emotional states of a user through the analysis of her EEG signal. In our study, we tried to detect the emotional polarity (Valence), the state of emotional excitement (Arousal), and the level of emotion control (Dominance). Through metric interpolation and Russell’s circumplex model, it is possible to characterize and define the current emotional state of the user who wears the device. Our study presents a prototype of an EEG-based emotion recognizer that provides the user’s emotional state exploitable as bio-feedback.

Machine Learning could help the healthcare industry manage huge amounts of data and discover hidden trends and patterns that could help us better understand disease development and treatment. The goal is to define a Neural Network model (NN) to classify physical frailty in aging cohort to identify the frail food and clinical profile. In a 1, 929 older cohort from Southern Italy, the Food Frequency Questionnaire (FFQ) and clinical data were collected with blood tests. A NN was built with a hyperparameter tuning technique using accuracy as a performance parameter to select the best model. Confusion matrices, Garson and Olden’s variable importance were evaluated. Older age, female gender, high BMI, and high blood pressure were associated with physical frailty. In frail subjects, the lipid profile and RBC levels were significantly lower than their counterpart. On the contrary, serum levels of interleukin-6 and CRP were higher in the frail group. Frail subjects show higher consumption of spaghetti soup, pecorino cheese, fennel and chocolate, while a lower consumption of ham. The NN model has a respective training and testing accuracy of 86.49% and 85.77%. NN performs well on the train. The test dataset makes few mistakes and can predict healthy subjects with high specificity. According to Garson’s method, age, gender, foods rich in fats, and smoking habits are essential in predicting the frailty condition. In contrast, Olden’s method underlined the higher consumption of legumes and unrefined cereals.

Research on recommender systems algorithms, like other areas of applied machine learning, is largely dominated by efforts to improve the state-of-the-art, typically in terms of accuracy measures. Several recent research works however indicate that the reported improvements over the years sometimes “don’t add up”, and that methods that were published several years ago often outperform the latest models when evaluated independently. Different factors contribute to this phenomenon, including that some researchers probably often only fine-tune their own models but not the baselines.

Point-of-interest (POI) recommendation is an essential service to location-based social networks (LBSNs), benefiting both users providing them the chance to explore new locations and businesses by discovering new potential customers. These systems learn the preferences of users and their mobility patterns to generate relevant POI recommendations. Previous studies have shown that incorporating contextual information such as geographical, temporal, social, and categorical substantially improves the quality of POI recommendations. However, fewer works have studied in-depth the multi-aspect benefits of context fusion on POI recommendation, in particular on beyond-accuracy, fairness, and interpretability of recommendations. In this work, we propose a linear regression-based fusion of POI contexts that effectively finds the best combination of contexts for each (i) user, or (ii) group of users from their historical interactions. The results of large-scale experiments on two popular datasets Gowalla and Yelp reveal several interesting findings. First, the proposed approach does not present significant loss in accuracy and unfairness of popularity bias as with classical collaborative baselines, and yet improves the beyond-accuracy of recommendation compared with existing context-aware (CA) approaches using heuristic context fusions; for instance, the proposed approach improves the accuracy and beyond-accuracy compare to best baseline model by 25% and 30%, respectively. Second, our proposed approach is interpretable, allowing to explain to the user why she has been recommended specific POIs, based on the learned context weights from user past check-ins; for example, if you are in Rome and our method recommends you a historical place like ‘Colosseum’, it can also provide an explanation why this item is recommended to you based on your personal preference on context (e.g., you were recommended to visit ‘Colosseum’ because in the past your visited historical places). Third, by analyzing the fairness of recommendation with respect to users (based on their activity levels) and items (based on the popularity of items), we found that a model which is recommend fairly on one dataset can recommend unfair on another dataset. Overall, our study suggests that appropriate context fusion is an essential element of an accurate, fair, and transparent POI recommendation system. We highlight that while we have tested the efficacy of our context-fusion methods on two popular CA recommendation models in the POI domain, namely GeoSoCa and LORE, our system can be flexibly utilized to extend the capability of other CA algorithms.

Over the years, model-based approaches have shown their effectiveness in computing recommendation lists in different domains and settings. By relying on the computation of latent factors, they can recommend items with a very high level of accuracy. Unfortunately, when moving to the latent space, even if the model embeds content-based information, we miss references to the actual semantics of the recommended item. It makes the interpretation of the recommendation process non-trivial. In this paper, we show how to initialize latent factors in Factorization Machines by using semantic features coming from knowledge graphs to train an interpretable model, which is, in turn, able to provide recommendations with a high level of accuracy. In the presented approach, semantic features are injected into the learning process to retain the original informativeness of the items available in the dataset. By relying on the information encoded in the original knowledge graph, we also propose two metrics to evaluate the semantic accuracy and robustness of knowledge-aware interpretability. An extensive experimental evaluation on six different datasets shows the effectiveness of the interpretable model in terms of both accuracy and diversity of recommendation results and interpretability robustness.

Recommender systems (RSs) employ user-item feedback, e.g., ratings, to match customers to personalized lists of products. Approaches to top-k recommendation mainly rely on Learning-To-Rank algorithms and, among them, the most widely adopted is Bayesian Personalized Ranking (BPR), which bases on a pair-wise optimization approach. Recently, BPR has been found vulnerable against adversarial perturbations of its model parameters. Adversarial Personalized Ranking (APR) mitigates this issue by robustifying BPR via an adversarial training procedure. The empirical improvements of APR's accuracy performance on BPR have led to its wide use in several recommender models. However, a key overlooked aspect has been the beyond-accuracy performance of APR, i.e., novelty, coverage, and amplification of popularity bias, considering that recent results suggest that BPR, the building block of APR, is sensitive to the intensification of biases and reduction of recommendation novelty. In this work, we model the learning characteristics of the BPR and APR optimization frameworks to give mathematical evidence that, when the feedback data have a tailed distribution, APR amplifies the popularity bias more than BPR due to an unbalanced number of received positive updates from short-head items. Using matrix factorization (MF), we empirically validate the theoretical results by performing preliminary experiments on two public datasets to compare BPR-MF and APR-MF performance on accuracy and beyond-accuracy metrics. The experimental results consistently show the degradation of novelty and coverage measures and a worrying amplification of bias.

Recommender systems (RSs) have widely grown thanks to the outstanding capability of providing users with accurate and tailored recommendations. Recently, public awareness and new regulations forced RS researchers and practitioners to study solutions to user privacy endangerment. This tutorial will guide the attendees through the possible threats and the solutions towards private RSs.

The paper introduces Visual-Elliot (V-Elliot), a reproducibility framework for Visual Recommendation systems (VRSs) based on Elliot. framework provides the widest set of VRSs compared to other recommendation frameworks in the literature (i.e., 6 state-of-the-art models which have been commonly employed as baselines in recent works). The framework pipeline spans from the dataset preprocessing and item visual features loading to easily train and test complex combinations of visual models and evaluation settings. V-Elliot provides an extended set of features to ease the design, testing, and integration of novel VRSs into V-Elliot. The framework exploits of dataset filtering/splitting functions, 40 evaluation metrics, five hyper-parameter optimization methods, more than 50 recommendation algorithms, and two statistical hypothesis tests. The files of this demonstration are available at: github.com/sisinflab/elliot.

In the last few years, a renewed interest of the research community on conversational recommender systems (CRSs) is emerging. This is probably due to the great diffusion of Digital Assistants (DAs) such as Amazon Alexa, Siri, or Google Assistant that are revolutionizing the way users interact with machines. DAs allow users to execute a wide range of actions through an interaction mostly based on natural language messages. However, although DAs are able to complete tasks such as sending texts, making phone calls, or playing songs, they are still at an early stage on offering recommendation capabilities by using the conversational paradigm.

Collaborative filtering models based on matrix factorization and learned similarities using Artificial Neural Networks (ANNs) have gained significant attention in recent years. This is, in part, because ANNs have demonstrated very good results in a wide variety of recommendation tasks. However, the introduction of ANNs within the recommendation ecosystem has been recently questioned, raising several comparisons in terms of efficiency and effectiveness. One aspect most of these comparisons have in common is their focus on accuracy, neglecting other evaluation dimensions important for the recommendation, such as novelty, diversity, or accounting for biases. In this work, we replicate experiments from three different papers that compare Neural Collaborative Filtering (NCF) and Matrix Factorization (MF), to extend the analysis to other evaluation dimensions. First, our contribution shows that the experiments under analysis are entirely reproducible, and we extend the study including other accuracy metrics and two statistical hypothesis tests. Second, we investigated the Diversity and Novelty of the recommendations, showing that MF provides a better accuracy also on the long tail, although NCF provides a better item coverage and more diversified recommendation lists. Lastly, we discuss the bias effect generated by the tested methods. They show a relatively small bias, but other recommendation baselines, with competitive accuracy performance, consistently show to be less affected by this issue. This is the first work, to the best of our knowledge, where several complementary evaluation dimensions have been explored for an array of state-of-the-art algorithms covering recent adaptations of ANNs and MF. Hence, we aim to show the potential these techniques may have on beyond-accuracy evaluation while analyzing the effect on reproducibility these complementary dimensions may spark. The code to reproduce the experiments is publicly available on GitHub at https://tny.sh/Reenvisioning.

Recently, recommendation systems have been proven to be susceptible to malicious perturbations of the model weights. To overcome this vulnerability, Adversarial Regularization emerged as one of the most effective solutions. Interestingly, the technique not only robustifies the model, but also significantly increases its accuracy. To date, unfortunately, the effect of Adversarial Regularization beyond-accuracy evaluation dimensions is unknown. This paper sheds light on these aspects and investigates how Adversarial Regularization impacts the amplification of popularity bias, and the deterioration of novelty and coverage of the recommendation list. The results highlight that, with imbalanced data distribution, Adversarial Regularization amplifies the popularity bias. Moreover, the empirical validation on five datasets confirms that it degrades the diversity and novelty of the generated recommendation. Code and data are available at https://github.com/sisinflab/The-Idiosyncratic-Effects-of-Adversarial-Training.

Deep Learning and factorization-based collaborative filtering recommendation models have undoubtedly dominated the scene of recommender systems in recent years. However, despite their outstanding performance, these methods require a training time proportional to the size of the embeddings and it further increases when also side information is considered for the computation of the recommendation list. In fact, in these cases we have that with a large number of high-quality features, the resulting models are more complex and difficult to train. This paper addresses this problem by presenting KGFlex: a sparse factorization approach that grants an even greater degree of expressiveness. To achieve this result, KGFlex analyzes the historical data to understand the dimensions the user decisions depend on (e.g., movie direction, musical genre, nationality of book writer). KGFlex represents each item feature as an embedding and it models user-item interactions as a factorized entropy-driven combination of the item attributes relevant to the user. KGFlex facilitates the training process by letting users update only those relevant features on which they base their decisions. In other words, the user-item prediction is mediated by the user’s personal view that considers only relevant features. An extensive experimental evaluation shows the approach’s effectiveness, considering the recommendation results’ accuracy, diversity, and induced bias. The public implementation of KGFlex is available at https://split.to/kgflex.

Recommender Systems have shown to be an effective way to alleviate the over-choice problem and provide accurate and tailored recommendations. However, the impressive number of proposed recommendation algorithms, splitting strategies, evaluation protocols, metrics, and tasks, has made rigorous experimental evaluation particularly challenging. Puzzled and frustrated by the continuous recreation of appropriate evaluation benchmarks, experimental pipelines, hyperparameter optimization, and evaluation procedures, we have developed an exhaustive framework to address such needs. Elliot is a comprehensive recommendation framework that aims to run and reproduce an entire experimental pipeline by processing a simple configuration file. The framework loads, filters, and splits the data considering a vast set of strategies (13 splitting methods and 8 filtering approaches, from temporal training-test splitting to nested K-folds Cross-Validation). Elliot(https://github.com/sisinflab/elliot) optimizes hyperparameters (51 strategies) for several recommendation algorithms (50), selects the best models, compares them with the baselines providing intra-model statistics, computes metrics (36) spanning from accuracy to beyond-accuracy, bias, and fairness, and conducts statistical analysis (Wilcoxon and Paired t-test).

Visual-based recommender systems (VRSs) enhance recommendation performance by integrating users' feedback with the visual features of items' images. Recently, human-imperceptible image perturbations, defined adversarial samples, have been shown capable of altering the VRSs performance, for example, by pushing (promoting) or nuking (demoting) specific categories of products. One of the most effective adversarial defense methods is adversarial training (AT), which enhances the robustness of the model by incorporating adversarial samples into the training process and minimizing an adversarial risk. The AT effectiveness has been verified on defending DNNs in supervised learning tasks such as image classification. However, the extent to which AT can protect deep VRSs, against adversarial perturbation of images remains mostly under-investigated. This work focuses on the defensive side of VRSs and provides general insights that could be further exploited to broaden the frontier in the field. First, we introduce a suite of adversarial attacks against DNNs on top of VRSs, and defense strategies to counteract them. Next, we present an evaluation framework, named Visual Adversarial Recommender (VAR), to empirically investigate the performance of defended or undefended DNNs in various visually-aware item recommendation tasks. The results of large-scale experiments indicate alarming risks in protecting a VRS through the DNN robustification. Source code and data are available at https://github.com/sisinflab/Visual-Adversarial-Recommendation.

The impact of data characteristics on the performance of classical recommender systems has been recently investigated and produced fruitful results about the relationship they have with recommendation accuracy. This work provides a systematic study on the impact of broadly chosen data characteristics (DCs) of recommender systems. This is applied to the accuracy and fairness of several variations of CF recommendation models. We focus on a suite of DCs that capture properties about the structure of the user–item interaction matrix, the rating frequency, item properties, or the distribution of rating values. Experimental validation of the proposed system involved large-scale experiments by performing 23,400 recommendation simulations on three real-world datasets in the movie (ML-100K and ML-1M) and book domains (BookCrossing). The validation results show that the investigated DCs in some cases can have up to 90% of explanatory power – on several variations of classical CF algorithms –, while they can explain – in the best case – about 40% of fairness results (measured according to user gender and age sensitive attributes). Therefore, this work evidences that it is more difficult to explain variations in performance when dealing with fairness dimension than accuracy.

Adversarial Machine Learning (AML) has initially emerged as the field of study that investigates security issues of conventional and modern machine learning (ML) models. The objective of this tutorial is to present a comprehensive overview on the application of AML techniques for recommendation in a two-fold categorization: (i) AML for the attack/defense purposes, and (ii) AML to build GAN-based recommender models. A theoretical presentation on the topics is paired with two corresponding hands-on sessions to show the efficacy of AML application and push up novel ideas and advances in recommendation tasks. The tutorial is divided into four parts. We start by introducing a summary on state-of-the-art recommender models, including deep learning ones, and we define the fundamentals of AML. Then, we present the Adversarial Recommendation Framework, to represent attack/defense strategies on RSs, and the GAN-based Recommendation Framework, which is at the basis of novel adversarial-based generative recommenders. The presentation of each framework is followed by a practical session. Finally, we conclude with open challenges and possible future works for both applications.

Shilling attacks against collaborative filtering (CF) models are characterized by several fake user profiles mounted on the system by an adversarial party to harvest recommendation outcomes toward a malicious desire. The vulnerability of CF models is directly tied with their reliance on the underlying interaction data ---like user-item rating matrix (URM) --- to train their models and their inherent inability to distinguish genuine profiles from non-genuine ones. The majority of works conducted so far for analyzing shilling attacks mainly focused on properties such as confronted recommendation models, recommendation outputs, and even users under attack. The under-researched element has been the impact of data characteristics on the effectiveness of shilling attacks on CF models.

Recommender systems (RS) are an integral part of many online services aiming to provide an enhanced user-oriented experience. Machine learning (ML) models are nowadays broadly adopted in modern state-of-the-art approaches to recommendation, which are typically trained to maximize a user-centred utility (e.g., user satisfaction) or a business-oriented one (e.g., profitability or sales increase). They work under the main assumption that users' historical feedback can serve as proper ground-truth for model training and evaluation. However, driven by the success in the ML community, recent advances show that state-of-the-art recommendation approaches such as matrix factorization (MF) models or the ones based on deep neural networks can be vulnerable to adversarial perturbations applied on the input data. These adversarial samples can impede the ability for training high-quality MF models and can put the driven success of these approaches at high risk.

Over the last years, we have been witnessing the advent of more and more precise and powerful recommendation algorithms and techniques able to effectively assess users' tastes and predict information that would probably be of interest for them. Most of these approaches rely on the collaborative paradigm (often exploiting machine learning techniques) and do not take into account the huge amount of knowledge, both structured and non-structured ones, describing the domain of interest of the recommendation engine. Although very effective in in predicting relevant items, collaborative approaches miss some very interesting features that go beyond the accuracy of results and move into the direction of providing novel and diverse results as well as generating an explanation for the recommended items or support interactive and conversational recommendation processes.

Hyper-parameters tuning is a crucial task to make a model perform at its best. However, despite the well-established methodologies, some aspects of the tuning remain unexplored. As an example, it may affect not just accuracy but also novelty as well as it may depend on the adopted dataset. Moreover, sometimes it could be sufficient to concentrate on a single parameter only (or a few of them) instead of their overall set. In this paper we report on our investigation on hyper-parameters tuning by performing an extensive 10-Folds Cross-Validation on MovieLens and Amazon Movies for three well-known baselines: User-kNN, Item-kNN, BPR-MF. We adopted a grid search strategy considering approximately 15 values for each parameter, and we then evaluated each combination of parameters in terms of accuracy and novelty. We investigated the discriminative power of nDCG, Precision, Recall, MRR, EFD, EPC, and, finally, we analyzed the role of parameters on model evaluation for Cross-Validation.

More and more precise and powerful recommendation algorithms and techniques have been proposed over the last years able to effectively assess users' tastes and predict information that would probably be of interest for them. Most of these approaches rely on the collaborative paradigm (often exploiting machine learning techniques) and do not take into account the huge amount of knowledge, both structured and non-structured ones, describing the domain of interest for the recommendation engine. The aim of knowledge-aware and conversational recommender systems is to go beyond the traditional accuracy goal and to start a new generation of algorithms and interactive approaches which exploit the knowledge encoded in ontological and logic-based knowledge bases, knowledge graphs as well as the semantics emerging from the analysis and exploitation of semi-structured textual sources.

Recommender systems are software tools and techniques which aim at suggesting to users items they might be interested in.Context-aware recommender systems are a particular category of recommender systems which exploit contextual information to provide more adequate recommendations.However, recommendation engines still suffer from the cold-start problem, namely where not enough information about users and their ratings is available.In this paper we introduce a method for generating a list of top k recommendations in a new user cold-start situations.It is based on a user model called Contextual Conditional Preferences and utilizes a satisfiability measure proposed in this paper.We analyze accuracy measures as well as serendipity, novelty and diversity of results obtained using three context-aware publicly available datasets in comparison with several contextual and traditional state-of-the-art baselines.We show that our method is applicable in the new user cold-start situations as well as in typical scenarios.

The main aim of data mining techniques and tools is that of identify and extract, from a set of (big) data, implicit patterns which can describe static or dynamic phenomena. Among these latter business processes are gaining more and more attention due to their crucial role in modern organizations and enterprises. Being able to identify and model processes inside organizations is for sure a key asset to discover their weak and strong points thus helping them in the improvement of their competitiveness. In this paper we describe a prototype system able to discover business processes from an event log and classify them with a suitable level of abstraction with reference to a related business ontology. The identified process, and its corresponding level of abstraction, depends on the knowledge encoded in the reference ontology which is dynamically exploited at runtime. The tool has been validated by considering examples and case studies from the literature on process mining.

In modern recommender systems, diversity has been widely acknowledged as an important factor to improve user experience and, more recently, intent-aware approaches to diversification have been proposed to provide the user with a list of recommendations covering different aspects of her behavior. In this paper, we propose and analyze the performances of two diversification methods taking into account temporal aspects of the user profile: in the first one we adopt a temporal decay function to emphasize the importance of more recent items in the user profile while in the second one we perform an evaluation based on the identification and analysis of temporal sessions. The two proposed methods have been implemented as temporal variants of the well-known xQuAD framework. In both cases, experimental results on Netflix 100M show an improvement in terms of accuracy-diversity balance.

Recommender systems aim to provide users with accurate item suggestions in a personalized fashion, but struggle in the case of cold start users, for whom there is a scarcity of preference data. User preferences can be either explicitly stated by the users — often by means of ratings —, or implicitly acquired by a system — for instance by mining text reviews, search queries, and purchase records. Recommendation methods have been mostly designed to deal with numerical ratings. However, real scenarios with user preferences expressed in the form of binary and unary (positive-only) feedback, e.g. the thumbs up/down in YouTube, and the likes in Facebook, are increasingly popular, and make the user cold start problem even more challenging. To address the cold start with positive-only feedback situations, we propose to exploit data additional to user preferences by means of specialized hybrid recommendation methods. In particular, we investigate a number of graph-based and matrix factorization recommendation models that jointly exploit user preferences and item semantic metadata automatically extracted from the well-known knowledge graph of DBpedia. Following a rigorous evaluation methodology for cold start, we empirically compare the above hybrid recommendation models on a Facebook dataset containing users likes for items in three different domains, namely books, movies and music. The achieved experimental results show that the semantics-aware hybrid approaches we propose outperform content-based and collaborative filtering baselines. In addition to recommendation accuracy, in our evaluation we also consider individual and aggregate diversity of recommendations as key quality factors in the users’ satisfaction.

The Web has moved, slowly but steadily, from a collection of documents towards a collection of structured data. Knowledge graphs have then emerged as a way of representing the knowledge encoded in such data as well as a tool to reason on them in order to extract new and implicit information. Knowledge graphs are currently used, for example, to explain search results, to explore knowledge spaces, to semantically enrich textual documents, or to feed knowledge-intensive applications such as recommender systems. In this work, we describe how to create and exploit a knowledge graph to supply a hybrid recommendation engine with information that builds on top of a collections of documents describing musical and sound items. Tags and textual descriptions are exploited to extract and link entities to external graphs such as WordNet and DBpedia, which are in turn used to semantically enrich the initial data. By means of the knowledge graph we build, recommendations are computed using a feature combination hybrid approach. Two explicit graph feature mappings are formulated to obtain meaningful item feature representations able to catch the knowledge embedded in the graph. Those content features are further combined with additional collaborative information deriving from implicit user feedback. An extensive evaluation on historical data is performed over two different datasets: a dataset of sounds composed of tags, textual descriptions, and user’s download information gathered from Freesound.org and a dataset of songs that mixes song textual descriptions with tags and user’s listening habits extracted from Songfacts.com and Last.fm, respectively. Results show significant improvements with respect to state-of-the-art collaborative algorithms in both datasets. In addition, we show how the semantic expansion of the initial descriptions helps in achieving much better recommendation quality in terms of aggregated diversity and novelty.

Computing useful recommendations for cold-start users is a major challenge in the design of recommender systems, and additional data is often required to compensate the scarcity of user feedback. In this paper we address such problem in a target domain by exploiting user preferences from a related auxiliary domain. Following a rigorous methodology for cold-start, we evaluate a number of recommendation methods on a dataset with positive-only feedback in the movie and music domains, both in single and cross-domain scenarios. Comparing the methods in terms of item ranking accuracy, diversity and catalog coverage, we show that cross-domain preference data is useful to provide more accurate suggestions when user feedback in the target domain is scarce or not available at all, and may lead to more diverse recommendations depending on the target domain. Moreover, evaluating the impact of the user profile size and diversity in the source domain, we show that, in general, the quality of target recommendations increases with the size of the profile, but may deteriorate with too diverse profiles.

In most real-world scenarios, the ultimate goal of recommender system applications is to suggest a short ranked list of items, namely top- N recommendations, that will appeal to the end user. Often, the problem of computing top- N recommendations is mainly tackled with a two-step approach. The system focuses first on predicting the unknown ratings, which are eventually used to generate a ranked recommendation list. Actually, the top- N recommendation task can be directly seen as a ranking problem where the main goal is not to accurately predict ratings but to directly find the best-ranked list of items to recommend. In this article we present SPrank, a novel hybrid recommendation algorithm able to compute top- N recommendations exploiting freely available knowledge in the Web of Data. In particular, we employ DBpedia, a well-known encyclopedic knowledge base in the Linked Open Data cloud, to extract semantic path-based features and to eventually compute top- N recommendations in a learning-to-rank fashion. Experiments with three datasets related to different domains (books, music, and movies) prove the effectiveness of our approach compared to state-of-the-art recommendation algorithms.

Providing very accurate recommendations to end users has been nowadays recognized to be just one of the main tasks a recommender systems must be able to perform. While predicting relevant suggestions, attention needs to be paid to their diversification in order to avoid monotony in recommendation. In this paper we focus on modeling users' inclination toward selecting diverse items, where diversity is computed by means of content-based item attributes. We then exploit such modeling to present a novel approach to re-rank the list of Top-N items predicted by a recommendation algorithm, in order to foster diversity in the final ranking. Experimental evaluation proves the effectiveness of the proposed approach.

The primary goal of the workshop is to showcase cutting edge research on the intersection of Recommender Systems and Semantic Technologies, by taking the best of the two worlds. This combination may provide the RecSys community with important scenarios where the potential of Semantic Technologies can be effectively exploited into systems performing complex tasks, such as recommendation engines processing Big Data.

The advent of the Linked Open Data (LOD) initiative gave birth to a variety of open knowledge bases freely accessible on the Web. They provide a valuable source of information that can improve conventional recommender systems, if properly exploited. In this paper we present SPrank, a novel hybrid recommendation algorithm able to compute top-N item recommendations from implicit feedback exploiting the information available in the so called Web of Data. We leverage DBpedia, a well-known knowledge base in the LOD compass, to extract semantic path-based features and to eventually compute recommendations using a learning to rank algorithm. Experiments with datasets on two different domains show that the proposed approach outperforms in terms of prediction accuracy several state-of-the-art top-N recommendation algorithms for implicit feedback in situations affected by different degrees of data sparsity.

The availability of a huge amount of interconnected data in the so called Web of Data (WoD) paves the way to a new generation of applications able to exploit the information encoded in it. In this paper we present a model-based recommender system leveraging the datasets publicly available in the Linked Open Data (LOD) cloud as DBpedia and LinkedMDB. The proposed approach adapts support vector machine (SVM) to deal with RDF triples. We tested our system and showed its effectiveness by a comparison with different recommender systems techniques -- both content-based and collaborative filtering ones.

SUMMARY Feature modeling an attractive technique for capturing commonality as well as variability within an application domain for generative programming and software product line engineering. Feature models symbolize an overarching representation of the possible application configuration space, and can hence be customized based on specific domain requirements and stakeholder goals. Most interactive or semi‐automated feature model customization processes neglect the need to have a holistic approach towards the integration and satisfaction of the stakeholder's soft and hard constraints, and the application‐domain integrity constraints. In this paper, we will show how the structure and constraints of a feature model can be modeled uniformly through Propositional Logic extended with concrete domains, called Pscr (𝒩). Furthermore, we formalize the representation of soft constraints in fuzzy 𝒫(𝒩) and explain how semi‐automated feature model customization is performed in this setting. The model configuration derivation process that we propose respects the soundness and completeness properties. Copyright © 2011 John Wiley & Sons, Ltd.

One of the main problems in online advertising is to display ads which are relevant and appropriate w.r.t. what the user is looking for. Often search engines fail to reach this goal as they do not consider semantics attached to keywords. In this paper we propose a system that tackles the problem by two different angles: help (i) advertisers to create more efficient ads campaigns and (ii) ads providers to properly match ads content to keywords in search engines. We exploit semantic relations stored in the DBpedia dataset and use an hybrid ranking system to rank keywords and to expand queries formulated by the user. Inputs of our ranking system are (i) the DBpedia dataset; (ii) external information sources such as classical search engine results and social tagging systems. We compare our approach with other RDF similarity measures, proving the validity of our algorithm with an extensive evaluation involving real users.

Non-standard reasoning in Description Logics (DLs) comprises computing a Least Common Subsumer (LCS), a Concept Difference, a Concept Unifier, or an Interpolant Concept, to name a few. Although some reasoning services have been unified already (e.g., LCS and Most Specific Concept), the definition of non-standard problems and the computation that solve them are very different from each other. We propose to unify the definitions of non-standard services as special Second-order sentences in DLs; when the solution concepts are optimal with respect to some preferences, a fixpoint replaces the Second-order quantification. Moreover, we propose to combine the well-known Tableaux calculi for DLs with rules that compute substitutions of Concept Variables. We prove soundness and completeness of the combined calculus and we give a sufficient condition for termination, which covers some non-trivial cases.

A ubiquitous Knowledge Base (u-KB) is a distributed and decentralized knowledge base where the factual knowledge (i.e. individuals) is scattered among objects disseminated within the environment with no centralized coordination. This paper presents an extended framework to enable u-KBs in mobile scenarios where a semantic discovery is carried out using metadata stored in RFIDs without fixed repositories. A dissemination protocol allows an on-demand retrieval of suitable descriptions directly from tags located on the objects. Such a vision allows to build a truly pervasive environment where autonomous objects compose a self-organized evolving discovery architecture suitable for u-Commerce purposes.

The paper focuses on an implementation of concept abduction with an Object-oriented Database Management System (OODBMS). OWL-DL Knowledge Bases have been translated to an OO version to enable standard and non-standard inference services as queries over a DB suitable for handheld devices. The framework has been implemented and tested: early experiments are reported.

In this paper we propose an extended version of the open source jUDDI implementation by the Apache Software Foundation, adapted to pervasive RFID contexts. The registry \nadopts an OWL-S 1.1 Pro¯le instance annotation of mobile services and resources. Ontology-based metadata are \nexploited in order to perform a semantic-based service discovery w.r.t. a given request. The proposed framework \nhas been devised for pervasive RFID-based logistics environments. A case study is presented along with experimental results on a prototype implementation.

In a generic semantic-based matchmaking process, given a request, it is desirable to obtain a ranked list of compatible services/resources/profiles in order of relevance. Furthermore, a match explanation can provide useful information to modify or refine the original request in a principled way. Though the feasibility of such an approach has been proved with fixed reasoning engines, it is a challenging subject to perform inference tasks on handheld devices. Here we propose abduction and contraction algorithms in Description Logics specifically devised for applications in mobile environments. A simple interaction paradigm based on Bluetooth protocol stack has also been implemented and tested in a mobile dating case study.

We propose a novel object discovery framework integrating the application layer of Bluetooth and RFID standards. The approach is motivated and illustrated in an innovative u-commerce setting. Given a request, it allows an advanced discovery process, exploiting semantically annotated descriptions of goods available in the u-marketplace. The RFID data exchange protocol and the Bluetooth service discovery protocol have been modified and enhanced to enable support for such semantic annotation of products. Modifications to the standards have been conceived to be backward compatible, thus allowing the smooth coexistence of the legacy discovery and/or identification features. Also noteworthy is the introduction of a dedicated compression tool to reduce storage/transmission problems due to the verbosity of XML-based semantic languages.

We present a novel resource discovery framework for u-commerce. Both the original RFID data exchange protocol and the Bluetooth Service Discovery Protocol have been extended in order to enable support for the semantic annotation of products and goods. Given a request, the approach we propose allows an enhanced discovery process exploiting the semantics of resource descriptions available in a u-marketplace. The enhancement is backward compatible with both the original discovery protocols, thus allowing the smooth coexistence of the resource discovery and/or identification approaches. We present and motivate our approach in an innovative u-commerce framework, and show its benefits.

Matchmaking arises when supply and demand meet in an electronic marketplace, or when agents search for a web service to perform some task, or even when recruiting agencies match curricula and job profiles. In such open environments, the objective of a matchmaking process is to discover best available offers to a given request. We address the problem of matchmaking from a knowledge representation perspective, with a formalization based on Description Logics. We devise Concept Abduction and Concept Contraction as non-monotonic inferences in Description Logics suitable for modeling matchmaking in a logical framework, and prove some related complexity results. We also present reasonable algorithms for semantic matchmaking based on the devised inferences, and prove that they obey to some commonsense properties. Finally, we report on the implementation of the proposed matchmaking framework, which has been used both as a mediator in e-marketplaces and for semantic web services discovery.

This paper presents a visual application in the framework of semantic-enabled e-marketplaces aimed at fully exploiting semantics of supply/demand descriptions in B2C and C2C e-marketplaces. Distinguishing aspects of the framework include logic-based explanation of request results, semantic ranking of matchmaking results, logic-based request refinement. The visual user interface has been designed and implemented to be immediate and simple, and it requires no knowledge of any logic principle to be fully used.

In this paper we present a knowledge-based approach to the elicitation of information from advertisements, in the framework of a semantic-enabled marketplace. The elicited information can be used for advertisements enriching and refining, without requiring users thorough knowledge of the domain, and to determine a logicbased exact match. The approach exploits non-standard inference services in Description Logics, namely Abduction and Contraction, to tackle a typical problem of semantic-enabled marketplaces, that is the difficulty the average or casual user has in exploiting all the knowledge expressed in an e-commerce domain, which appears necessary to issue requests. We present an algorithm, which returns the set of concepts not included in the request-that can be used for query refinement- and more interesting what is still missing for each available supply, to obtain an exact, bidirectional, match.

We propose a framework and polynomial algorithms for semantic-based automated Web service orchestration, fully compliant with semantic Web technologies. The approach exploits the recently proposed concept abduction inference service in description logics to solve concept covering problems. We present how the proposed approach deals with not exact solutions, computing an approximate orchestration with respect to an agent request modeled using a significant subset of OWL-DL.

We propose a collaborative environment for semantic-enabled mobile devices (e.g. PDAs, cell phones, laptops) in peer to peer scenarios. Within the environment, resource discovery is performed exploiting technologies and techniques for knowledge representation developed for the semantic Web, which have been adapted to cope with the highly flexible structure of ad-hoc networks in ubiquitous computing. The approach exploits the standard Bluetooth stack, using the original UUID payload, to carry semantically annotated data. The environment is motivated and presented in a museum case study.

In this paper we present a Description Logic approach to extended matchmaking between Demands and Supplies in an Electronic Marketplace, which allows the semantic-based treatment of negotiable and strict requirements in the description.To this aim we exploit two novel non-standard Description Logic inference services, Concept Contraction -which extends satisfiability-and Concept Abduction -which extends subsumption.Based on these services we devise algorithms to find negotiation spaces and to determine the quality of a possible match, also in the presence of a distinction between strictly required and optional elements.

More and more resources are becoming available on the Web, and there is a growing need for infrastructures that, based on advertised descriptions, are able to semantically match demands with supplies.We formalize general properties a matchmaker should have, then we present a matchmaking facilitator, compliant with desired properties.The system embeds a NeoClassic reasoner, whose structural subsumption algorithm has been modified to allow match categorization into potential and partial, and ranking of matches within categories. Experiments carried out show the good correspondence between users and system rankings.