VLDB 2026 Research / reviewers in the wild / expert
Vito Walter Anelli
dblp:171/0384
· DBLP profile ↗
40ranked-venue papers in the field
27as first author
32since 2021 · last 2026
0000-0002-5567-4307ORCID · verified
Domains — venue-derived; a paper can count in several
Information Retrieval & Web Search · 35 (23 first)Knowledge Engineering, Semantic Web & Information Systems · 4 (3 first)Database Systems & Data Management · 1 (1 first)
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | ACE: Semantically-Grounded Graph Alignment via Affective Contrastive LearningabstractGraph Contrastive Learning (GCL) methods for recommendation learn representations by propagating signals over user-item interaction graphs. However, modeling these graphs with homogeneous edges can lead to semantic-structural misalignment, where information is exchanged between structurally adjacent but semantically dissimilar items, adversely affecting retrieval quality. Existing solutions typically rely on auxiliary encoders or additional supervision, increasing model complexity and training cost. We propose ACE (Affective Contrastive Embeddings), a framework that improves representation alignment by incorporating affective semantics into contrastive learning. ACE encodes the affective dimensions of valence and arousal as a topological prior, encouraging consistency between learned embeddings and an affective semantic space distilled from large language models. To operationalize this alignment, we introduce a Semantically Weighted Noise Contrastive Estimation (SW-NCE) loss that modulates contrastive gradients according to users' affective preferences. Experiments on Amazon, Last.fm, and SiTunes demonstrate that ACE consistently improves top-K retrieval performance over 11 baselines while reducing computational overhead. These results indicate that affective geometric alignment is an effective and efficient mechanism for enhancing graph-based retrieval models. Potito Aghilar, Sabino Roccotelli, Vito Walter Anelli, Alejandro Bellogín, Michelantonio Trizio, Tommaso Di Noia |
SIGIR | 3 |
| 2025 | Balancing Accuracy and Novelty with Sub-Item PopularityabstractIn the realm of music recommendation, sequential recommenders have shown promise in capturing the dynamic nature of music consumption. A key characteristic of this domain is repetitive listening, where users frequently replay familiar tracks. To capture these repetition patterns, recent research has introduced Personalised Popularity Scores (PPS), which quantify user-specific preferences based on historical frequency. While PPS enhances relevance in recommendation, it often reinforces already-known content, limiting the system’s ability to surface novel or serendipitous items—key elements for fostering long-term user engagement and satisfaction. To address this limitation, we build upon RecJPQ, a Transformer-based framework initially developed to improve scalability in large-item catalogues through sub-item decomposition. We repurpose RecJPQ’s sub-item architecture to model personalised popularity at a finer granularity. This allows us to capture shared repetition patterns across sub-embeddings—latent structures not accessible through item-level popularity alone. We propose a novel integration of sub-ID-level personalised popularity within the RecJPQ framework, enabling explicit control over the trade-off between accuracy and personalised novelty. Our sub-ID-level PPS method (sPPS) consistently outperforms item-level PPS by achieving significantly higher personalised novelty without compromising recommendation accuracy. Code and experiments are publicly available at https://github.com/sisinflab/Sub-id-Popularity. Chiara Mallamaci, Aleksandr V. Petrov, Alberto Carlo Maria Mancino, Vito Walter Anelli, Tommaso Di Noia, Craig Macdonald |
RecSys | 4 |
| 2025 | Do LLMs Memorize Recommendation Datasets? A Preliminary Study on MovieLens-1MabstractLarge Language Models (LLMs) have become increasingly central to recommendation scenarios due to their remarkable natural language understanding and generation capabilities. Although significant research has explored the use of LLMs for various recommendation tasks, little effort has been dedicated to verifying whether they have memorized public recommendation dataset as part of their training data. This is undesirable because memorization reduces the generalizability of research findings, as benchmarking on memorized datasets does not guarantee generalization to unseen datasets. Furthermore, memorization can amplify biases, for example, some popular items may be recommended more frequently than others. Dario Di Palma, Felice Antonio Merra, Maurizio Sfilio, Vito Walter Anelli, Fedelucio Narducci, Tommaso Di Noia |
SIGIR | 4 |
| 2024 | Enhancing Sequential Music Recommendation with Personalized Popularity AwarenessabstractIn the realm of music recommendation, sequential recommender systems have shown promise in capturing the dynamic nature of music consumption. Nevertheless, traditional Transformer-based models, such as SASRec and BERT4Rec, while effective, encounter challenges due to the unique characteristics of music listening habits. In fact, existing models struggle to create a coherent listening experience due to rapidly evolving preferences. Moreover, music consumption is characterized by a prevalence of repeated listening, i.e. users frequently return to their favourite tracks, an important signal that could be framed as individual or personalized popularity. This paper addresses these challenges by introducing a novel approach that incorporates personalized popularity information into sequential recommendation. By combining user-item popularity scores with model-generated scores, our method effectively balances the exploration of new music with the satisfaction of user preferences. Experimental results demonstrate that a Personalized Most Popular recommender, a method solely based on user-specific popularity, outperforms existing state-of-the-art models. Furthermore, augmenting Transformer-based models with personalized popularity awareness yields superior performance, showing improvements ranging from 25.2% to 69.8%. The code for this paper is available at https://github.com/sisinflab/personalized-popularity-awareness. Davide Abbattista, Vito Walter Anelli, Tommaso Di Noia, Craig Macdonald, Aleksandr V. Petrov |
RecSys | 2 |
| 2024 | Sixth Knowledge-aware and Conversational Recommender Systems Workshop (KaRS)abstractRecommender systems, though widely used, often struggle to engage users effectively. While deep learning methods have enhanced connections between users and items, they often neglect the user’s perspective. Knowledge-based approaches, utilizing knowledge graphs, offer semantic insights and address issues like knowledge graph embeddings, hybrid recommendation, and interpretable recommendation. More recently, neural-symbolic systems, combining data-driven and symbolic techniques, show promise in recommendation systems, especially when used with knowledge graphs. Moreover, content features become vital in conversational recommender systems, which demand multi-turn dialogues. Recent literature highlights increasing interest in this area, particularly with the emergence of Large Language Models (LLMs), which excel in understanding user queries and generating recommendations in natural language. Sixth Knowledge-aware and Conversational Recommender Systems (KaRS) Workshop aims to disseminate advancements and discuss about challenges and opportunities. Vito Walter Anelli, Antonio Ferrara 0001, Cataldo Musto, Fedelucio Narducci, Azzurra Ragone, Markus Zanker |
RecSys | 1 |
| 2024 | A Novel Evaluation Perspective on GNNs-based Recommender Systems through the Topology of the User-Item GraphabstractRecently, graph neural networks (GNNs)-based recommender systems have encountered great success in recommendation. As the number of GNNs approaches rises, some works have started questioning the theoretical and empirical reasons behind their superior performance. Nevertheless, this investigation still disregards that GNNs treat the recommendation data as a topological graph structure. Building on this assumption, in this work, we provide a novel evaluation perspective on GNNs-based recommendation, which investigates the impact of the graph topology on the recommendation performance. To this end, we select some (topological) properties of the recommendation data and three GNNs-based recommender systems (i.e., LightGCN, DGCF, and SVD-GCN). Then, starting from three popular recommendation datasets (i.e., Yelp2018, Gowalla, and Amazon-Book) we sample them to obtain 1,800 size-reduced datasets that still resemble the original ones but can encompass a wider range of topological structures. We use this procedure to build a large pool of samples for which data characteristics and recommendation performance of the selected GNNs models are measured. Through an explanatory framework, we find strong correspondences between graph topology and GNNs performance, offering a novel evaluation perspective on these models. Daniele Malitesta, Claudio Pomo, Vito Walter Anelli, Alberto Carlo Maria Mancino, Tommaso Di Noia, Eugenio Di Sciascio |
RecSys | 3 |
| 2024 | PRONTO: Prompt-Based Detection of Semantic Containment Patterns in MLMs
Alessandro De Bellis, Vito Walter Anelli, Tommaso Di Noia, Eugenio Di Sciascio |
ISWC (2) | 2 |
| 2023 | Post-hoc Selection of Pareto-Optimal Solutions in Search and RecommendationabstractInformation Retrieval (IR) and Recommender Systems (RSs) tasks are moving from computing a ranking of final results based on a single metric to multi-objective problems. Solving these problems leads to a set of Pareto-optimal solutions, known as Pareto frontier, in which no objective can be further improved without hurting the others. In principle, all the points on the Pareto frontier are potential candidates to represent the best model selected with respect to the combination of two, or more, metrics. To our knowledge, there are no well-recognized strategies to decide which point should be selected on the frontier in IR and RSs. In this paper, we propose a novel, post-hoc, theoretically-justified technique, named "Population Distance from Utopia" (PDU), to identify and select the one-best Pareto-optimal solution. PDU considers fine-grained utopia points, and measures how far each point is from its utopia point, allowing to select solutions tailored to user preferences, a novel feature we call "calibration". We compare PDU against state-of-the-art strategies through extensive experiments on tasks from both IR and RS, showing that PDU combined with calibration notably impacts the solution selection. Vincenzo Paparella, Vito Walter Anelli, Franco Maria Nardini, Raffaele Perego 0001, Tommaso Di Noia |
CIKM | 2 |
| 2023 | Auditing Consumer- and Producer-Fairness in Graph Collaborative Filtering
Vito Walter Anelli, Yashar Deldjoo, Tommaso Di Noia, Daniele Malitesta, Vincenzo Paparella, Claudio Pomo |
ECIR (1) | 1 |
| 2023 | Fifth Knowledge-aware and Conversational Recommender Systems Workshop (KaRS)abstractRecommender systems have become ubiquitous in daily life, but their limitations in interacting with human users have become evident. Deep learning approaches have led to the development of data-driven algorithms that identify connections between users and items, but they often miss a critical actor in the loop - the end-user. Knowledge-based approaches are gaining attention due to the availability of knowledge-graphs, such as DBpedia and Wikidata, which provide semantics-aware information on different knowledge domains. These approaches are being used for recommendation and challenges such as knowledge graph embeddings, hybrid recommendation, and interpretable recommendation. Moreover, the emergence of neural-symbolic systems, which combine data-driven and symbolic methods, can significantly improve recommendation systems. A growing number of research papers on such topics demonstrate the growing interest and research potential of these systems. Furthermore, content features become crucial when interaction requires it. The development of conversational recommender systems presents new challenges, as they require multi-turn dialogues between users and systems, blurring the line between recommendation and retrieval. Evaluation of these systems goes beyond simple accuracy metrics and is hampered by the limited availability of datasets. While research and development into conversational recommender systems has been less prominent in the past, recent literature shows growing interest and potential for these systems. Vito Walter Anelli, Pierpaolo Basile, Gerard de Melo, Francesco M. Donini, Antonio Ferrara 0001, Cataldo Musto, Fedelucio Narducci, Azzurra Ragone, Markus Zanker |
RecSys | 1 |
| 2023 | Challenging the Myth of Graph Collaborative Filtering: a Reasoned and Reproducibility-driven AnalysisabstractThe success of graph neural network-based models (GNNs) has significantly advanced recommender systems by effectively modeling users and items as a bipartite, undirected graph. However, many original graph-based works often adopt results from baseline papers without verifying their validity for the specific configuration under analysis. Our work addresses this issue by focusing on the replicability of results. We present a code that successfully replicates results from six popular and recent graph recommendation models (NGCF, DGCF, LightGCN, SGL, UltraGCN, and GFCF) on three common benchmark datasets (Gowalla, Yelp 2018, and Amazon Book). Additionally, we compare these graph models with traditional collaborative filtering models that historically performed well in offline evaluations. Furthermore, we extend our study to two new datasets (Allrecipes and BookCrossing) that lack established setups in existing literature. As the performance on these datasets differs from the previous benchmarks, we analyze the impact of specific dataset characteristics on recommendation accuracy. By investigating the information flow from users’ neighborhoods, we aim to identify which models are influenced by intrinsic features in the dataset structure. The code to reproduce our experiments is available at: https://github.com/sisinflab/Graph-RSs-Reproducibility. Vito Walter Anelli, Daniele Malitesta, Claudio Pomo, Alejandro Bellogín, Eugenio Di Sciascio, Tommaso Di Noia |
RecSys | 1 |
| 2023 | Reproducibility of Multi-Objective Reinforcement Learning Recommendation: Interplay between Effectiveness and Beyond-Accuracy PerspectivesabstractProviding effective suggestions is of predominant importance for successful Recommender Systems (RSs). Nonetheless, the need of accounting for additional multiple objectives has become prominent, from both the final users’ and the item providers’ points of view. This need has led to a new class of RSs, called Multi-Objective Recommender Systems (MORSs). These systems are designed to provide suggestions by considering multiple (conflicting) objectives simultaneously, such as diverse, novel, and fairness-aware recommendations. In this work, we reproduce a state-of-the-art study on MORSs that exploits a reinforcement learning agent to satisfy three objectives, i.e., accuracy, diversity, and novelty of recommendations. The selected study is one of the few MORSs where the source code and datasets are released to ensure the reproducibility of the proposed approach. Interestingly, we find that some challenges arise when replicating the results of the original work, due to the nature of multiple-objective problems. We also extend the evaluation of the approach to analyze the impact of improving user-centered objectives of recommendations (i.e., diversity and novelty) in terms of algorithmic bias. To this end, we take into consideration both popularity and category of the items. We discover some interesting trends in the recommendation performance according to different evaluation metrics. In addition, we see that the multi-objective reinforcement learning approach is responsible for increasing the bias disparity in the output of the recommendation algorithm for those items belonging to positively/negatively biased categories. We publicly release datasets and codes in the following GitHub repository: https://github.com/sisinflab/MORS_reproducibility. Vincenzo Paparella, Vito Walter Anelli, Ludovico Boratto, Tommaso Di Noia |
RecSys | 2 |
| 2023 | Broadening the Scope: Evaluating the Potential of Recommender Systems beyond prioritizing AccuracyabstractAlthough beyond-accuracy metrics have gained attention in the last decade, the accuracy of recommendations is still considered the gold standard to evaluate Recommender Systems (RSs). This approach prioritizes the accuracy of recommendations, neglecting the quality of suggestions to enhance user needs, such as diversity and novelty, as well as trustworthiness regulations in RSs for user and provider fairness. As a result, single metrics determine the success of RSs, but this approach fails to consider other criteria simultaneously. A downside of this method is that the most accurate model configuration may not excel in addressing the remaining criteria. This study seeks to broaden RS evaluation by introducing a multi-objective evaluation that considers all model configurations simultaneously under several perspectives. To achieve this, several hyper-parameter configurations of an RS model are trained, and the Pareto-optimal ones are retrieved. The Quality Indicators (QI) of Pareto frontiers, which are gaining interest in Multi-Objective Optimization research, are adapted to RSs. QI enables evaluating the model’s performance by considering various configurations and giving the same importance to each metric. The experiments show that this multi-objective evaluation overturns the ranking of performance among RSs, paving the way to revisit the evaluation approaches of the RecSys research community. We release codes and datasets in the following GitHub repository: https://github.com/sisinflab/RecMOE. Vincenzo Paparella, Dario Di Palma, Vito Walter Anelli, Tommaso Di Noia |
RecSys | 3 |
| 2023 | Trustworthy Recommender Systems: Technical, Ethical, Legal, and Regulatory PerspectivesabstractThis tutorial provides an interdisciplinary overview about the topics of fairness, non-discrimination, transparency, privacy, and security in the context of recommender systems. These are important dimensions of trustworthy AI systems according to European policies, but also extend to the global debate on regulating AI technology. Since we strongly believe that the aforementioned aspects require more than merely technical considerations, we discuss these topics also from ethical, legal, and regulatory points of views, intertwining different perspectives. The main focus of the tutorial is still on presenting technical solutions that aim at addressing the mentioned topics of trustworthiness. In addition, the tutorial equips the mostly technical audience of RecSys with the necessary understanding of the social and ethical implications of their research and development, and of recent ethical guidelines and regulatory frameworks. Markus Schedl, Vito Walter Anelli, Elisabeth Lex |
RecSys | 2 |
| 2023 | Denoise to Protect: A Method to Robustify Visual Recommenders from AdversariesabstractWhile the integration of product images enhances the recommendation performance of visual-based recommender systems (VRSs), this can make the model vulnerable to adversaries that can produce noised images capable to alter the recommendation behavior. Recently, stronger and stronger adversarial attacks have emerged to raise awareness of these risks; however, effective defense methods are still an urgent open challenge. In this work, we propose "Adversarial Image Denoiser" (AiD), a novel defense method that cleans up the item images by malicious perturbations. In particular, we design a training strategy whose denoising objective is to minimize both the visual differences between clean and adversarial images and preserve the ranking performance in authentic settings. We perform experiments to evaluate the efficacy of AiD using three state-of-the-art adversarial attacks mounted against standard VRSs. Code and datasets at https://github.com/sisinflab/Denoise-to-protect-VRS. Felice Antonio Merra, Vito Walter Anelli, Tommaso Di Noia, Daniele Malitesta, Alberto Carlo Maria Mancino |
SIGIR | 2 |
| 2023 | Auditing fairness under unawareness through counterfactual reasoning
Giandomenico Cornacchia, Vito Walter Anelli, Giovanni Maria Biancofiore, Fedelucio Narducci, Claudio Pomo, Azzurra Ragone, Eugenio Di Sciascio |
Inf. Process. Manag. | 2 |
| 2023 | KGFlex: Efficient Recommendation with Sparse Feature Factorization and Knowledge GraphsabstractCollaborative filtering models have undoubtedly dominated the scene of recommender systems in recent years. However, due to the little use of content information, they narrowly focus on accuracy, disregarding a higher degree of personalization. Meanwhile, knowledge graphs are arousing considerable interest in recommendation models thanks to their ability to enrich the system with content features that captures subtle user-item relations. Nevertheless, with many high-quality features, the models become more complex and challenging to train. We extend KGFlex [ 16 ], a hybrid model that analyzes historical data to understand the semantic features the user decisions depend on. KGFlex represents item features as embeddings, and it models user-item interactions as a factorized entropy-driven combination of the item attributes relevant to the user, thus reducing the complexity and raising the degree of personalization. The method does not neglect long tail items, reducing the popularity bias and ensuring a high level of fairness. The user-item prediction is mediated by the user’s personal views of the embeddings that grant a high degree of expressiveness. This extension analyzes different entropy measurement strategies, an enhanced user negative decision modeling, and assesses the fairness of KGFlex and the impact of its hyperparameters. KGFlex is available at https://split.to/kgflex . Antonio Ferrara 0001, Vito Walter Anelli, Alberto Carlo Maria Mancino, Tommaso Di Noia, Eugenio Di Sciascio |
Trans. Recomm. Syst. | 2 |
| 2022 | Interpretability of BERT Latent Space through Knowledge GraphsabstractThe advent of pretrained language have renovated the ways of handling natural languages, improving the quality of systems that rely on them. BERT played a crucial role in revolutionizing the Natural Language Processing (NLP) area. However, the deep learning framework it implements lacks interpretability. Thus, recent research efforts aimed to explain what BERT learns from the text sources exploited to pre-train its linguistic model. In this paper, we analyze the latent vector space resulting from the BERT context-aware word embeddings. We focus on assessing whether regions of the BERT vector space hold an explicit meaning attributable to a Knowledge Graph (KG). First, we prove the existence of explicitly meaningful areas through the Link Prediction (LP) task. Then, we demonstrate these regions being linked to explicit ontology concepts of a KG by learning classification patterns. To the best of our knowledge, this is the first attempt at interpreting the BERT learned linguistic knowledge through a KG relying on its pretrained context-aware word embeddings. Vito Walter Anelli, Giovanni Maria Biancofiore, Alessandro De Bellis, Tommaso Di Noia, Eugenio Di Sciascio |
CIKM | 1 |
| 2022 | Fourth Knowledge-aware and Conversational Recommender Systems Workshop (KaRS)abstractIn the last few years, a renewed interest of the research community in conversational recommender systems (CRSs) has been emerging. This is likely due to the massive proliferation of Digital Assistants (DAs) such as Amazon Alexa, Siri, or Google Assistant that are revolutionizing the way users interact with machines. DAs allow users to execute a wide range of actions through an interaction mostly based on natural language utterances. However, although DAs are able to complete tasks such as sending texts, making phone calls, or playing songs, they still remain at an early stage in terms of their recommendation capabilities via a conversation. In addition, we have been witnessing the advent of increasingly precise and powerful recommendation algorithms and techniques able to effectively assess users’ tastes and predict information that may be of interest to them. Most of these approaches rely on the collaborative paradigm (often exploiting machine learning techniques) and neglect the huge amount of knowledge, both structured and unstructured, describing the domain of interest of a recommendation engine. Although very effective in predicting relevant items, collaborative approaches miss some very interesting features that go beyond the accuracy of results and move in the direction of providing novel and diverse results as well as generating explanations for recommended items. Knowledge-aware side information becomes crucial when a conversational interaction is implemented, in particular for preference elicitation, explanation, and critiquing steps. Vito Walter Anelli, Pierpaolo Basile, Gerard de Melo, Francesco M. Donini, Antonio Ferrara 0001, Cataldo Musto, Fedelucio Narducci, Azzurra Ragone, Markus Zanker |
RecSys | 1 |
| 2022 | User-controlled federated matrix factorization for recommender systems
Vito Walter Anelli, Yashar Deldjoo, Tommaso Di Noia, Antonio Ferrara 0001, Fedelucio Narducci |
J. Intell. Inf. Syst. | 1 |
| 2022 | Semantic Interpretation of Top-N RecommendationsabstractOver the years, model-based approaches have shown their effectiveness in computing recommendation lists in different domains and settings. By relying on the computation of latent factors, they can recommend items with a very high level of accuracy. Unfortunately, when moving to the latent space, even if the model embeds content-based information, we miss references to the actual semantics of the recommended item. It makes the interpretation of the recommendation process non-trivial. In this paper, we show how to initialize latent factors in Factorization Machines by using semantic features coming from knowledge graphs to train an interpretable model, which is, in turn, able to provide recommendations with a high level of accuracy. In the presented approach, semantic features are injected into the learning process to retain the original informativeness of the items available in the dataset. By relying on the information encoded in the original knowledge graph, we also propose two metrics to evaluate the semantic accuracy and robustness of knowledge-aware interpretability. An extensive experimental evaluation on six different datasets shows the effectiveness of the interpretable model in terms of both accuracy and diversity of recommendation results and interpretability robustness. Vito Walter Anelli, Tommaso Di Noia, Eugenio Di Sciascio, Azzurra Ragone, Joseph Trotta |
IEEE Trans. Knowl. Data Eng. | 1 |
| 2021 | A Formal Analysis of Recommendation Quality of Adversarially-trained RecommendersabstractRecommender systems (RSs) employ user-item feedback, e.g., ratings, to match customers to personalized lists of products. Approaches to top-k recommendation mainly rely on Learning-To-Rank algorithms and, among them, the most widely adopted is Bayesian Personalized Ranking (BPR), which bases on a pair-wise optimization approach. Recently, BPR has been found vulnerable against adversarial perturbations of its model parameters. Adversarial Personalized Ranking (APR) mitigates this issue by robustifying BPR via an adversarial training procedure. The empirical improvements of APR's accuracy performance on BPR have led to its wide use in several recommender models. However, a key overlooked aspect has been the beyond-accuracy performance of APR, i.e., novelty, coverage, and amplification of popularity bias, considering that recent results suggest that BPR, the building block of APR, is sensitive to the intensification of biases and reduction of recommendation novelty. In this work, we model the learning characteristics of the BPR and APR optimization frameworks to give mathematical evidence that, when the feedback data have a tailed distribution, APR amplifies the popularity bias more than BPR due to an unbalanced number of received positive updates from short-head items. Using matrix factorization (MF), we empirically validate the theoretical results by performing preliminary experiments on two public datasets to compare BPR-MF and APR-MF performance on accuracy and beyond-accuracy metrics. The experimental results consistently show the degradation of novelty and coverage measures and a worrying amplification of bias. Vito Walter Anelli, Yashar Deldjoo, Tommaso Di Noia, Felice Antonio Merra |
CIKM | 1 |
| 2021 | FedeRank: User Controlled Feedback with Federated Recommender Systems
Vito Walter Anelli, Yashar Deldjoo, Tommaso Di Noia, Antonio Ferrara 0001, Fedelucio Narducci |
ECIR (1) | 1 |
| 2021 | Pursuing Privacy in Recommender Systems: the View of Users and Researchers from Regulations to ApplicationsabstractRecommender systems (RSs) have widely grown thanks to the outstanding capability of providing users with accurate and tailored recommendations. Recently, public awareness and new regulations forced RS researchers and practitioners to study solutions to user privacy endangerment. This tutorial will guide the attendees through the possible threats and the solutions towards private RSs. Vito Walter Anelli, Luca Belli, Yashar Deldjoo, Tommaso Di Noia, Antonio Ferrara 0001, Fedelucio Narducci, Claudio Pomo |
RecSys | 1 |
| 2021 | V-Elliot: Design, Evaluate and Tune Visual Recommender SystemsabstractThe paper introduces Visual-Elliot (V-Elliot), a reproducibility framework for Visual Recommendation systems (VRSs) based on Elliot. framework provides the widest set of VRSs compared to other recommendation frameworks in the literature (i.e., 6 state-of-the-art models which have been commonly employed as baselines in recent works). The framework pipeline spans from the dataset preprocessing and item visual features loading to easily train and test complex combinations of visual models and evaluation settings. V-Elliot provides an extended set of features to ease the design, testing, and integration of novel VRSs into V-Elliot. The framework exploits of dataset filtering/splitting functions, 40 evaluation metrics, five hyper-parameter optimization methods, more than 50 recommendation algorithms, and two statistical hypothesis tests. The files of this demonstration are available at: github.com/sisinflab/elliot. Vito Walter Anelli, Alejandro Bellogín, Antonio Ferrara 0001, Daniele Malitesta, Felice Antonio Merra, Claudio Pomo, Francesco M. Donini, Tommaso Di Noia |
RecSys | 1 |
| 2021 | Third Knowledge-aware and Conversational Recommender Systems Workshop (KaRS)abstractIn the last few years, a renewed interest of the research community on conversational recommender systems (CRSs) is emerging. This is probably due to the great diffusion of Digital Assistants (DAs) such as Amazon Alexa, Siri, or Google Assistant that are revolutionizing the way users interact with machines. DAs allow users to execute a wide range of actions through an interaction mostly based on natural language messages. However, although DAs are able to complete tasks such as sending texts, making phone calls, or playing songs, they are still at an early stage on offering recommendation capabilities by using the conversational paradigm. Vito Walter Anelli, Pierpaolo Basile, Tommaso Di Noia, Francesco M. Donini, Cataldo Musto, Fedelucio Narducci, Markus Zanker |
RecSys | 1 |
| 2021 | Reenvisioning the comparison between Neural Collaborative Filtering and Matrix FactorizationabstractCollaborative filtering models based on matrix factorization and learned similarities using Artificial Neural Networks (ANNs) have gained significant attention in recent years. This is, in part, because ANNs have demonstrated very good results in a wide variety of recommendation tasks. However, the introduction of ANNs within the recommendation ecosystem has been recently questioned, raising several comparisons in terms of efficiency and effectiveness. One aspect most of these comparisons have in common is their focus on accuracy, neglecting other evaluation dimensions important for the recommendation, such as novelty, diversity, or accounting for biases. In this work, we replicate experiments from three different papers that compare Neural Collaborative Filtering (NCF) and Matrix Factorization (MF), to extend the analysis to other evaluation dimensions. First, our contribution shows that the experiments under analysis are entirely reproducible, and we extend the study including other accuracy metrics and two statistical hypothesis tests. Second, we investigated the Diversity and Novelty of the recommendations, showing that MF provides a better accuracy also on the long tail, although NCF provides a better item coverage and more diversified recommendation lists. Lastly, we discuss the bias effect generated by the tested methods. They show a relatively small bias, but other recommendation baselines, with competitive accuracy performance, consistently show to be less affected by this issue. This is the first work, to the best of our knowledge, where several complementary evaluation dimensions have been explored for an array of state-of-the-art algorithms covering recent adaptations of ANNs and MF. Hence, we aim to show the potential these techniques may have on beyond-accuracy evaluation while analyzing the effect on reproducibility these complementary dimensions may spark. The code to reproduce the experiments is publicly available on GitHub at https://tny.sh/Reenvisioning. Vito Walter Anelli, Alejandro Bellogín, Tommaso Di Noia, Claudio Pomo |
RecSys | 1 |
| 2021 | RecSys 2021 Challenge Workshop: Fairness-aware engagement prediction at scale on Twitter's Home TimelineabstractThe workshop features presentations of accepted contributions to the RecSys Challenge 2021, organized by Politecnico di Bari, ETH Zürich, Jönköping University, and the data set is provided by Twitter. The challenge focuses on a real-world task of tweet engagement prediction in a dynamic environment. For 2021, the challenge considers four different engagement types: Likes, Retweet, Quote, and replies. This year’s challenge brings the problem even closer to Twitter’s real recommender systems by introducing latency constraints. We also increases the data size to encourage novel methods. Also, the data density is increased in terms of the graph where users are considered to be nodes and interactions as edges. The goal is twofold: to predict the probability of different engagement types of a target user for a set of Tweets based on heterogeneous input data while providing fair recommendations. In fact, multi-goal optimization considering accuracy and fairness is particularly challenging. However, we believed that the recommendation community was nowadays mature enough to face the challenge of providing accurate and, at the same time, fair recommendations. To this end, Twitter has released a public dataset of close to 1 billion data points, > 40 million each day over 28 days. Week 1 − 3 will be used for training and week 4 for evaluation and testing. Each datapoint contains the tweet along with engagement features, user features, and tweet features. A peculiarity of this challenge is related to keeping the dataset updated with the platform: if a user deletes a Tweet, or their data from Twitter, the dataset is promptly updated. Moreover, each change in the dataset implied new evaluations of all submissions and the update of the leaderboard metrics. The challenge was well received with 578 registered users, and 386 submissions. Vito Walter Anelli, Saikishore Kalloori, Bruce Ferwerda, Luca Belli, Alykhan Tejani, Frank Portman, Alexandre Lung-Yut-Fong, Benjamin Paul Chamberlain, Yuanpu Xie, Jonathan J. Hunt, Michael M. Bronstein, Wenzhe Shi |
RecSys | 1 |
| 2021 | The Idiosyncratic Effects of Adversarial Training on Bias in Personalized Recommendation LearningabstractRecently, recommendation systems have been proven to be susceptible to malicious perturbations of the model weights. To overcome this vulnerability, Adversarial Regularization emerged as one of the most effective solutions. Interestingly, the technique not only robustifies the model, but also significantly increases its accuracy. To date, unfortunately, the effect of Adversarial Regularization beyond-accuracy evaluation dimensions is unknown. This paper sheds light on these aspects and investigates how Adversarial Regularization impacts the amplification of popularity bias, and the deterioration of novelty and coverage of the recommendation list. The results highlight that, with imbalanced data distribution, Adversarial Regularization amplifies the popularity bias. Moreover, the empirical validation on five datasets confirms that it degrades the diversity and novelty of the generated recommendation. Code and data are available at https://github.com/sisinflab/The-Idiosyncratic-Effects-of-Adversarial-Training. Vito Walter Anelli, Tommaso Di Noia, Felice Antonio Merra |
RecSys | 1 |
| 2021 | Sparse Feature Factorization for Recommender Systems with Knowledge GraphsabstractDeep Learning and factorization-based collaborative filtering recommendation models have undoubtedly dominated the scene of recommender systems in recent years. However, despite their outstanding performance, these methods require a training time proportional to the size of the embeddings and it further increases when also side information is considered for the computation of the recommendation list. In fact, in these cases we have that with a large number of high-quality features, the resulting models are more complex and difficult to train. This paper addresses this problem by presenting KGFlex: a sparse factorization approach that grants an even greater degree of expressiveness. To achieve this result, KGFlex analyzes the historical data to understand the dimensions the user decisions depend on (e.g., movie direction, musical genre, nationality of book writer). KGFlex represents each item feature as an embedding and it models user-item interactions as a factorized entropy-driven combination of the item attributes relevant to the user. KGFlex facilitates the training process by letting users update only those relevant features on which they base their decisions. In other words, the user-item prediction is mediated by the user’s personal view that considers only relevant features. An extensive experimental evaluation shows the approach’s effectiveness, considering the recommendation results’ accuracy, diversity, and induced bias. The public implementation of KGFlex is available at https://split.to/kgflex. Vito Walter Anelli, Tommaso Di Noia, Eugenio Di Sciascio, Antonio Ferrara 0001, Alberto Carlo Maria Mancino |
RecSys | 1 |
| 2021 | Elliot: A Comprehensive and Rigorous Framework for Reproducible Recommender Systems EvaluationabstractRecommender Systems have shown to be an effective way to alleviate the over-choice problem and provide accurate and tailored recommendations. However, the impressive number of proposed recommendation algorithms, splitting strategies, evaluation protocols, metrics, and tasks, has made rigorous experimental evaluation particularly challenging. Puzzled and frustrated by the continuous recreation of appropriate evaluation benchmarks, experimental pipelines, hyperparameter optimization, and evaluation procedures, we have developed an exhaustive framework to address such needs. Elliot is a comprehensive recommendation framework that aims to run and reproduce an entire experimental pipeline by processing a simple configuration file. The framework loads, filters, and splits the data considering a vast set of strategies (13 splitting methods and 8 filtering approaches, from temporal training-test splitting to nested K-folds Cross-Validation). Elliot(https://github.com/sisinflab/elliot) optimizes hyperparameters (51 strategies) for several recommendation algorithms (50), selects the best models, compares them with the baselines providing intra-model statistics, computes metrics (36) spanning from accuracy to beyond-accuracy, bias, and fairness, and conducts statistical analysis (Wilcoxon and Paired t-test). Vito Walter Anelli, Alejandro Bellogín, Antonio Ferrara 0001, Daniele Malitesta, Felice Antonio Merra, Claudio Pomo, Francesco M. Donini, Tommaso Di Noia |
SIGIR | 1 |
| 2021 | A Study of Defensive Methods to Protect Visual Recommendation Against Adversarial Manipulation of ImagesabstractVisual-based recommender systems (VRSs) enhance recommendation performance by integrating users' feedback with the visual features of items' images. Recently, human-imperceptible image perturbations, defined adversarial samples, have been shown capable of altering the VRSs performance, for example, by pushing (promoting) or nuking (demoting) specific categories of products. One of the most effective adversarial defense methods is adversarial training (AT), which enhances the robustness of the model by incorporating adversarial samples into the training process and minimizing an adversarial risk. The AT effectiveness has been verified on defending DNNs in supervised learning tasks such as image classification. However, the extent to which AT can protect deep VRSs, against adversarial perturbation of images remains mostly under-investigated. This work focuses on the defensive side of VRSs and provides general insights that could be further exploited to broaden the frontier in the field. First, we introduce a suite of adversarial attacks against DNNs on top of VRSs, and defense strategies to counteract them. Next, we present an evaluation framework, named Visual Adversarial Recommender (VAR), to empirically investigate the performance of defended or undefended DNNs in various visually-aware item recommendation tasks. The results of large-scale experiments indicate alarming risks in protecting a VRS through the DNN robustification. Source code and data are available at https://github.com/sisinflab/Visual-Adversarial-Recommendation. Vito Walter Anelli, Yashar Deldjoo, Tommaso Di Noia, Daniele Malitesta, Felice Antonio Merra |
SIGIR | 1 |
| 2020 | SAShA: Semantic-Aware Shilling Attacks on Recommender Systems Exploiting Knowledge Graphs
Vito Walter Anelli, Yashar Deldjoo, Tommaso Di Noia, Eugenio Di Sciascio, Felice Antonio Merra |
ESWC | 1 |
| 2020 | Adversarial Learning for Recommendation: Applications for Security and Generative Tasks - Concept to CodeabstractAdversarial Machine Learning (AML) has initially emerged as the field of study that investigates security issues of conventional and modern machine learning (ML) models. The objective of this tutorial is to present a comprehensive overview on the application of AML techniques for recommendation in a two-fold categorization: (i) AML for the attack/defense purposes, and (ii) AML to build GAN-based recommender models. A theoretical presentation on the topics is paired with two corresponding hands-on sessions to show the efficacy of AML application and push up novel ideas and advances in recommendation tasks. The tutorial is divided into four parts. We start by introducing a summary on state-of-the-art recommender models, including deep learning ones, and we define the fundamentals of AML. Then, we present the Adversarial Recommendation Framework, to represent attack/defense strategies on RSs, and the GAN-based Recommendation Framework, which is at the basis of novel adversarial-based generative recommenders. The presentation of each framework is followed by a practical session. Finally, we conclude with open challenges and possible future works for both applications. Vito Walter Anelli, Yashar Deldjoo, Tommaso Di Noia, Felice Antonio Merra |
RecSys | 1 |
| 2020 | RecSys 2020 Challenge Workshop: Engagement Prediction on Twitter's Home TimelineabstractThe workshop features presentations of accepted contributions to the RecSys Challenge 2020, organized by Politecnico di Bari, Free University of Bozen-Bolzano, TU Wien, University of Colorado, Boulder, and Universidade Federal de Campina Grande, and sponsored by Twitter. The challenge focuses on a real-world task of Tweet engagement prediction in a dynamic environment. The goal is to predict the probability for different types of engagement (Like, Reply, Retweet, and Retweet with comment) of a target user for a set of Tweets, based on heterogeneous input data. To this end, Twitter has released a large public dataset of ~160M public Tweets, obtained by subsampling within ~2 weeks, that contains engagement features, user features, and Tweet features. A peculiarity of this challenge is related to the recent regulations on data protection and privacy. The challenge data set was compliant: if a user deleted a Tweet, or their data from Twitter, the dataset was promptly updated. Moreover, each change in the dataset implied new evaluations of all submissions and the update of the leaderboard metrics. Vito Walter Anelli, Amra Delic, Gabriele Sottocornola, Jessie Smith, Nazareno Andrade, Luca Belli, Michael M. Bronstein, Sofia Ira Ktena, Alexandre Lung-Yut-Fong, Frank Portman, Alykhan Tejani, Yuanpu Xie, Wenzhe Shi |
RecSys | 1 |
| 2019 | 2nd Workshop on Knowledge-aware and Conversational Recommender Systems - KaRSabstractOver the last years, we have been witnessing the advent of more and more precise and powerful recommendation algorithms and techniques able to effectively assess users' tastes and predict information that would probably be of interest for them. Most of these approaches rely on the collaborative paradigm (often exploiting machine learning techniques) and do not take into account the huge amount of knowledge, both structured and non-structured ones, describing the domain of interest of the recommendation engine. Although very effective in in predicting relevant items, collaborative approaches miss some very interesting features that go beyond the accuracy of results and move into the direction of providing novel and diverse results as well as generating an explanation for the recommended items or support interactive and conversational recommendation processes. Vito Walter Anelli, Tommaso Di Noia |
CIKM | 1 |
| 2019 | Local Popularity and Time in top-N Recommendation
Vito Walter Anelli, Tommaso Di Noia, Eugenio Di Sciascio, Azzurra Ragone, Joseph Trotta |
ECIR (1) | 1 |
| 2019 | On the discriminative power of hyper-parameters in cross-validation and how to choose themabstractHyper-parameters tuning is a crucial task to make a model perform at its best. However, despite the well-established methodologies, some aspects of the tuning remain unexplored. As an example, it may affect not just accuracy but also novelty as well as it may depend on the adopted dataset. Moreover, sometimes it could be sufficient to concentrate on a single parameter only (or a few of them) instead of their overall set. In this paper we report on our investigation on hyper-parameters tuning by performing an extensive 10-Folds Cross-Validation on MovieLens and Amazon Movies for three well-known baselines: User-kNN, Item-kNN, BPR-MF. We adopted a grid search strategy considering approximately 15 values for each parameter, and we then evaluated each combination of parameters in terms of accuracy and novelty. We investigated the discriminative power of nDCG, Precision, Recall, MRR, EFD, EPC, and, finally, we analyzed the role of parameters on model evaluation for Cross-Validation. Vito Walter Anelli, Tommaso Di Noia, Eugenio Di Sciascio, Claudio Pomo, Azzurra Ragone |
RecSys | 1 |
| 2019 | How to Make Latent Factors Interpretable by Feeding Factorization Machines with Knowledge Graphs
Vito Walter Anelli, Tommaso Di Noia, Eugenio Di Sciascio, Azzurra Ragone, Joseph Trotta |
ISWC (1) | 1 |
| 2018 | Knowledge-aware and conversational recommender systemsabstractMore and more precise and powerful recommendation algorithms and techniques have been proposed over the last years able to effectively assess users' tastes and predict information that would probably be of interest for them. Most of these approaches rely on the collaborative paradigm (often exploiting machine learning techniques) and do not take into account the huge amount of knowledge, both structured and non-structured ones, describing the domain of interest for the recommendation engine. The aim of knowledge-aware and conversational recommender systems is to go beyond the traditional accuracy goal and to start a new generation of algorithms and interactive approaches which exploit the knowledge encoded in ontological and logic-based knowledge bases, knowledge graphs as well as the semantics emerging from the analysis and exploitation of semi-structured textual sources. Vito Walter Anelli, Pierpaolo Basile, Derek G. Bridge, Tommaso Di Noia, Pasquale Lops, Cataldo Musto, Fedelucio Narducci, Markus Zanker |
RecSys | 1 |