Demo Data from SIGIR 2026 / reviewers in the wild / expert
Benedetta Muscato
dblp:348/9113
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Trustworthy machine learning · 60% Information extraction and text analysis · 40% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Trustworthy machine learning › interpretability
explainable AI |
0.9 | 1 | 2025 | Perspectives in Play: A Multi-Perspective Approach for More Inclusive NLP Systems · IJCAI 2025 |
Machine learning › Trustworthy machine learning
fairness |
0.9 | 1 | 2025 | Perspectives in Play: A Multi-Perspective Approach for More Inclusive NLP Systems · IJCAI 2025 |
Natural language and speech › Information extraction and text analysis › abusive language detection
hate speech detection |
0.9 | 1 | 2025 | Perspectives in Play: A Multi-Perspective Approach for More Inclusive NLP Systems · IJCAI 2025 |
Machine learning › Trustworthy machine learning
interpretability |
0.9 | 1 | 2025 | Perspectives in Play: A Multi-Perspective Approach for More Inclusive NLP Systems · IJCAI 2025 |
Natural language and speech › Information extraction and text analysis › text classification › semantic classification
subjective text classification |
0.9 | 1 | 2025 | Perspectives in Play: A Multi-Perspective Approach for More Inclusive NLP Systems · IJCAI 2025 |
Methods — techniques the papers use, named apart from their topics
soft labels · 0.9jensen-shannon divergence · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Perspectives in Play: A Multi-Perspective Approach for More Inclusive NLP SystemsabstractIn the realm of Natural Language Processing (NLP), common approaches for handling human disagreement consist of aggregating annotators' viewpoints to establish a single ground truth. However, prior studies show that disregarding individual opinions can lead to the side-effect of under-representing minority perspectives, especially in subjective tasks, where annotators may systematically disagree because of their preferences. Recognizing that labels reflect the diverse backgrounds, life experiences, and values of individuals, this study proposes a new multi-perspective approach using soft labels to encourage the development of the next generation of perspective-aware models—more inclusive and pluralistic. We conduct an extensive analysis across diverse subjective text classification tasks including hate speech, irony, abusive language, and stance detection, to highlight the importance of capturing human disagreements, often overlooked by traditional aggregation methods. Results show that the multi-perspective approach not only better approximates human label distributions, as measured by Jensen-Shannon Divergence (JSD), but also achieves superior classification performance (higher F1-scores), outperforming traditional approaches. However, our approach exhibits lower confidence in tasks like irony and stance detection, likely due to the inherent subjectivity present in the texts. Lastly, leveraging Explainable AI (XAI), we explore model uncertainty and uncover meaningful insights into model predictions. All implementation details are available at our github repo. Benedetta Muscato, Lucia C. Passaro, Gizem Gezici, Fosca Giannotti |
IJCAI | 1 |