Demo Data from VLDB 2026 / reviewers in the wild / expert
Neema Kotonya
dblp:218/5785
· DBLP profile ↗
5ranked-venue papers
4as first author
2since 2021 · last 2025
0000-0001-7094-0805ORCID · corroborated
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 5 · 4 first-author · 2 since 2021Databases, data management, data science and information retrieval · 1 · 1 first-authorHuman-computer interaction and ubiquitous computing · 1 · 1 first-author
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Information extraction and text analysis · 61% Knowledge representation and reasoning · 30% Question answering and dialogue systems · 9% |
Topics — the 3 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Information extraction and text analysis › fact-checking
explainable fact-checking |
0.4 | 1 | 2020 | Explainable Automated Fact-Checking for Public Health Claims · EMNLP (1) 2020 |
Knowledge, reasoning and agents › Knowledge representation and reasoning
explanation generation |
0.4 | 1 | 2020 | Explainable Automated Fact-Checking for Public Health Claims · EMNLP (1) 2020 |
Natural language and speech › Information extraction and text analysis
fact-checking |
0.4 | 1 | 2020 | Explainable Automated Fact-Checking for Public Health Claims · EMNLP (1) 2020 |
Methods — techniques the papers use, named apart from their topics
supervised learning · 0.4human evaluation · 0.4
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Uchaguzi-2022: A Dataset of Citizen Reports on the 2022 Kenyan ElectionabstractOnline reporting platforms have enabled citizens around the world to collectively share their opinions and report in real time on events impacting their local communities. Systematically organizing (e.g., categorizing by attributes) and geotagging large amounts of crowdsourced information is crucial to ensuring that accurate and meaningful insights can be drawn from this data and used by policy makers to bring about positive change. These tasks, however, typically require extensive manual annotation efforts. In this paper we present Uchaguzi-2022, a dataset of 14k categorized and geotagged citizen reports related to the 2022 Kenyan General Election containing mentions of election-related issues such as official misconduct, vote count irregularities, and acts of violence. We use this dataset to investigate whether language models can assist in scalably categorizing and geotagging reports, thus highlighting its potential application in the AI for Social Good space. Roberto Mondini, Neema Kotonya, Robert L. Logan IV, Elizabeth M. Olson, Angela Oduor Lungati, Daniel Duke Odongo, Tim Ombasa, Hemank Lamba, Aoife Cahill, Joel R. Tetreault, Alejandro Jaimes |
COLING | 2 |
| 2024 | Towards a Framework for Evaluating Explanations in Automated Fact VerificationabstractAs deep neural models in NLP become more complex, and as a consequence opaque, the necessity to interpret them becomes greater. A burgeoning interest has emerged in rationalizing explanations to provide short and coherent justifications for predictions. In this position paper, we advocate for a formal framework for key concepts and properties about rationalizing explanations to support their evaluation systematically. We also outline one such formal framework, tailored to rationalizing explanations of increasingly complex structures, from free-form explanations to deductive explanations, to argumentative explanations (with the richest structure). Focusing on the automated fact verification task, we provide illustrations of the use and usefulness of our formalization for evaluating explanations, tailored to their varying structures. Neema Kotonya, Francesca Toni |
LREC/COLING | 1 |
| 2020 | Explainable Automated Fact-Checking: A SurveyabstractA number of exciting advances have been made in automated fact-checking thanks to increasingly larger datasets and more powerful systems, leading to improvements in the complexity of claims which can be accurately fact-checked.However, despite these advances, there are still desirable functionalities missing from the fact-checking pipeline.In this survey, we focus on the explanation functionality -that is fact-checking systems providing reasons for their predictions.We summarize existing methods for explaining the predictions of fact-checking systems and we explore trends in this topic.Further, we consider what makes for good explanations in this specific domain through a comparative analysis of existing fact-checking explanations against some desirable properties.Finally, we propose further research directions for generating fact-checking explanations, and describe how these may lead to improvements in the research area. Neema Kotonya, Francesca Toni |
COLING | 1 |
| 2020 | Explainable Automated Fact-Checking for Public Health ClaimsabstractFact-checking is the task of verifying the veracity of claims by assessing their assertions against credible evidence.The vast majority of fact-checking studies focus exclusively on political claims.Very little research explores fact-checking for other topics, specifically subject matters for which expertise is required.We present the first study of explainable fact-checking for claims which require specific expertise.For our case study we choose the setting of public health.To support this case study we construct a new dataset PUBHEALTH of 11.8K claims accompanied by journalist crafted, gold standard explanations (i.e., judgments) to support the fact-check labels for claims 1 .We explore two tasks: veracity prediction and explanation generation.We also define and evaluate, with humans and computationally, three coherence properties of explanation quality.Our results indicate that, by training on in-domain data, gains can be made in explainable, automated fact-checking for claims which require specific expertise. Neema Kotonya, Francesca Toni |
EMNLP (1) | 1 |
| 2018 | Of Wines and Reviews: Measuring and Modeling the Vivino Wine Social NetworkabstractThis paper presents an analysis of social experiences around wine consumption through the lens of Vivino, a social network for wine enthusiasts with over 26 million users worldwide. We compare users' perceptions of various wine types and regional styles across both New and Old World wines, examining them across price ranges, vintages, regions, varietals, and blends. We find that ratings provided by Vivino users are not biased by cost; then, we study how wine characteristics, language in wine reviews, and the distribution of wine ratings can be combined to develop prediction models. More specifically, we model user behavior to develop a regression model for predicting wine ratings, and a classifier for determining user review preferences. Neema Kotonya, Paolo De Cristofaro, Emiliano De Cristofaro |
ASONAM | 1 |