Demo Data from SIGIR 2026 / reviewers in the wild / expert
Gabriel Herman Bernardim Andrade
dblp:351/4977
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2023
0000-0003-1950-8069ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Information extraction and text analysis · 67% Trustworthy machine learning · 33% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Information extraction and text analysis
entity linking |
0.7 | 1 | 2023 | Comparative evaluation of boundary-relaxed annotation for Entity Linking performance · ACL (1) 2023 |
Natural language and speech › Information extraction and text analysis
named entity recognition |
0.7 | 1 | 2023 | Comparative evaluation of boundary-relaxed annotation for Entity Linking performance · ACL (1) 2023 |
Machine learning › Trustworthy machine learning › learning from noisy data
noisy annotation |
0.7 | 1 | 2023 | Comparative evaluation of boundary-relaxed annotation for Entity Linking performance · ACL (1) 2023 |
Methods — techniques the papers use, named apart from their topics
entity linking pipeline · 0.7annotation noise injection · 0.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2023 | Comparative evaluation of boundary-relaxed annotation for Entity Linking performanceabstractEntity Linking performance has a strong reliance on having a large quantity of high-quality annotated training data available.Yet, manual annotation of named entities, especially their boundaries, is ambiguous, error-prone, and raises many inconsistencies between annotators.While imprecise boundary annotation can degrade a model's performance, there are applications where accurate extraction of entities' surface form is not necessary.For those cases, a lenient annotation guideline could relieve the annotators' workload and speed up the process.This paper presents a case study designed to verify the feasibility of such annotation process and evaluate the impact of boundary-relaxed annotation in an Entity Linking pipeline.We first generate a set of noisy versions of the widely used AIDA CoNLL-YAGO dataset by expanding the boundaries subsets of annotated entity mentions and then train three Entity Linking models on this data and evaluate the relative impact of imprecise annotation on entity recognition and disambiguation performances.We demonstrate that the magnitude of effects caused by noise in the Named Entity Recognition phase is dependent on both model complexity and noise ratio, while Entity Disambiguation components are susceptible to entity boundary imprecision due to strong vocabulary dependency. Gabriel Herman Bernardim Andrade, Shuntaro Yada, Eiji Aramaki |
ACL (1) | 1 |