Demo Data from EDBT 2026 / reviewers in the wild / expert
Hoa Dang
dblp:75/5789
· DBLP profile ↗
2ranked-venue papers
0as first author
1since 2021 · last 2025
0009-0006-3009-3465ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 2 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% |
Topics — the 4 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Information retrieval
evaluation |
0.9 | 1 | 2025 | Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented Generation · SIGIR 2025 |
Information retrieval › evaluation › evaluation methodology
nugget-based evaluation |
0.9 | 1 | 2025 | Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented Generation · SIGIR 2025 |
Information retrieval › evaluation › text generation evaluation
retrieval-augmented generation evaluation |
0.9 | 1 | 2025 | Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented Generation · SIGIR 2025 |
Information retrieval
retrieval-augmented generation |
0.3 | 1 | 2025 | Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented Generation · SIGIR 2025 |
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented GenerationabstractRetrieval-augmented generation (RAG) summarizes retrieved documents into a text passage that fulfills the information need expressed by the user. Such generated responses should faithfully distill the relevant information and provide sufficient attribution back to the source documents. Nugget-based evaluation was proposed for text summarization and has been adapted to evaluate RAG output in recent shared tasks such as 2024 TREC RAG, BioGen, and NeuCLIR tracks. However, annotating such detailed and nuanced information is complex and errorful. Multiple pieces of information need to be labeled, extracted, linked, and cross-referenced. In this work, we present an annotation protocol and tool tailored to collecting information for evaluating RAG systems. Our tool has four steps: nugget creation, nugget revision, document support assessment, and finally, nugget alignment. Each step aims to minimize the annotator's cognitive load, improving the efficiency and reliability. Eugene Yang 0001, Dawn J. Lawrie, Hoa Dang, Ian Soboroff, James Mayfield |
SIGIR | 3 |
| 2007 | DUC in context
Paul Over, Hoa Dang, Donna K. Harman |
Inf. Process. Manag. | 2 |