Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Hoa Dang

dblp:75/5789 · DBLP profile ↗
← Back
2ranked-venue papers
0as first author
1since 2021 · last 2025
0009-0006-3009-3465ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Databases, data management, data science and information retrieval · 2 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Databases, data mining, and information retrieval
1 paper
Information retrieval · 100%

Topics — the 4 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Information retrieval
evaluation
0.912025
Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented Generation · SIGIR 2025
Information retrieval › evaluation › evaluation methodology
nugget-based evaluation
0.912025
Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented Generation · SIGIR 2025
Information retrieval › evaluation › text generation evaluation
retrieval-augmented generation evaluation
0.912025
Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented Generation · SIGIR 2025
Information retrieval
retrieval-augmented generation
0.312025
Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented Generation · SIGIR 2025
YearPublicationVenuePosition
2025 Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented Generation
abstract
Retrieval-augmented generation (RAG) summarizes retrieved documents into a text passage that fulfills the information need expressed by the user. Such generated responses should faithfully distill the relevant information and provide sufficient attribution back to the source documents. Nugget-based evaluation was proposed for text summarization and has been adapted to evaluate RAG output in recent shared tasks such as 2024 TREC RAG, BioGen, and NeuCLIR tracks. However, annotating such detailed and nuanced information is complex and errorful. Multiple pieces of information need to be labeled, extracted, linked, and cross-referenced. In this work, we present an annotation protocol and tool tailored to collecting information for evaluating RAG systems. Our tool has four steps: nugget creation, nugget revision, document support assessment, and finally, nugget alignment. Each step aims to minimize the annotator's cognitive load, improving the efficiency and reliability.
Eugene Yang 0001, Dawn J. Lawrie, Hoa Dang, Ian Soboroff, James Mayfield
SIGIR3
2007 DUC in context
Paul Over, Hoa Dang, Donna K. Harman
Inf. Process. Manag.2