Demo Data from VLDB 2026 / reviewers in the wild / expert
Meik Bittkowski
dblp:04/7922
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
0009-0005-4668-6030ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Information retrieval
evaluation |
0.9 | 1 | 2025 | REANIMATOR: Reanimate Retrieval Test Collections with Extracted and Synthetic Resources · SIGIR 2025 |
Information retrieval › evaluation › test collection
test collection construction |
0.9 | 1 | 2025 | REANIMATOR: Reanimate Retrieval Test Collections with Extracted and Synthetic Resources · SIGIR 2025 |
Information retrieval
retrieval-augmented generation |
0.3 | 1 | 2025 | REANIMATOR: Reanimate Retrieval Test Collections with Extracted and Synthetic Resources · SIGIR 2025 |
Methods — techniques the papers use, named apart from their topics
synthetic relevance labeling · 0.9large language model · 0.9human-in-the-loop · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | REANIMATOR: Reanimate Retrieval Test Collections with Extracted and Synthetic ResourcesabstractRetrieval test collections are essential for evaluating information retrieval systems, yet they often lack generalizability across tasks. To overcome this limitation, we introduce REANIMATOR, a versatile framework designed to enable the repurposing of existing test collections by enriching them with extracted and synthetic resources. REANIMATOR enhances test collections from PDF files by parsing full texts and machine-readable tables, as well as related contextual information. It then employs state-of-the-art large language models to produce synthetic relevance labels. Including an optional human-in-the-loop step can help validate the resources that have been extracted and generated. We demonstrate its potential with a revitalized version of the TREC-COVID test collection, showcasing the development of a retrieval-augmented generation system and evaluating the impact of tables on retrieval-augmented generation. REANIMATOR enables the reuse of test collections for new applications, lowering costs and broadening the utility of legacy resources. Björn Engelmann 0002, Fabian Haak 0001, Philipp Schaer, Mani Erfanian Abdoust, Linus Netze, Meik Bittkowski |
SIGIR | 6 |