Demo Data from EDBT 2026 / reviewers in the wild / expert
Dewi Timman
dblp:437/0433
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2026
0009-0007-7831-4359ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Information retrieval › retrieval models › neural retrieval
dense retrieval |
1.0 | 1 | 2026 | Reproducing Complex Set-Compositional Information Retrieval · SIGIR 2026 |
Information retrieval
evaluation |
1.0 | 1 | 2026 | Reproducing Complex Set-Compositional Information Retrieval · SIGIR 2026 |
Information retrieval › retrieval models
neural retrieval |
1.0 | 1 | 2026 | Reproducing Complex Set-Compositional Information Retrieval · SIGIR 2026 |
Information retrieval › evaluation › evaluation methodology
reproducibility |
1.0 | 1 | 2026 | Reproducing Complex Set-Compositional Information Retrieval · SIGIR 2026 |
Information retrieval
retrieval models |
1.0 | 1 | 2026 | Reproducing Complex Set-Compositional Information Retrieval · SIGIR 2026 |
Methods — techniques the papers use, named apart from their topics
neural retrieval · 1.0BM25 · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Reproducing Complex Set-Compositional Information RetrievalabstractComplex information needs may involve set-compositional queries using conjunction, disjunction, and exclusion, yet it remains unclear whether current retrieval paradigms genuinely satisfy such constraints or exploit 'semantic shortcuts'. We conduct a reproducibility study to benchmark major retrieval families and reasoning-targeted methods on QUEST and QUEST+Variants, and introduce LIMIT+, a controlled benchmark where relevance depends on arbitrary attribute predicates and constraint satisfaction, and less on pretrained knowledge. Our findings show that (i) on QUEST, the best neural retrievers achieve an effectiveness that is more than double what can be achieved with BM25 (Recall@100 > 0.41 vs. 0.20), but reasoning-targeted methods like ReasonIR and Search-R1 do not outperform general-purpose retrievers uniformly; (ii) on LIMIT+, gains fail to transfer, where the strongest QUEST method collapses from Recall@100 ? 0.42 to below 0.02, while classic lexical retrieval gains to ~0.96. Lastly, (iii) stratifying by compositional depth reveals a consistent degradation across all methods, where algebraic sparse and lexical methods show more stable performance while dense approaches collapse. We release code and LIMIT+ data generation scripts to support future reproducibility and controlled evaluation. Vincent Degenhart, Dewi Timman, Arjen P. de Vries, Faegheh Hasibi, Mohanna Hoveyda |
SIGIR | 2 |