Demo Data from VLDB 2026 / reviewers in the wild / expert
Jianhao Nie
dblp:327/6544
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2026
0009-0004-5561-6635ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% | |
| Artificial intelligence
1 paper |
Speech recognition and synthesis · 100% |
Topics — the 2 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Information retrieval › evaluation › benchmark
robustness benchmark |
1.0 | 1 | 2026 | SQuTR: A Robustness Benchmark for Spoken Query to Text Retrieval under Acoustic Noise · SIGIR 2026 |
Information retrieval › document retrieval › spoken document retrieval
spoken query retrieval |
1.0 | 1 | 2026 | SQuTR: A Robustness Benchmark for Spoken Query to Text Retrieval under Acoustic Noise · SIGIR 2026 |
Methods — techniques the papers use, named apart from their topics
noise mixing · 2.0benchmark construction · 2.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | SQuTR: A Robustness Benchmark for Spoken Query to Text Retrieval under Acoustic NoiseabstractSpoken query retrieval is an important interaction mode in modern information retrieval. However, existing evaluation datasets are often limited to simple queries under constrained noise conditions, making them inadequate for assessing the robustness of spoken query retrieval systems under complex acoustic perturbations. To address this limitation, we present SQuTR, a robustness benchmark for spoken query retrieval that includes a large-scale dataset and a unified evaluation protocol. SQuTR aggregates 37,317 unique queries from six commonly used English and Chinese text retrieval datasets, spanning multiple domains and diverse query types. We synthesize speech using voice profiles from 200 real speakers and mix 17 categories of real-world environmental noise under controlled SNR levels, enabling reproducible robustness evaluation from quiet to highly noisy conditions. Under the unified protocol, we conduct large-scale evaluations on representative cascaded and end-to-end retrieval systems. Experimental results show that retrieval performance decreases as noise increases, with substantially different drops across systems. Even large-scale retrieval models struggle under extreme noise, indicating that robustness remains a critical bottleneck. Overall, SQuTR provides a reproducible testbed for benchmarking and diagnostic analysis, and facilitates future research on robustness in spoken query to text retrieval. Yueying Hua, Jianhao Nie, Yueping He, Caixin Kang |
SIGIR | 5 |