Demo Data from SIGIR 2026 / reviewers in the wild / expert
Yanyun Zhou
dblp:71/2854
· DBLP profile ↗
4ranked-venue papers
1as first author
3since 2021 · last 2027
—ORCID · conflict
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 2 · 2 since 2021Applied, interdisciplinary, general and emerging computing · 2 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Language models and text generation · 67% Trustworthy machine learning · 33% | |
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Medical and health informatics · 100% |
Topics — the 4 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation › large language model evaluation › large language model benchmarking
dynamic evaluation |
1.0 | 1 | 2026 | Inflated Excellence or True Performance? Rethinking Medical Diagnostic Benchmarks with Dynamic Evaluation · ACL (1) 2026 |
Natural language and speech › Language models and text generation
large language model evaluation |
1.0 | 1 | 2026 | Inflated Excellence or True Performance? Rethinking Medical Diagnostic Benchmarks with Dynamic Evaluation · ACL (1) 2026 |
Machine learning › Trustworthy machine learning
robustness evaluation |
1.0 | 1 | 2026 | Inflated Excellence or True Performance? Rethinking Medical Diagnostic Benchmarks with Dynamic Evaluation · ACL (1) 2026 |
Medical and health informatics
clinical diagnosis |
0.3 | 1 | 2026 | Inflated Excellence or True Performance? Rethinking Medical Diagnostic Benchmarks with Dynamic Evaluation · ACL (1) 2026 |
Methods — techniques the papers use, named apart from their topics
stress testing · 2.0dynamic benchmark generation · 2.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2027 | TM-Net: A temporal-aware Mamba-attention hybrid network for video desnowing
Shenhan Feng, Yanyun Zhou, Jiaohao Li, Zhenhong Jia |
Expert Syst. Appl. | 2 |
| 2026 | Inflated Excellence or True Performance? Rethinking Medical Diagnostic Benchmarks with Dynamic EvaluationabstractMedical diagnostics is a high-stakes and complex domain that is critical to patient care.However, current evaluations of large language models (LLMs) remain limited in capturing key challenges of clinical diagnostic scenarios.Most rely on benchmarks derived from public exams, raising contamination bias that can inflate performance, and they overlook the confounded nature of real consultations beyond textbook cases.Recent dynamic evaluations offer a promising alternative, but often remain insufficient for diagnosis-oriented benchmarking, with limited coverage of clinically grounded confounders and trustworthiness beyond accuracy.To address these gaps, we propose DyReMe, a dynamic benchmark for medical diagnostics that provides a controlled and scalable stress test of diagnostic robustness.Unlike static exam-style questions, DyReMe generates fresh, consultation-style cases that incorporate clinically grounded confounders, such as differential diagnoses and common misdiagnosis factors.It also varies expression styles to capture heterogeneous patient-style descriptions.Beyond accuracy, DyReMe evaluates LLMs on three additional clinically relevant dimensions: veracity, helpfulness, and consistency.Our experiments show that this dynamic approach yields more challenging assessments and exposes substantial weaknesses of stateof-the-art LLMs under clinically confounded diagnostic settings.These findings highlight the urgent need for evaluation frameworks that better assess trustworthy medical diagnostics under clinically grounded confounders. 1 Xiangxu Zhang, Lei Li 0053, Yanyun Zhou, Xiao Zhou 0005, Xian Wu 0001 |
ACL (1) | 3 |
| 2026 | SafeRecovery: A Safety-Recovery Benchmark with Four-Axis Evaluation for Quadruped Locomotion
Yaozeng Huang, Shuhao Jiang, Yanyun Zhou |
ICIC (2) | 6 |
| 2005 | E-commerce ethics problem and countermeasure of China on the basis of systematic thinkingabstractAt first, this text has analyzed the epistemology reason lacked in study of ethics to new-type commercial mode of e-commerce; Then, on the basis of the visual angle of thinking of the system, it has divided the numerous and disorderly and complicated Chinese e-commerce ethics problem into four kind and put forward the corresponding ethics norm and cultural countermeasure of China's traditional ethics. Yanyun Zhou, Maixiu Hu |
ICEC | 1 |