Demo Data from EDBT 2026 / reviewers in the wild / expert
Zhenghan Yu
dblp:400/4360
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Language models and text generation · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation › large language model evaluation
meta-evaluation |
0.9 | 1 | 2025 | A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability · ACL (1) 2025 |
Natural language and speech › Language models and text generation
text generation evaluation |
0.9 | 1 | 2025 | A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability · ACL (1) 2025 |
Natural language and speech › Language models and text generation › large language model evaluation
LLM-as-a-judge |
0.3 | 1 | 2025 | A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability · ACL (1) 2025 |
Methods — techniques the papers use, named apart from their topics
automatic benchmark construction · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better InterpretabilityabstractIn NLG meta-evaluation, evaluation metrics are typically assessed based on their consistency with humans.However, we identify some limitations in traditional NLG meta-evaluation approaches, such as issues in handling human ratings and ambiguous selections of correlation measures, which undermine the effectiveness of meta-evaluation.In this work, we propose a dual-perspective NLG meta-evaluation framework that focuses on different evaluation capabilities, thereby providing better interpretability.In addition, we introduce a method of automatically constructing the corresponding benchmarks without requiring new human annotations.Furthermore, we conduct experiments with 16 representative LLMs as the evaluators based on our proposed framework, comprehensively analyzing their evaluation performance from different perspectives. Xinyu Hu 0001, Mingqi Gao 0002, Li Lin 0014, Zhenghan Yu, Xiaojun Wan 0001 |
ACL (1) | 4 |