Demo Data from VLDB 2026 / reviewers in the wild / expert
Advait Gosai
dblp:344/7436
· DBLP profile ↗
2ranked-venue papers
1as first author
2since 2021 · last 2026
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 2 · 1 first-author · 2 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
2 papers |
Language models and text generation · 44% Question answering and dialogue systems · 28% Trustworthy machine learning · 22% |
Topics — the 5 heaviest of 6, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Trustworthy machine learning
interpretability |
1.0 | 1 | 2026 | PRBench: Large-Scale Expert Rubrics for Evaluating High-Stakes Professional Reasoning · ACL (1) 2026 |
Natural language and speech › Language models and text generation
large language model evaluation |
1.0 | 1 | 2026 | PRBench: Large-Scale Expert Rubrics for Evaluating High-Stakes Professional Reasoning · ACL (1) 2026 |
Natural language and speech › Language models and text generation › large language model evaluation › automatic evaluation
rubric-based evaluation |
1.0 | 1 | 2026 | PRBench: Large-Scale Expert Rubrics for Evaluating High-Stakes Professional Reasoning · ACL (1) 2026 |
Natural language and speech › Question answering and dialogue systems
spoken dialogue systems |
1.0 | 1 | 2026 | Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interaction · ACL (1) 2026 |
Natural language and speech › Speech recognition and synthesis › speech evaluation
spoken language assessment |
0.3 | 1 | 2026 | Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interaction · ACL (1) 2026 |
Methods — techniques the papers use, named apart from their topics
multi-turn evaluation · 1.0large language model evaluation · 1.0expert rubric design · 1.0benchmark construction · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | PRBench: Large-Scale Expert Rubrics for Evaluating High-Stakes Professional ReasoningabstractAfra Feyza Akyürek, Advait Gosai, Chen Bo Calvin Zhang, Vipul Gupta, Jaehwan Jeong, Anisha Gunjal, Tahseen Rabbani, Maria Mazzone, David Randolph IV, Mohammad Mahmoudi Meymand, Gurshaan Chattha, Paula Rodriguez, Diego A. Mares Buendia, Pavit Singh, Michael Liu, Subodh Chawla, Peter Cline, Lucy Ogaz, Ernesto Gabriel Hernández Montoya, Zihao Wang, Pavi Bhatter, Marcos Ayestaran, Bing Liu, Yunzhong He. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026. Afra Feyza Akyürek, Advait Gosai, Chen Bo Calvin Zhang, Jaehwan Jeong, Anisha Gunjal, Tahseen Rabbani, Maria Mazzone, David Randolph IV, Mohammad Mahmoudi Meymand, Gurshaan Chattha, Paula Rodriguez, Diego Mares, Pavit Singh, Michael Liu, Subodh Chawla, Peter Cline, Lucy Ogaz, Ernesto Gabriel Hernández Montoya, Pavi Bhatter, Marcos Ayestaran, Yunzhong He |
ACL (1) | 2 |
| 2026 | Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human InteractionabstractAdvait Gosai, Tyler Vuong, Utkarsh Tyagi, Steven Li, Wenjia You, Miheer Bavare, Arda Uçar, Zhongwang Fang, Brian Jang, Bing Liu, Yunzhong He. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026. Advait Gosai, Tyler Vuong, Utkarsh Tyagi, Steven Li, Wenjia You, Miheer Bavare, Arda Uçar, Zhongwang Fang, Brian Jang, Yunzhong He |
ACL (1) | 1 |