Demo Data from EDBT 2026 / reviewers in the wild / expert
Annika Vivekananthan
dblp:422/0431
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Bioinformatics and computational biology · 77% Medical and health informatics · 23% | |
| Artificial intelligence
1 paper |
Vision and language · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Computer vision › Vision and language › vision-language model › multimodal large language model
multimodal large language model evaluation |
0.9 | 1 | 2025 | ConnectomeBench: Can LLMs proofread the connectome? · NeurIPS 2025 |
Bioinformatics and computational biology › computational neuroscience
connectomics |
0.9 | 1 | 2025 | ConnectomeBench: Can LLMs proofread the connectome? · NeurIPS 2025 |
Medical and health informatics › neuroimaging
neuroimaging analysis |
0.3 | 1 | 2025 | ConnectomeBench: Can LLMs proofread the connectome? · NeurIPS 2025 |
Methods — techniques the papers use, named apart from their topics
multimodal model · 1.7large language model · 1.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | ConnectomeBench: Can LLMs proofread the connectome?abstractConnectomics—the mapping of neural connections in an organism's brain—currently requires extraordinary human effort to proofread the data collected from imaging and machine-learning assisted segmentation. With the growing excitement around using AI agents to automate important scientific tasks, we explore whether current AI systems can perform multiple tasks necessary for data proofreading. We introduce ConnectomeBench, a multimodal benchmark evaluating large language model (LLM) capabilities in three critical proofreading tasks: segment type identification, split error correction, and merge error detection. Using expert annotated data from two large open-source datasets—a cubic millimeter of mouse visual cortex and the complete Drosophila brain—we evaluate proprietary multimodal LLMs including Claude 3.7/4 Sonnet, o4-mini, GPT-4.1, GPT-4o, as well as open source models like InternVL-3 and NVLM. Our results demonstrate that current models achieve surprisingly high performance in segment identification (52-82\% balanced accuracy vs. 20-25\% chance) and binary/multiple choice split error correction (75-85\% accuracy vs. 50\% chance) while generally struggling on merge error identification tasks. Overall, while the best models still lag behind expert performance, they demonstrate promising capabilities that could eventually enable them to augment and potentially replace human proofreading in connectomics. Jeff Brown, Andrew Kirjner, Annika Vivekananthan, Edward S. Boyden |
NeurIPS | 3 |