Demo Data from SIGIR 2026 / reviewers in the wild / expert
James Bennett
dblp:25/6082
· DBLP profile ↗
2ranked-venue papers
1as first author
2since 2021 · last 2026
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Language models and text generation · 100% | |
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Computational social science and digital humanities · 100% |
Topics — the 2 heaviest of 2, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
large language model evaluation |
0.8 | 1 | 2024 | Large Language Models' Expert-level Global History Knowledge Benchmark (HiST-LLM) · NeurIPS 2024 |
Computational social science and digital humanities
digital history |
0.8 | 1 | 2024 | Large Language Models' Expert-level Global History Knowledge Benchmark (HiST-LLM) · NeurIPS 2024 |
Methods — techniques the papers use, named apart from their topics
benchmarking · 1.5
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Simple tone curves: theory and applicationsabstractA single tone curve that remaps the brightnesses of each image pixel is a simple and widely deployed way to enhance an image. Tone curves might be crafted by individual users or determined algorithmically in camera processing pipelines. The precise shape of the tone curve is not a priori strongly constrained, other than it is usually limited to increasing functions of brightness. In this paper, we constrain the shape further and define a tone curve to be simple if it has no or one inflexion point. With respect to our representation, wiggly tone curves have several inflexion points and are deemed to be complex. A key contribution of our work is to show how we can best approximate a complex curve with a simple counterpart. For the MIT-Adobe FiveK dataset, comprising thousands of images that are tone-adjusted by photographic experts, we calculate corresponding simple tone curve adjusted images. Using objective similarity metrics, we find that simple curves deliver equally good image enhancement. In terms of preference experiments, simple curves deliver slightly preferred images compared to complex counterparts. Similar results are reported for a second smaller underwater image dataset. James Bennett, Graham D. Finlayson |
Vis. Comput. | 1 |
| 2024 | Large Language Models' Expert-level Global History Knowledge Benchmark (HiST-LLM)abstractLarge Language Models (LLMs) have the potential to transform humanities and social science research, yet their history knowledge and comprehension at a graduate level remains untested. Benchmarking LLMs in history is particularly challenging, given that human knowledge of history is inherently unbalanced, with more information available on Western history and recent periods. We introduce the History Seshat Test for LLMs (HiST-LLM), based on a subset of the Seshat Global History Databank, which provides a structured representation of human historical knowledge, containing 36,000 data points across 600 historical societies and over 2,700 scholarly references. This dataset covers every major world region from the Neolithic period to the Industrial Revolution and includes information reviewed and assembled by history experts and graduate research assistants. Using this dataset, we benchmark a total of seven models from the Gemini, OpenAI, and Llama families. We find that, in a four-choice format, LLMs have a balanced accuracy ranging from 33.6% (Llama-3.1-8B) to 46% (GPT-4-Turbo), outperforming random guessing (25%) but falling short of expert comprehension. LLMs perform better on earlier historical periods. Regionally, performance is more even but still better for the Americas and lowest in Oceania and Sub-Saharan Africa for the more advanced models. Our benchmark shows that while LLMs possess some expert-level historical knowledge, there is considerable room for improvement. Jakob Hauser, Dániel Kondor, Jenny Reddish, Majid Benam, Enrico Cioni, Federica Villa, James Bennett, Daniel Hoyer, Pieter Francois, Peter Turchin, R. Maria del Rio Chanona |
NeurIPS | 7 |