Demo Data from EDBT 2026 / reviewers in the wild / expert
Tingjuntao Ni
dblp:419/8594
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Computational social science and digital humanities · 100% | |
| Artificial intelligence
1 paper |
Language models and text generation · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
large language model evaluation |
0.9 | 1 | 2025 | SocioBench: Modeling Human Behavior in Sociological Surveys with Large Language Models · EMNLP 2025 |
Computational social science and digital humanities
social simulation |
0.9 | 1 | 2025 | SocioBench: Modeling Human Behavior in Sociological Surveys with Large Language Models · EMNLP 2025 |
Computational social science and digital humanities
survey simulation |
0.9 | 1 | 2025 | SocioBench: Modeling Human Behavior in Sociological Surveys with Large Language Models · EMNLP 2025 |
Methods — techniques the papers use, named apart from their topics
large language model simulation · 1.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | SocioBench: Modeling Human Behavior in Sociological Surveys with Large Language ModelsabstractLarge language models (LLMs) show strong potential for simulating human social behaviors and interactions, yet lack large-scale, systematically constructed benchmarks for evaluating their alignment with real-world social attitudes.To bridge this gap, we introduce SocioBench-a comprehensive benchmark derived from the annually collected, standardized survey data of the International Social Survey Programme (ISSP).The benchmark aggregates over 480,000 real respondent records from more than 30 countries, spanning 10 sociological domains and over 40 demographic attributes.Our experiments indicate that LLMs achieve only 30-40% accuracy when simulating individuals in complex survey scenarios, with statistically significant differences across domains and demographic subgroups.These findings highlight several limitations of current LLMs in survey scenarios, including insufficient individuallevel data coverage, inadequate scenario diversity, and missing group-level modeling.We have open-sourced SocioBench at https:// github.com/JiaWANG-TJ/SocioBench. Jia Wang 0058, Tingjuntao Ni, Zhongyu Wei |
EMNLP | 3 |