Demo Data from EDBT 2026 / reviewers in the wild / expert
Chonghan Qin
dblp:427/1039
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2026
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Language models and text generation · 100% |
Topics — the 2 heaviest of 2, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation › large language model › large language model adaptation
behavioral adaptation |
1.0 | 1 | 2026 | ImplicitMemBench: Measuring Unconscious Behavioral Adaptation in Large Language Models · ACL (1) 2026 |
Natural language and speech › Language models and text generation
memory |
1.0 | 1 | 2026 | ImplicitMemBench: Measuring Unconscious Behavioral Adaptation in Large Language Models · ACL (1) 2026 |
Methods — techniques the papers use, named apart from their topics
benchmark evaluation · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | ImplicitMemBench: Measuring Unconscious Behavioral Adaptation in Large Language ModelsabstractExisting memory benchmarks for LLM agents evaluate explicit recall of facts, yet overlook implicit memory where experience becomes automated behavior without conscious retrieval.This gap is critical: effective assistants must automatically apply learned procedures or avoid failed actions without explicit reminders.We introduce IMPLIC-ITMEMBENCH, the first systematic benchmark evaluating implicit memory through three cognitively grounded constructs drawn from standard cognitive-science accounts of nondeclarative memory: Procedural Memory (oneshot skill acquisition after interference), Priming (theme-driven bias via paired experimental/control instances), and Classical Conditioning (Conditioned Stimulus-Unconditioned Stimulus (CS-US) associations shaping first decisions).Our 300-item suite employs a unified Learning/Priming-Interfere-Test protocol with first-attempt scoring.Evaluation of 17 models reveals severe limitations: no model exceeds 66% overall, with top performers DeepSeek-R1 (65.3%),Qwen3-32B (64.1%), and GPT-5 (63.0%) far below human baselines.Analysis uncovers dramatic asymmetries (inhibition 17.6% vs. preference 75.0%) and universal bottlenecks requiring architectural innovations beyond parameter scaling.IMPLICITMEM-BENCH reframes evaluation from "what agents recall" to "what they automatically enact" 1 . Chonghan Qin, Xiachong Feng, Weitao Ma, Lingpeng Kong |
ACL (1) | 1 |