Demo Data from VLDB 2026 / reviewers in the wild / expert
Samira Hajizadeh
dblp:408/1511
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2026
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Language models and text generation · 50% Deep learning architectures and training · 50% | |
| Software engineering, system software, and programming languages
1 paper |
Software maintenance and evolution · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
code understanding |
1.0 | 1 | 2026 | Sense and Sensitivity: Examining the Influence of Semantic Recall on Long Context Code Understanding · ACL (1) 2026 |
Machine learning › Deep learning architectures and training › transformer › transformer analysis
positional effect |
1.0 | 1 | 2026 | Sense and Sensitivity: Examining the Influence of Semantic Recall on Long Context Code Understanding · ACL (1) 2026 |
Software maintenance and evolution › program comprehension
code comprehension |
0.3 | 1 | 2026 | Sense and Sensitivity: Examining the Influence of Semantic Recall on Long Context Code Understanding · ACL (1) 2026 |
Methods — techniques the papers use, named apart from their topics
semantic recall sensitivity · 2.0counterfactual measurement · 2.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Sense and Sensitivity: Examining the Influence of Semantic Recall on Long Context Code UnderstandingabstractLarge language models (LLMs) are increasingly deployed for understanding large codebases, but whether they understand operational semantics of long code context or rely on pattern matching shortcuts remains unclear.We distinguish between lexical recall (retrieving code verbatim) and semantic recall (understanding operational semantics).Evaluating 10 state-of-the-art LLMs, we find that while frontier models achieve near-perfect, positionindependent lexical recall, semantic recall degrades severely when code is centrally positioned in long contexts.We introduce semantic recall sensitivity to measure whether tasks require understanding of code's operational semantics vs. permit pattern matching shortcuts.Through a novel counterfactual measurement method, we show that models rely heavily on pattern matching shortcuts to solve existing code understanding benchmarks.We propose a new task SemTrace, which achieves high semantic recall sensitivity through unpredictable operations; LLMs' accuracy exhibits severe positional effects, with median accuracy drops of 92.73% versus CRUXEval's 53.36% as the relevant code snippet approaches the middle of the input code context.Our findings suggest current evaluations substantially underestimate semantic recall failures in long context code understanding. 1 Adam Storek, Mukur Gupta, Samira Hajizadeh, Prashast Srivastava, Suman Jana |
ACL (1) | 3 |