Demo Data from VLDB 2026 / reviewers in the wild / expert
Yinxi Li
dblp:420/0323
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2026
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Language models and text generation · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
code generation |
1.0 | 1 | 2026 | TokDrift: When LLM Speaks in Subwords but Code Speaks in Grammar · ACL (1) 2026 |
Natural language and speech › Language models and text generation
code understanding |
1.0 | 1 | 2026 | TokDrift: When LLM Speaks in Subwords but Code Speaks in Grammar · ACL (1) 2026 |
Natural language and speech › Language models and text generation
tokenization |
1.0 | 1 | 2026 | TokDrift: When LLM Speaks in Subwords but Code Speaks in Grammar · ACL (1) 2026 |
Methods — techniques the papers use, named apart from their topics
semantic-preserving rewrite · 1.0byte-pair encoding · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | TokDrift: When LLM Speaks in Subwords but Code Speaks in GrammarabstractLarge language models (LLMs) for code rely on subword tokenizers, such as byte-pair encoding (BPE), learned from mixed natural language text and programming language code but driven by statistics rather than grammar.As a result, semantically identical code snippets can be tokenized differently depending on superficial factors such as whitespace or identifier naming.To measure the impact of this misalignment, we introduce TOKDRIFT, a framework that applies semantic-preserving rewrite rules to create code variants differing only in tokenization.Across nine code LLMs, including large ones with over 30B parameters, even minor formatting changes can cause substantial shifts in model behavior.Layer-wise analysis shows that the issue originates in early embeddings, where subword segmentation fails to capture grammar token boundaries.Our findings identify misaligned tokenization as a hidden obstacle to reliable code understanding and generation, highlighting the need for grammaraware tokenization for future code LLMs.Benchmark Source Task Input PL Output PL # Samples HumanEval-Fix-py HumanEvalPack (Muennighoff et al., 2023) bug fixing Python Python 164 HumanEval-Fix-java Java Java 164 HumanEval-Explain-py code summarization Python Python 164 HumanEval-Explain-java Java Java 164 Avatar-py2java Avatar (Ahmad et al., 2023; Pan et al., 2024) code translation Python Java 244 Avatar-java2py Java Python 246 CodeNet-py2java CodeNet (Puri et al., 2021; Pan et al., 2024) Python Java 200 CodeNet-java2py Java Python 200 Yinxi Li, Yuntian Deng, Pengyu Nie 0001 |
ACL (1) | 1 |