Demo Data from VLDB 2026 / reviewers in the wild / expert
Mumin Jia
dblp:397/3945
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Generative modeling · 50% Deep learning architectures and training · 50% |
Topics — the 2 heaviest of 2, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Generative modeling › autoregressive model
next-token prediction |
0.9 | 1 | 2025 | Dynamics of Spontaneous Topic Changes in Next Token Prediction with Self-Attention · NeurIPS 2025 |
Machine learning › Deep learning architectures and training › attention mechanism
self-attention |
0.9 | 1 | 2025 | Dynamics of Spontaneous Topic Changes in Next Token Prediction with Self-Attention · NeurIPS 2025 |
Methods — techniques the papers use, named apart from their topics
theoretical analysis · 0.9empirical validation · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Dynamics of Spontaneous Topic Changes in Next Token Prediction with Self-AttentionabstractHuman cognition is punctuated by abrupt, spontaneous shifts between topics—driven by emotional, contextual, or associative cues—a phenomenon known as spontaneous thought in neuroscience. In contrast, self-attention-based models rely on structured patterns over their inputs to predict each next token, lacking spontaneity. Motivated by this distinction, we characterize *spontaneous topic changes* in self-attention architectures and reveal divergences from *spontaneous human thought*. First, we establish theoretical results under a simplified, single-layer self-attention model with suitable conditions by defining a topic as a set of Token Priority Graphs (TPGs). Specifically, we demonstrate that (1) the model maintains the priority order of tokens related to the input topic, (2) a spontaneous topic change can occur only if lower-priority tokens outnumber all higher-priority tokens of the input topic, and (3) unlike human cognition, the longer context length or the more ambiguous input topic does not increase the likelihood of spontaneous change. Second, we empirically validate that the effect of input length or topic ambiguity persists in modern, state-of-the-art LLMs, underscoring a fundamental disparity between human cognition and AI behavior in the context of spontaneous topic changes. To the best of our knowledge, no prior work has explored these questions with a focus so closely aligned to human thought. Mumin Jia, Jairo Diaz Rodriguez |
NeurIPS | 1 |