Demo Data from EDBT 2026 / reviewers in the wild / expert
Roman Abramov
dblp:286/9480
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Deep learning architectures and training · 50% Question answering and dialogue systems · 25% Knowledge representation and reasoning · 25% |
Topics — the 4 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Deep learning architectures and training
data augmentation |
0.9 | 1 | 2025 | Grokking in the Wild: Data Augmentation for Real-World Multi-Hop Reasoning with Transformers · ICML 2025 |
Machine learning › Deep learning architectures and training › training dynamics
grokking |
0.9 | 1 | 2025 | Grokking in the Wild: Data Augmentation for Real-World Multi-Hop Reasoning with Transformers · ICML 2025 |
Knowledge, reasoning and agents › Knowledge representation and reasoning › knowledge graph
knowledge graph augmentation |
0.9 | 1 | 2025 | Grokking in the Wild: Data Augmentation for Real-World Multi-Hop Reasoning with Transformers · ICML 2025 |
Natural language and speech › Question answering and dialogue systems
multi-hop reasoning |
0.9 | 1 | 2025 | Grokking in the Wild: Data Augmentation for Real-World Multi-Hop Reasoning with Transformers · ICML 2025 |
Methods — techniques the papers use, named apart from their topics
knowledge graph augmentation · 0.9data augmentation · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Grokking in the Wild: Data Augmentation for Real-World Multi-Hop Reasoning with TransformersabstractTransformers have achieved great success in numerous NLP tasks but continue to exhibit notable gaps in multi-step factual reasoning, especially when real-world knowledge is sparse. Recent advances in grokking have demonstrated that neural networks can transition from memorizing to perfectly generalizing once they detect underlying logical patterns – yet these studies have primarily used small, synthetic tasks. In this paper, for the first time, we extend grokking to real-world factual data and address the challenge of dataset sparsity by augmenting existing knowledge graphs with carefully designed synthetic data to raise the ratio $\phi_r$ of inferred facts to atomic facts above the threshold required for grokking. Surprisingly, we find that even factually incorrect synthetic data can strengthen emergent reasoning circuits rather than degrade accuracy, as it forces the model to rely on relational structure rather than memorization. When evaluated on multi-hop reasoning benchmarks, our approach achieves up to 95–100% accuracy on 2WikiMultiHopQA – substantially improving over strong baselines and matching or exceeding current state-of-the-art results. We further provide an in-depth analysis of how increasing $\phi_r$ drives the formation of generalizing circuits inside Transformers. Our findings suggest that grokking-based data augmentation can unlock implicit multi-hop reasoning capabilities, opening the door to more robust and interpretable factual reasoning in large-scale language models. Roman Abramov, Felix Steinbauer, Gjergji Kasneci |
ICML | 1 |