Demo Data from EDBT 2026 / reviewers in the wild / expert
Jiyoun Ha
dblp:217/9947
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Efficient and distributed learning · 46% Deep learning architectures and training · 30% Language models and text generation · 23% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Efficient and distributed learning
adaptive computation |
0.9 | 1 | 2025 | Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation · NeurIPS 2025 |
Natural language and speech › Language models and text generation
efficient language model |
0.9 | 1 | 2025 | Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation · NeurIPS 2025 |
Machine learning › Efficient and distributed learning
parameter sharing |
0.9 | 1 | 2025 | Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation · NeurIPS 2025 |
Machine learning › Deep learning architectures and training › transformer
recursive transformer |
0.9 | 1 | 2025 | Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation · NeurIPS 2025 |
Machine learning › Deep learning architectures and training
transformer |
0.3 | 1 | 2025 | Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation · NeurIPS 2025 |
Methods — techniques the papers use, named apart from their topics
token-level routing · 0.9mixture of recursions · 0.9KV sharing · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level ComputationabstractScaling language models unlocks impressive capabilities, but the accompanying computational and memory demands make both training and deployment expensive. Existing efficiency efforts typically target either parameter sharing or adaptive computation, leaving open the question of how to attain both simultaneously. We introduce Mixture-of-Recursions (MoR), a unified framework that combines the two axes of efficiency inside a single Recursive Transformer. MoR reuses a shared stack of layers across recursion steps to achieve parameter efficiency, while lightweight routers enable adaptive token-level thinking by dynamically assigning different recursion depths to individual tokens. This allows MoR to focus quadratic attention computation only among tokens still active at a given recursion depth, further improving memory access efficiency by selectively caching only their key-value pairs. Beyond these core mechanisms, we also propose a KV sharing variant that reuses KV pairs from the first recursion, specifically designed to further decrease memory footprint. Across model scales ranging from 135M to 1.7B parameters, MoR forms a new Pareto frontier: at equal training FLOPs and smaller model sizes, it significantly lowers validation perplexity and improves few-shot accuracy, while delivering higher throughput compared with vanilla and existing recursive baselines. Sangmin Bae, Reza Bayat, Sungnyun Kim, Jiyoun Ha, Tal Schuster, Adam Fisch, Hrayr Harutyunyan, Aaron C. Courville, Se-Young Yun |
NeurIPS | 5 |