Demo Data from SIGIR 2026 / reviewers in the wild / expert
Dongjun Nam
dblp:420/1328
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Efficient and distributed learning · 33% Deep learning architectures and training · 33% Representation and self-supervised learning · 33% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Deep learning architectures and training
data augmentation |
0.9 | 1 | 2025 | Single-Teacher View Augmentation: Boosting Knowledge Distillation via Angular Diversity · NeurIPS 2025 |
Machine learning › Efficient and distributed learning › model compression
knowledge distillation |
0.9 | 1 | 2025 | Single-Teacher View Augmentation: Boosting Knowledge Distillation via Angular Diversity · NeurIPS 2025 |
Machine learning › Representation and self-supervised learning › multi-view learning
view augmentation |
0.9 | 1 | 2025 | Single-Teacher View Augmentation: Boosting Knowledge Distillation via Angular Diversity · NeurIPS 2025 |
Methods — techniques the papers use, named apart from their topics
ensemble distillation · 0.9angular diversity loss · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Single-Teacher View Augmentation: Boosting Knowledge Distillation via Angular DiversityabstractKnowledge Distillation (KD) aims to train a lightweight student model by transferring knowledge from a large, high-capacity teacher.
Recent studies have shown that leveraging diverse teacher perspectives can significantly improve distillation performance; however, achieving such diversity typically requires multiple teacher networks, leading to high computational costs. In this work, we propose a novel cost-efficient knowledge augmentation method for KD that generates diverse multi-views by attaching multiple branches to a single teacher. To ensure meaningful semantic variation across multi-views, we introduce two angular diversity objectives: 1) $\textit{constrained inter-angle diversify loss}$, which maximizes angles between augmented views while preserving proximity to the original teacher output, and 2) $\textit{intra-angle diversify loss}$, which encourages an even distribution of views around the original output. The ensembled knowledge from these angularly diverse views, along with the original teacher, is distilled into the student. We further theoretically demonstrate that our objectives increase the diversity among ensemble members and thereby reduce the upper bound of the ensemble's expected loss, leading to more effective distillation. Experimental results show that our method surpasses an existing knowledge augmentation method across diverse configurations. Moreover, the proposed method is compatible with other KD frameworks in a plug-and-play fashion, providing consistent improvements in generalization performance. Seonghoon Yu, Dongjun Nam, Dina Katabi, Jeany Son |
NeurIPS | 2 |