Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Dongjun Nam

dblp:420/1328 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Efficient and distributed learning · 33% Deep learning architectures and training · 33% Representation and self-supervised learning · 33%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Deep learning architectures and training
data augmentation
0.912025
Single-Teacher View Augmentation: Boosting Knowledge Distillation via Angular Diversity · NeurIPS 2025
Machine learning › Efficient and distributed learning › model compression
knowledge distillation
0.912025
Single-Teacher View Augmentation: Boosting Knowledge Distillation via Angular Diversity · NeurIPS 2025
Machine learning › Representation and self-supervised learning › multi-view learning
view augmentation
0.912025
Single-Teacher View Augmentation: Boosting Knowledge Distillation via Angular Diversity · NeurIPS 2025

Methods — techniques the papers use, named apart from their topics

ensemble distillation · 0.9angular diversity loss · 0.9
YearPublicationVenuePosition
2025 Single-Teacher View Augmentation: Boosting Knowledge Distillation via Angular Diversity
abstract
Knowledge Distillation (KD) aims to train a lightweight student model by transferring knowledge from a large, high-capacity teacher. Recent studies have shown that leveraging diverse teacher perspectives can significantly improve distillation performance; however, achieving such diversity typically requires multiple teacher networks, leading to high computational costs. In this work, we propose a novel cost-efficient knowledge augmentation method for KD that generates diverse multi-views by attaching multiple branches to a single teacher. To ensure meaningful semantic variation across multi-views, we introduce two angular diversity objectives: 1) $\textit{constrained inter-angle diversify loss}$, which maximizes angles between augmented views while preserving proximity to the original teacher output, and 2) $\textit{intra-angle diversify loss}$, which encourages an even distribution of views around the original output. The ensembled knowledge from these angularly diverse views, along with the original teacher, is distilled into the student. We further theoretically demonstrate that our objectives increase the diversity among ensemble members and thereby reduce the upper bound of the ensemble's expected loss, leading to more effective distillation. Experimental results show that our method surpasses an existing knowledge augmentation method across diverse configurations. Moreover, the proposed method is compatible with other KD frameworks in a plug-and-play fashion, providing consistent improvements in generalization performance.
Seonghoon Yu, Dongjun Nam, Dina Katabi, Jeany Son
NeurIPS2