Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data.

Yufan Bao

dblp:300/7333 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Efficient and distributed learning · 60% Image recognition and object detection · 20% Optimization for machine learning · 20%

Topics — the 5 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Optimization for machine learning › evolutionary computation
genetic algorithms
0.812024
DetKDS: Knowledge Distillation Search for Object Detectors · ICML 2024
Machine learning › Efficient and distributed learning › model compression
knowledge distillation
0.812024
DetKDS: Knowledge Distillation Search for Object Detectors · ICML 2024
Machine learning › Efficient and distributed learning
model compression
0.812024
DetKDS: Knowledge Distillation Search for Object Detectors · ICML 2024
Machine learning › Efficient and distributed learning › automated machine learning
neural architecture search
0.812024
DetKDS: Knowledge Distillation Search for Object Detectors · ICML 2024
Computer vision › Image recognition and object detection
object detection
0.812024
DetKDS: Knowledge Distillation Search for Object Detectors · ICML 2024

Methods — techniques the papers use, named apart from their topics

evolutionary algorithm · 0.8divide-and-conquer search · 0.8
YearPublicationVenuePosition
2024 DetKDS: Knowledge Distillation Search for Object Detectors
abstract
In this paper, we present DetKDS, the first framework that searches for optimal detection distillation policies. Manual design of detection distillers becomes challenging and time-consuming due to significant disparities in distillation behaviors between detectors with different backbones, paradigms, and label assignments. To tackle these challenges, we leverage search algorithms to discover optimal distillers for homogeneous and heterogeneous student-teacher pairs. Firstly, our search space encompasses global features, foreground-background features, instance features, logits response, and localization response as inputs. Then, we construct omni-directional cascaded transformations and obtain the distiller by selecting the advanced distance function and common weight value options. Finally, we present a divide-and-conquer evolutionary algorithm to handle the explosion of the search space. In this strategy, we first evolve the best distiller formulations of individual knowledge inputs and then optimize the combined weights of these multiple distillation losses. DetKDS automates the distillation process without requiring expert design or additional tuning, effectively reducing the teacher-student gap in various scenarios. Based on the analysis of our search results, we provide valuable guidance that contributes to detection distillation designs. Comprehensive experiments on different detectors demonstrate that DetKDS outperforms state-of-the-art methods in detection and instance segmentation tasks. For instance, DetKDS achieves significant gains than baseline detectors: $+3.7$, $+4.1$, $+4.0$, $+3.7$, and $+3.5$ AP on RetinaNet, Faster-RCNN, FCOS, RepPoints, and GFL, respectively. Code at: https://github.com/lliai/DetKDS.
Lujun Li 0001, Yufan Bao, Peijie Dong, Chuanguang Yang, Anggeng Li, Wenhan Luo, Wei Xue 0002, Yike Guo
ICML2