EDBT 2026 Demo / reviewers in the wild / expert
Yufan Bao
dblp:300/7333
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Efficient and distributed learning · 60% Image recognition and object detection · 20% Optimization for machine learning · 20% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Optimization for machine learning › evolutionary computation
genetic algorithms |
0.8 | 1 | 2024 | DetKDS: Knowledge Distillation Search for Object Detectors · ICML 2024 |
Machine learning › Efficient and distributed learning › model compression
knowledge distillation |
0.8 | 1 | 2024 | DetKDS: Knowledge Distillation Search for Object Detectors · ICML 2024 |
Machine learning › Efficient and distributed learning
model compression |
0.8 | 1 | 2024 | DetKDS: Knowledge Distillation Search for Object Detectors · ICML 2024 |
Machine learning › Efficient and distributed learning › automated machine learning
neural architecture search |
0.8 | 1 | 2024 | DetKDS: Knowledge Distillation Search for Object Detectors · ICML 2024 |
Computer vision › Image recognition and object detection
object detection |
0.8 | 1 | 2024 | DetKDS: Knowledge Distillation Search for Object Detectors · ICML 2024 |
Methods — techniques the papers use, named apart from their topics
evolutionary algorithm · 0.8divide-and-conquer search · 0.8
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | DetKDS: Knowledge Distillation Search for Object DetectorsabstractIn this paper, we present DetKDS, the first framework that searches for optimal detection distillation policies. Manual design of detection distillers becomes challenging and time-consuming due to significant disparities in distillation behaviors between detectors with different backbones, paradigms, and label assignments. To tackle these challenges, we leverage search algorithms to discover optimal distillers for homogeneous and heterogeneous student-teacher pairs. Firstly, our search space encompasses global features, foreground-background features, instance features, logits response, and localization response as inputs. Then, we construct omni-directional cascaded transformations and obtain the distiller by selecting the advanced distance function and common weight value options. Finally, we present a divide-and-conquer evolutionary algorithm to handle the explosion of the search space. In this strategy, we first evolve the best distiller formulations of individual knowledge inputs and then optimize the combined weights of these multiple distillation losses. DetKDS automates the distillation process without requiring expert design or additional tuning, effectively reducing the teacher-student gap in various scenarios. Based on the analysis of our search results, we provide valuable guidance that contributes to detection distillation designs. Comprehensive experiments on different detectors demonstrate that DetKDS outperforms state-of-the-art methods in detection and instance segmentation tasks. For instance, DetKDS achieves significant gains than baseline detectors: $+3.7$, $+4.1$, $+4.0$, $+3.7$, and $+3.5$ AP on RetinaNet, Faster-RCNN, FCOS, RepPoints, and GFL, respectively. Code at: https://github.com/lliai/DetKDS. Lujun Li 0001, Yufan Bao, Peijie Dong, Chuanguang Yang, Anggeng Li, Wenhan Luo, Wei Xue 0002, Yike Guo |
ICML | 2 |