Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Monika Michaluk

dblp:383/7234 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Efficient and distributed learning · 67% Deep learning architectures and training · 33%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Efficient and distributed learning › adaptive computation
early exit
0.912025
How to Train Your Multi-Exit Model? Analyzing the Impact of Training Strategies · ICML 2025
Machine learning › Efficient and distributed learning › dynamic neural network
multi-exit network
0.912025
How to Train Your Multi-Exit Model? Analyzing the Impact of Training Strategies · ICML 2025
Machine learning › Deep learning architectures and training
training dynamics
0.912025
How to Train Your Multi-Exit Model? Analyzing the Impact of Training Strategies · ICML 2025

Methods — techniques the papers use, named apart from their topics

mixed training · 0.9joint training · 0.9disjoint training · 0.9
YearPublicationVenuePosition
2025 How to Train Your Multi-Exit Model? Analyzing the Impact of Training Strategies
abstract
Early exits enable the network's forward pass to terminate early by attaching trainable internal classifiers to the backbone network. Existing early-exit methods typically adopt either a joint training approach, where the backbone and exit heads are trained simultaneously, or a disjoint approach, where the heads are trained separately. However, the implications of this choice are often overlooked, with studies typically adopting one approach without adequate justification. This choice influences training dynamics and its impact remains largely unexplored. In this paper, we introduce a set of metrics to analyze early-exit training dynamics and guide the choice of training strategy. We demonstrate that conventionally used joint and disjoint regimes yield suboptimal performance. To address these limitations, we propose a mixed training strategy: the backbone is trained first, followed by the training of the entire multi-exit network. Through comprehensive evaluations of training strategies across various architectures, datasets, and early-exit methods we present strengths and weaknesses of the early exit training strategies. In particular, we show consistent improvements in performance and efficiency using the proposed mixed strategy.
Piotr Kubaty, Bartosz Wójcik, Bartlomiej Krzepkowski, Monika Michaluk, Tomasz Trzcinski, Jary Pomponi, Kamil Adamczewski
ICML4