EDBT 2026 Demo / reviewers in the wild / expert
Yipeng Mei
dblp:399/0396
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
0009-0005-6581-1028ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Systems, architecture and hardware · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Efficient and distributed learning · 100% | |
| Computer architecture, parallel and distributed computing, and storage systems
1 paper |
High-performance computing · 50% Distributed systems · 50% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Efficient and distributed learning
distributed training |
0.9 | 1 | 2025 | EfficientMoE: Optimizing Mixture-of-Experts Model Training With Adaptive Load Balance · IEEE Trans. Parallel Distributed Syst. 2025 |
Machine learning › Efficient and distributed learning › resource allocation
load balancing |
0.9 | 1 | 2025 | EfficientMoE: Optimizing Mixture-of-Experts Model Training With Adaptive Load Balance · IEEE Trans. Parallel Distributed Syst. 2025 |
Machine learning › Efficient and distributed learning › distributed training › large model training
mixture-of-experts training |
0.9 | 1 | 2025 | EfficientMoE: Optimizing Mixture-of-Experts Model Training With Adaptive Load Balance · IEEE Trans. Parallel Distributed Syst. 2025 |
Distributed systems
communication optimization |
0.3 | 1 | 2025 | EfficientMoE: Optimizing Mixture-of-Experts Model Training With Adaptive Load Balance · IEEE Trans. Parallel Distributed Syst. 2025 |
High-performance computing
performance optimization at scale |
0.3 | 1 | 2025 | EfficientMoE: Optimizing Mixture-of-Experts Model Training With Adaptive Load Balance · IEEE Trans. Parallel Distributed Syst. 2025 |
Methods — techniques the papers use, named apart from their topics
load prediction · 1.7expert capacity model · 1.7dynamic expert scheduling · 1.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | EfficientMoE: Optimizing Mixture-of-Experts Model Training With Adaptive Load BalanceabstractMixture-of-Experts (MoE) efficiently trains large models by using sparse activation to lower costs, selecting a few experts based on data characteristics. However, it faces challenges such as All-to-All communication overhead and load imbalance, with most optimizations targeting dynamic graphs rather than the more efficient static graphs. This study identifies two key challenges in training MoE on static graphs: 1) excessive All-to-All communication (up to 75% of iteration time) and load imbalance (70% of tokens handled by two experts) between experts due to the sparse structure of the MoE model and the token distribution; and 2) inefficient zero-padding for static shapes, leading to unnecessary computational overhead(wasting approximately 50% of resources). Thus, EfficientMoE, a scheduling method based on expert load and data characteristics, is introduced. EfficientMoE first designs a sampler to collect real-time information about token distribution, expert load, etc. It constructs a load prediction model to evaluate expert load. Subsequently, EfficientMoE proposes a dynamic schedule strategy for experts with evaluated expert load, reducing All-to-All communication and addressing load-balancing issues. Additionally, an expert capacity model is proposed to set different capacities for replicas of hot experts before static graph compilation, minimizing computation and storage overhead caused by significant padding. This study implements EfficientMoE in MindSpore and uses 32 Ascend AI accelerators to train an MoE model with 21 billion parameters and evaluate its validity. EfficientMoE demonstrated an improvement of 30% in model training time, approximately 12% reduction in communication time, and saved 35% computational resources across different clusters, compared with Switch transformers, and the Fastermoe method for static graphs. Chengchuang Huang, Yipeng Mei, Lifu Zhang 0004, Teng Su |
IEEE Trans. Parallel Distributed Syst. | 3 |