Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Ziyang Zou

dblp:378/5745 · DBLP profile ↗
← Back
3ranked-venue papers
1as first author
3since 2021 · last 2026
0009-0003-4166-6810ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Systems, architecture and hardware · 2 · 2 since 2021Computer networks · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer architecture, parallel and distributed computing, and storage systems
2 papers
Distributed systems · 44% High-performance computing · 44% Cloud and datacenter computing · 13%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Distributed systems › distributed machine learning
distributed training
1.012026
Reducing Cross-Pod Communication Overhead for MoE Model Training With Hybrid Parallelism in Multi-Tenant Clusters · IEEE Trans. Parallel Distributed Syst. 2026
High-performance computing › large-scale training
large language model training
1.012026
PhOrch: Proactive Phase-Level Flow Path Orchestration For Contention-Free LLM Training · INFOCOM 2026
Cloud and datacenter computing
resource management
0.312026
Reducing Cross-Pod Communication Overhead for MoE Model Training With Hybrid Parallelism in Multi-Tenant Clusters · IEEE Trans. Parallel Distributed Syst. 2026

Methods — techniques the papers use, named apart from their topics

proactive orchestration · 1.0neighborhood search · 1.0best-fit · 1.00-1 integer quadratic programming · 1.0
YearPublicationVenuePosition
2026 PhOrch: Proactive Phase-Level Flow Path Orchestration For Contention-Free LLM Training
Ziyang Zou, Shuangwu Chen, Tao Zhang 0170, Huihuang Qin, Jian Yang 0014, Xiaobin Tan, Dong Jin 0004
INFOCOM1
2026 Reducing Cross-Pod Communication Overhead for MoE Model Training With Hybrid Parallelism in Multi-Tenant Clusters
abstract
The massive parameter scale of sparsely-activated Mixture-of-Experts (MoE) models necessitates distributed training with hybrid parallelism. Placing such training tasks,i.e.mapping the logical partitions of an MoE model to available physical NPUs, is challenging. Due to the bandwidth and latency discrepancies between intra- and inter- Pods, the cross-Pod communication usually becomes a bottleneck. The high dispersion of NPUs in multi-tenant clusters exacerbates this issue further. However, a paucity of studies has considered the cross-Pod model placement problem. To address this challenge, we propose a novel model placement scheme tailored for MoE model training with hybrid parallelism in multi-tenant clusters. By quantifying the cross-Pod communication overhead incurred during MoE model training, the model placement is formulated as a 0-1 integer quadratic problem, which is NP hard. Motivated by the traffic difference between different parallelism, we decompose this problem into two subproblems. To solve the subproblems, we propose a lightweight two-stage algorithm based on Best-Fit strategy and neighborhood search. Experiments under different models and network topologies show that our model placement scheme can reduce cross-Pod traffic by 35.9% and cut communication time by 18.7% compared to state-of-the-art methods.
Huihuang Qin, Shuangwu Chen, Tao Zhang 0170, Ziyang Zou, Xiaobin Tan, Shiyin Zhu, Jian Yang 0014
IEEE Trans. Parallel Distributed Syst.5
2025 HBD-CE: Efficient Cross-HBD Communication for LLM Training in High-Bandwidth Domain Cluster via Hierarchical Collectives
Huihuang Qin, Shuangwu Chen, Zijian Wen, Ziyang Zou, Tao Zhang 0170, Xiaobin Tan, Jian Yang 0014
NPC (2)5