Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Zanbo Wang

dblp:247/9665 · DBLP profile ↗
← Back
3ranked-venue papers
0as first author
3since 2021 · last 2026
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 2 since 2021Systems, architecture and hardware · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer architecture, parallel and distributed computing, and storage systems
1 paper
Distributed systems · 44% Parallel and multicore computing · 44% High-performance computing · 13%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Distributed systems › distributed machine learning
distributed training
1.012026
MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in Production · EuroSys 2026
Parallel and multicore computing › parallelization strategies
model parallelism
1.012026
MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in Production · EuroSys 2026
High-performance computing › large-scale training
large-scale training systems
0.312026
MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in Production · EuroSys 2026

Methods — techniques the papers use, named apart from their topics

workload balancing · 1.0encoder-LLM multiplexing · 1.0adaptive resharding · 1.0
YearPublicationVenuePosition
2026 MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in Production
abstract
As the foundational component of versatile AI applications, training an multimodal large language model (MLLM) relies on multimodal datasets with dynamic modality mixture proportions and sample length distributions. However, existing MLLM systems remain inefficient under dynamic workloads, due to statically coupled decisions of resource allocation and model parallelization between encoders and the LLM backbone. This paper presents MegaScale-Omni, an industrial-grade MLLM training system tailored for dynamic workload adaption and hyper-scale deployment. MegaScale-Omni is built upon the training scheme of encoder-LLM multiplexing with three key innovations: (1) Decoupled parallelism strategies with long-short sequence parallelism for encoders to process variable-length samples, and full-fledged 5D parallelism for the LLM backbone, both organized under a communication-efficient parallelization layout. (2) Unified encoder-LLM representations for flexible, extensible colocation, and a new paradigm of encoder-LLM joint pipeline with workload resilience. (3) Workload balancing techniques via decentralized grouped reordering in data loaders and adaptive resharding from encoder to LLM ranks. MegaScale-Omni is deployed as the foundation of our in-house large-scale MLLM training tasks with thousands of GPUs. Our experimental results demonstrate 1.27×–7.57× throughput improvement under production-grade dynamic workloads, as compared to four state-of-the-art systems.
Chunyu Xue, Yangrui Chen, Jianyu Jiang, Ningxin Zheng, Junda Feng, Jingji Chen, Shixiong Zhao, Zanbo Wang, Lishu Luo, Faming Wu, Haibin Lin, Yanghua Peng, Xin Liu 0086, Quan Chen 0002
EuroSys11
2024 Exploiting global contextual information for document-level named entity recognition
Yiting Yu, Zanbo Wang, Wei Wei 0002, Xianling Mao, Shanshan Feng 0001, Fei Wang 0014, Sheng Jiang 0003
Knowl. Based Syst.2
2021 Position-aware self-attention based neural sequence labeling
Wei Wei 0002, Zanbo Wang, Xianling Mao, Guangyou Zhou, Pan Zhou 0001, Sheng Jiang 0003
Pattern Recognit.2