Demo Data from EDBT 2026 / reviewers in the wild / expert
Zanbo Wang
dblp:247/9665
· DBLP profile ↗
3ranked-venue papers
0as first author
3since 2021 · last 2026
—ORCID · conflict
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 2 · 2 since 2021Systems, architecture and hardware · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Computer architecture, parallel and distributed computing, and storage systems
1 paper |
Distributed systems · 44% Parallel and multicore computing · 44% High-performance computing · 13% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Distributed systems › distributed machine learning
distributed training |
1.0 | 1 | 2026 | MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in Production · EuroSys 2026 |
Parallel and multicore computing › parallelization strategies
model parallelism |
1.0 | 1 | 2026 | MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in Production · EuroSys 2026 |
High-performance computing › large-scale training
large-scale training systems |
0.3 | 1 | 2026 | MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in Production · EuroSys 2026 |
Methods — techniques the papers use, named apart from their topics
workload balancing · 1.0encoder-LLM multiplexing · 1.0adaptive resharding · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in ProductionabstractAs the foundational component of versatile AI applications, training an multimodal large language model (MLLM) relies on multimodal datasets with dynamic modality mixture proportions and sample length distributions. However, existing MLLM systems remain inefficient under dynamic workloads, due to statically coupled decisions of resource allocation and model parallelization between encoders and the LLM backbone. This paper presents MegaScale-Omni, an industrial-grade MLLM training system tailored for dynamic workload adaption and hyper-scale deployment. MegaScale-Omni is built upon the training scheme of encoder-LLM multiplexing with three key innovations: (1) Decoupled parallelism strategies with long-short sequence parallelism for encoders to process variable-length samples, and full-fledged 5D parallelism for the LLM backbone, both organized under a communication-efficient parallelization layout. (2) Unified encoder-LLM representations for flexible, extensible colocation, and a new paradigm of encoder-LLM joint pipeline with workload resilience. (3) Workload balancing techniques via decentralized grouped reordering in data loaders and adaptive resharding from encoder to LLM ranks. MegaScale-Omni is deployed as the foundation of our in-house large-scale MLLM training tasks with thousands of GPUs. Our experimental results demonstrate 1.27×–7.57× throughput improvement under production-grade dynamic workloads, as compared to four state-of-the-art systems. Chunyu Xue, Yangrui Chen, Jianyu Jiang, Ningxin Zheng, Junda Feng, Jingji Chen, Shixiong Zhao, Zanbo Wang, Lishu Luo, Faming Wu, Haibin Lin, Yanghua Peng, Xin Liu 0086, Quan Chen 0002 |
EuroSys | 11 |
| 2024 | Exploiting global contextual information for document-level named entity recognition
Yiting Yu, Zanbo Wang, Wei Wei 0002, Xianling Mao, Shanshan Feng 0001, Fei Wang 0014, Sheng Jiang 0003 |
Knowl. Based Syst. | 2 |
| 2021 | Position-aware self-attention based neural sequence labeling
Wei Wei 0002, Zanbo Wang, Xianling Mao, Guangyou Zhou, Pan Zhou 0001, Sheng Jiang 0003 |
Pattern Recognit. | 2 |