Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Wanxin Song

dblp:434/2750 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2026
0009-0001-2776-8883ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Systems, architecture and hardware · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer architecture, parallel and distributed computing, and storage systems
1 paper
High-performance computing · 50% Distributed systems · 25% Hardware accelerators and domain-specific architectures · 25%

Topics — the 4 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
High-performance computing
collective communication
1.012026
UniOrch: A Unified Mixed Framework for High-Efficiency LLM Training on Heterogeneous AI Chips · IEEE Trans. Parallel Distributed Syst. 2026
Distributed systems › distributed machine learning
distributed training
1.012026
UniOrch: A Unified Mixed Framework for High-Efficiency LLM Training on Heterogeneous AI Chips · IEEE Trans. Parallel Distributed Syst. 2026
Hardware accelerators and domain-specific architectures › accelerator integration
heterogeneous accelerator integration
1.012026
UniOrch: A Unified Mixed Framework for High-Efficiency LLM Training on Heterogeneous AI Chips · IEEE Trans. Parallel Distributed Syst. 2026
High-performance computing › large-scale training
large language model training
1.012026
UniOrch: A Unified Mixed Framework for High-Efficiency LLM Training on Heterogeneous AI Chips · IEEE Trans. Parallel Distributed Syst. 2026

Methods — techniques the papers use, named apart from their topics

hybrid parallel training · 1.0cost model · 1.0
YearPublicationVenuePosition
2026 UniOrch: A Unified Mixed Framework for High-Efficiency LLM Training on Heterogeneous AI Chips
abstract
Efficient coordination of heterogeneous AI chips (GPU/NPU/DCU) in data centers is crucial for Large Language Model (LLM) training, but this process is hindered by architectural mismatches, protocol fragmentation, and network partitioning. Existing solutions fail to achieve unified resource management across different chips, resulting in severe resource fragmentation and reduced allreduce efficiency. To overcome these limitations, this paper proposes the unified coordination framework UniOrch, which not only integrates three core functionalities, including hardware abstraction, software standardization, and communication coordination, but also enables the training and inference of large models across heterogeneous AI chips. UniOrch's hardware-agnostic bare-metal cloud eliminates virtualization overhead through Border Gateway Protocol Ethernet Virtual Private Network (BGP EVPN) overlay networks and gateway-based chip integration; its PyTorch-based adaptation layer masks hardware differences and reduces migration costs; the Transformer Collective Communication Library (TCCL) unifies NCCL, HCCL, and OpenMPIprotocols to support seamless hybrid parallel training. Furthermore, the framework ' score scheduling mechanism is the Heterogeneous Hybrid Estimation Model (HHEM), which employs a two stage cost model combining static analysis with dynamic runtime feedback to dynamically allocate computing power based on Transformer task loads, ensuring cross-chip task synchronization, resource pooling, and dynamic allocation. Deployment verification in real-world production environments (e.g., China Construction Bank) shows that UniOrch achieves significant improvements: resource utilization of heterogeneous AI infrastructure is increased by 35%, cross-chip latency is reduced by 42%, accuracy loss in heterogeneous environments is <0.8%.
Jia Wang 0038, Yang Zhai, Haojie Wang 0004, Wanxin Song, Wei Li 0008, Zhaofeng He 0001
IEEE Trans. Parallel Distributed Syst.7