Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Mingyuan Cai

dblp:409/3206 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Software engineering, systems software and programming languages · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer architecture, parallel and distributed computing, and storage systems
1 paper
High-performance computing · 38% Parallel and multicore computing · 38% Cloud and datacenter computing · 12%

Topics — the 3 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Parallel and multicore computing
MPI
0.912025
Towards Hybrid Architectures for Big Data Analytics: Insights From Spark-MPI Integration · IEEE Trans. Serv. Comput. 2025
Cloud and datacenter computing
big data analytics
0.312025
Towards Hybrid Architectures for Big Data Analytics: Insights From Spark-MPI Integration · IEEE Trans. Serv. Comput. 2025
Memory systems
in-memory computing
0.312025
Towards Hybrid Architectures for Big Data Analytics: Insights From Spark-MPI Integration · IEEE Trans. Serv. Comput. 2025
YearPublicationVenuePosition
2025 Towards Hybrid Architectures for Big Data Analytics: Insights From Spark-MPI Integration
abstract
High-Performance Data Analytics (HPDA) combines high-performance computing (HPC) with data analytics to uncover patterns and insights in dual-intensive applications that are both data-intensive and compute-intensive. Traditional big data frameworks and HPC technologies often struggle to address these demands independently, prompting researchers to explore their integration. Spark, known for its efficient in-memory computing with RDDs, and MPI, a foundational standard in HPC, are prominent candidates for such integration. This survey explores the integration of Spark and MPI for HPDA, highlighting their potential for unified data processing and computation. We first classify application workloads and review the characteristics and limitations of traditional frameworks. Then, we analyze the challenges and requirements of integrated architectures, focusing on the specific implementations of typical middleware-level architectures. Through comparative analysis, we highlight their advantages and limitations. Finally, we present application examples, outline key challenges and future research directions, and briefly discuss progress in integration approaches for other technology combinations.
Mengbing Zhou, Qiuyan Li, Mingyuan Cai, Cheng-Zhong Xu 0001, Yang Wang 0006
IEEE Trans. Serv. Comput.3