Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Philippe Guyard

dblp:371/8653 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Databases, data management, data science and information retrieval · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Databases, data mining, and information retrieval
1 paper
Query processing and optimization · 100%
Computer architecture, parallel and distributed computing, and storage systems
1 paper
Cloud and datacenter computing · 100%

Topics — the 4 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Query processing and optimization
adaptive query processing
0.812024
A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning · Proc. VLDB Endow. 2024
Query processing and optimization
query optimization
0.812024
A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning · Proc. VLDB Endow. 2024
Cloud and datacenter computing
cluster resource management and scheduling
0.812024
A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning · Proc. VLDB Endow. 2024
Cloud and datacenter computing
cloud deployment
0.212024
A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning · Proc. VLDB Endow. 2024

Methods — techniques the papers use, named apart from their topics

multi-objective optimization · 1.5hybrid compile-time/runtime tuning · 1.5
YearPublicationVenuePosition
2024 A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning
abstract
As Spark becomes a common big data analytics platform, its growing complexity makes automatic tuning of numerous parameters critical for performance. Our work on Spark parameter tuning is particularly motivated by two recent trends: Spark's Adaptive Query Execution (AQE) based on runtime statistics, and the increasingly popular Spark cloud deployments that make cost-performance reasoning crucial for the end user. This paper presents our design of a Spark optimizer that controls all tunable parameters of each query in the new AQE architecture to explore its performance benefits and, at the same time, casts the tuning problem in the theoretically sound multi-objective optimization (MOO) setting to better adapt to user cost-performance preferences. To this end, we propose a novel hybrid compile-time/runtime approach to multi-granularity tuning of diverse, correlated Spark parameters, as well as a suite of modeling and optimization techniques to solve the tuning problem in the MOO setting while meeting the stringent time constraint of 1--2 seconds for cloud use. Evaluation results using TPC-H and TPC-DS benchmarks demonstrate the superior performance of our approach: (i ) When prioritizing latency, it achieves 63% and 65% reduction for TPC-H and TPC-DS, respectively, under an average solving time of 0.7--0.8 sec, outperforming the most competitive MOO method that reduces only 18--25% latency with 2.6--15 sec solving time. (ii) When shifting preferences between latency and cost, our approach dominates the solutions of alternative methods, exhibiting superior adaptability to varying preferences.
Chenghao Lyu, Philippe Guyard, Yanlei Diao
Proc. VLDB Endow.3