Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data.

Zhenyong Fan

dblp:381/6163 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Databases, data management, data science and information retrieval · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer architecture, parallel and distributed computing, and storage systems
1 paper
Storage systems · 91% Cloud and datacenter computing · 9%
Databases, data mining, and information retrieval
1 paper
Database system architecture and tuning · 100%

Topics — the 3 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Storage systems › scalable storage › big data storage
data lake storage
0.812024
Separation Is for Better Reunion: Data Lake Storage at Huawei · ICDE 2024
Storage systems › distributed storage
disaggregated storage
0.812024
Separation Is for Better Reunion: Data Lake Storage at Huawei · ICDE 2024
Storage systems
storage reliability
0.812024
Separation Is for Better Reunion: Data Lake Storage at Huawei · ICDE 2024

Methods — techniques the papers use, named apart from their topics

tiered storage · 1.5metadata acceleration · 1.5erasure coding · 1.5
YearPublicationVenuePosition
2024 Separation Is for Better Reunion: Data Lake Storage at Huawei
abstract
Huawei collaborates with some Chinese large busi-ness companies to store and process exabytes of nationwide operational data in data lake storage to provide business insights. Specifically, our customers will ask to store and process massive log message data to support their real-time and decision-making applications. Thus, we need computation and storage components in the analytic platform to process and store these data cost-efficiently. To meet these user requirements, we have designed a storage system in data lake, StreamLake, which introduces a novel design to serve log message streaming and batch data processing in distributed storage, with high scalability, efficiency, reliability and low cost. Specifically, we introduce a stream (storage) object as a storage abstraction for message streaming data to achieve the storage-disaggregated architecture with high scalability and reliability. Moreover, we utilize the erasure coding and tiered storage to save the storage cost, and furthermore, the stream object can be automatically converted to a table object such that cost-effective stream and batch data processing can be achieved. For tabular data, we implement the lakehouse functionality to support ACID via the table object, with a metadata acceleration to improve the efficiency of data access between the compute and storage engines. Also, we design a LakeBrain optimizer at the storage side to optimize the query performance and resource utilization under the storage-disaggregated architecture. Finally, we have also deployed StreamLake in China Mobile, the world's largest mobile network operator to serve over 20PB production data, and the results demonstrate improvements of 30% to 4x in terms of query performance and over 37% in terms of cost saving.
Chengliang Chai, Haohai Ma, Zhenyong Fan, Jiaquan Zhang, Rui Zhang 0003, Duanshun Li, Keji Huang, Guangbin Meng, Yuefeng Zhou, Lirong Jian, Jiwu Shu, Ye Yuan 0001, Guoren Wang, Guoliang Li 0001
ICDE6