EDBT 2026 Demo / reviewers in the wild / expert
Guangbin Meng
dblp:381/6088
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Computer architecture, parallel and distributed computing, and storage systems
1 paper |
Storage systems · 91% Cloud and datacenter computing · 9% | |
| Databases, data mining, and information retrieval
1 paper |
Database system architecture and tuning · 100% |
Topics — the 3 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Storage systems › scalable storage › big data storage
data lake storage |
0.8 | 1 | 2024 | Separation Is for Better Reunion: Data Lake Storage at Huawei · ICDE 2024 |
Storage systems › distributed storage
disaggregated storage |
0.8 | 1 | 2024 | Separation Is for Better Reunion: Data Lake Storage at Huawei · ICDE 2024 |
Storage systems
storage reliability |
0.8 | 1 | 2024 | Separation Is for Better Reunion: Data Lake Storage at Huawei · ICDE 2024 |
Methods — techniques the papers use, named apart from their topics
tiered storage · 1.5metadata acceleration · 1.5erasure coding · 1.5
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | Separation Is for Better Reunion: Data Lake Storage at HuaweiabstractHuawei collaborates with some Chinese large busi-ness companies to store and process exabytes of nationwide operational data in data lake storage to provide business insights. Specifically, our customers will ask to store and process massive log message data to support their real-time and decision-making applications. Thus, we need computation and storage components in the analytic platform to process and store these data cost-efficiently. To meet these user requirements, we have designed a storage system in data lake, StreamLake, which introduces a novel design to serve log message streaming and batch data processing in distributed storage, with high scalability, efficiency, reliability and low cost. Specifically, we introduce a stream (storage) object as a storage abstraction for message streaming data to achieve the storage-disaggregated architecture with high scalability and reliability. Moreover, we utilize the erasure coding and tiered storage to save the storage cost, and furthermore, the stream object can be automatically converted to a table object such that cost-effective stream and batch data processing can be achieved. For tabular data, we implement the lakehouse functionality to support ACID via the table object, with a metadata acceleration to improve the efficiency of data access between the compute and storage engines. Also, we design a LakeBrain optimizer at the storage side to optimize the query performance and resource utilization under the storage-disaggregated architecture. Finally, we have also deployed StreamLake in China Mobile, the world's largest mobile network operator to serve over 20PB production data, and the results demonstrate improvements of 30% to 4x in terms of query performance and over 37% in terms of cost saving. Chengliang Chai, Haohai Ma, Zhenyong Fan, Jiaquan Zhang, Rui Zhang 0003, Duanshun Li, Keji Huang, Guangbin Meng, Yuefeng Zhou, Lirong Jian, Jiwu Shu, Ye Yuan 0001, Guoren Wang, Guoliang Li 0001 |
ICDE | 13 |