Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Xin Yao 0008

dblp:202/9077-8 · DBLP profile ↗
← Back
30ranked-venue papers
3as first author
26since 2021 · last 2026
0000-0002-5780-7900ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Systems, architecture and hardware · 17 · 3 first-author · 13 since 2021Databases, data management, data science and information retrieval · 8 · 8 since 2021Computer networks · 6 · 6 since 2021Artificial intelligence and machine learning · 2 · 2 since 2021Security and privacy · 1 · 1 since 2021Software engineering, systems software and programming languages · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer architecture, parallel and distributed computing, and storage systems
17 papers
Storage systems · 56% Distributed systems · 11% Cloud and datacenter computing · 11%
Databases, data mining, and information retrieval
6 papers
Information retrieval · 31% Indexing and storage engines · 26% Knowledge graphs · 23%
Computer networks
5 papers
Network measurement and analytics · 48% Software-defined and programmable networks · 40% Network management and operations · 11%
Artificial intelligence
2 papers
Efficient and distributed learning · 75% Language models and text generation · 25%

Topics — the 30 heaviest of 79, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Storage systems
key-value storage
2.732026
Epiphron: Resource-Efficient Distributed Key-Value Storage · IEEE Trans. Knowl. Data Eng. 2026
HLN-Tree: A memory-efficient B+-Tree with huge leaf nodes and locality predictors · ACM Trans. Storage 2025
Cheetah: Metadata Aggregation for Fast Object Storage without Distributed Ordering · EuroSys 2025
Cloud and datacenter computing
virtualization
2.022026
A Tale of Two Paths: Optimizing Paravirtualized Storage I/O with eBPF · ACM Trans. Storage 2026
RosenBridge: A Framework for Enabling Express I/O Paths Across the Virtualization Boundary · FAST 2026
Network measurement and analytics
sketch-based measurement
1.622025
Carrera: Enabling High-Performance eBPF-based Sketches in Network Measurement · ICNP 2025
Accelerating Sketch-based End-Host Traffic Measurement with Automatic DPU Offloading · INFOCOM 2024
Indexing and storage engines
learned index
1.422024
Hyper: A High-Performance and Memory-Efficient Learned Index via Hybrid Construction · Proc. ACM Manag. Data 2024
LMSFC: A Novel Multidimensional Index based on Learned Monotonic Space Filling Curves · Proc. VLDB Endow. 2023
Storage systems › flash and SSD
solid-state drive
1.322026
HyTorC: Hybrid Address Translation for SSDs Supporting Compression · ACM Trans. Storage 2026
A Tale of Two Paths: Optimizing Paravirtualized Storage I/O with eBPF · ACM Trans. Storage 2026
Software-defined and programmable networks
programmable data plane
1.322026
Epiphron: Resource-Efficient Distributed Key-Value Storage · IEEE Trans. Knowl. Data Eng. 2026
Carrera: Enabling High-Performance eBPF-based Sketches in Network Measurement · ICNP 2025
Knowledge graphs
knowledge graph construction
1.012026
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora · ACL (1) 2026
Knowledge graphs › relation extraction
knowledge triple extraction
1.012026
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora · ACL (1) 2026
Information retrieval › similarity search
nearest neighbor search
1.012026
KBest: Efficient Vector Search on Kunpeng CPU · KDD (1) 2026
Software-defined and programmable networks › programmable data plane
programmable switch
1.012026
Network Functions With Dynamic State Management on Programmable Switches · IEEE Trans. Netw. 2026
Software-defined and programmable networks › programmable data plane
SmartNIC offload
1.012026
Epiphron: Resource-Efficient Distributed Key-Value Storage · IEEE Trans. Knowl. Data Eng. 2026
Memory systems › memory management › virtual memory
address translation
1.012026
HyTorC: Hybrid Address Translation for SSDs Supporting Compression · ACM Trans. Storage 2026
Distributed systems › replication › replicated data types
conflict-free replicated data types
1.012026
CrossFS: Improving Cross-Domain File System Performance with CRDT-Based Metadata Synchronization · ACM Trans. Storage 2026
Distributed systems
distributed coordination
1.012026
CrossFS: Improving Cross-Domain File System Performance with CRDT-Based Metadata Synchronization · ACM Trans. Storage 2026
Storage systems › file systems
distributed file system
1.012026
CrossFS: Improving Cross-Domain File System Performance with CRDT-Based Metadata Synchronization · ACM Trans. Storage 2026
Storage systems › key-value storage
distributed in-memory key-value store
1.012026
Epiphron: Resource-Efficient Distributed Key-Value Storage · IEEE Trans. Knowl. Data Eng. 2026
Storage systems › storage reliability
erasure coding
1.012026
Epiphron: Resource-Efficient Distributed Key-Value Storage · IEEE Trans. Knowl. Data Eng. 2026
Storage systems › metadata management
file system metadata management
1.012026
CrossFS: Improving Cross-Domain File System Performance with CRDT-Based Metadata Synchronization · ACM Trans. Storage 2026
Storage systems › flash and SSD › flash memory management
flash translation layer
1.012026
HyTorC: Hybrid Address Translation for SSDs Supporting Compression · ACM Trans. Storage 2026
Cloud and datacenter computing › virtualization
i/o virtualization
1.012026
RosenBridge: A Framework for Enabling Express I/O Paths Across the Virtualization Boundary · FAST 2026
High-performance computing
performance optimization
1.012026
KBest: Efficient Vector Search on Kunpeng CPU · KDD (1) 2026
Storage systems
storage reliability
1.012026
Epiphron: Resource-Efficient Distributed Key-Value Storage · IEEE Trans. Knowl. Data Eng. 2026
Information retrieval › similarity search › nearest neighbor search
approximate nearest neighbor search
0.912025
UpANNS: Enhancing Billion-Scale ANNS Efficiency with Real-World PIM Architecture · SC 2025
Query processing and optimization › secure query processing
encrypted query processing
0.912025
Opera: Achieving Secure and High-Performance OLAP with Parallelized Homomorphic Comparisons · SP 2025
Query processing and optimization › OLAP
OLAP query processing
0.912025
Opera: Achieving Secure and High-Performance OLAP with Parallelized Homomorphic Comparisons · SP 2025
Information retrieval
retrieval models
0.912025
UpANNS: Enhancing Billion-Scale ANNS Efficiency with Real-World PIM Architecture · SC 2025
Network measurement and analytics › traffic measurement
high-speed traffic measurement
0.912025
Carrera: Enabling High-Performance eBPF-based Sketches in Network Measurement · ICNP 2025
Cryptographic primitives and cryptanalysis › homomorphic encryption
fully homomorphic encryption
0.912025
Opera: Achieving Secure and High-Performance OLAP with Parallelized Homomorphic Comparisons · SP 2025
Cryptographic primitives and cryptanalysis
homomorphic encryption
0.912025
Opera: Achieving Secure and High-Performance OLAP with Parallelized Homomorphic Comparisons · SP 2025
Storage systems
approximate nearest neighbor search
0.912025
UpANNS: Enhancing Billion-Scale ANNS Efficiency with Real-World PIM Architecture · SC 2025

Methods — techniques the papers use, named apart from their topics

large language model · 2.0erasure coding · 2.0eBPF · 2.0conceptualization · 2.0address mapping · 2.0RDMA · 2.0homomorphic comparison · 1.7density-driven cache management · 1.7caching · 1.7state pre-computation · 1.0runtime binding · 1.0run-length encoding · 1.0replication · 1.0hybrid tree indexing · 1.0hardware-software co-design · 1.0bitmap compression · 1.0background scrubbing · 1.0adaptive caching · 1.0
YearPublicationVenuePosition
2026 AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora
abstract
We present AutoSchemaKG, a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas. Our system leverages large language models to simultaneously extract knowledge triples and induce comprehensive schemas directly from text, modeling both entities and events while employing conceptualization to organize instances into semantic categories. Processing over 50 million documents, we construct ATLAS (Automated Triple Linking And Schema induction), a family of knowledge graphs with 900+ million nodes and 5.9 billion edges. This approach outperforms state-of-the-art baselines on multi-hop QA tasks and enhances LLM factuality. Notably, our schema induction achieves 92\% semantic alignment with human-crafted schemas with zero manual intervention, demonstrating that billion-scale knowledge graphs with dynamically induced schemas can effectively complement parametric knowledge in large language models.
Jiaxin Bai, Wei Fan 0001, Qing Zong, Hong Ting Tsang, Hongyu Luo, Yauwai Yim, Tianshi Zheng, Xi Peng 0006, Xin Yao 0008, Huiwen Yang, Leijie Wu, J. I Yi, Gong Zhang 0001, Renhai Chen, Yangqiu Song
ACL (1)14
2026 RosenBridge: A Framework for Enabling Express I/O Paths Across the Virtualization Boundary
Jianqin Yan, Ruofan Xiong, Leping Yang, Xin Yao 0008, Renhai Chen, Gong Zhang 0001, Dongsheng Li 0001, Jiwu Shu
FAST6
2026 KScaNN: Scalable Approximate Nearest Neighbor Search on Kunpeng
abstract
Approximate Nearest Neighbor Search (ANNS) is a cornerstone algorithm for information retrieval, recommendation systems, and machine learning applications. While x86-based architectures have historically dominated this domain, the increasing adoption of ARM-based servers in industry presents a critical need for ANNS solutions optimized on ARM architectures. A naive port of existing x86 ANNS algorithms to ARM platforms results in a substantial performance deficit, failing to leverage the unique capabilities of the underlying hardware. To address this challenge, we introduce KScaNN, a novel ANNS algorithm co-designed for the Kunpeng 920 ARM architecture. KScaNN embodies a holistic approach that synergizes sophisticated, data aware algorithmic refinements with carefully-designed hardware specific optimizations. Its core contributions include: 1) novel algorithmic techniques, including a hybrid intra-cluster search strategy and an improved PQ residual calculation method, which optimize the search process at a higher level; 2) an ML-driven adaptive search module that provides adaptive, per-query tuning of search parameters, eliminating the inefficiencies of static configurations; and 3) highly-optimized SIMD kernels for ARM that maximize hardware utilization for the critical distance computation workloads. The experimental results demonstrate that KScaNN not only closes the performance gap but establishes a new standard, achieving up to a 1.63x speedup over the fastest x86-based solution. This work provides a definitive blueprint for achieving leadership-class performance for vector search on modern ARM architectures and underscores
Oleg Senkevich, Siyang Xu, Tianyi Jiang, Alexander Radionov, Jan Tabaszewski, Dmitriy Malyshev, Daihao Xue, Licheng Yu, Weidi Zeng, Xin Yao 0008, Siyu Huang, Gleb Neshchetkin, Qiuling Pan, Yaoyao Fu
ICDE12
2026 KBest: Efficient Vector Search on Kunpeng CPU
Kaihao Ma, Oleg Senkevich, Daihao Xue, Dmitriy Malyshev, Yangming Lv, Shihai Xiao, Xiao Yan 0002, Alexander Radionov, Weidi Zeng, Yuanzhan Gao, Zhiyu Zou, Xin Yao 0008, Yaoyao Fu, Gongyi Wang, Gong Zhang 0001, Fei Yi, Yingfan Liu
KDD (1)14
2026 Epiphron: Resource-Efficient Distributed Key-Value Storage
abstract
In-memory key-value storage necessitates a substantial quantity of computation and storage resources for both performance and scalability, thereby diminishing the resources available for user applications. The emergence of programmable network hardware, including SmartNICs and programmable switches, provides the opportunity to offload operations from server CPUs. We present Epiphron, a novel distributed in-memory key-value store architecture that co-designs with off-path SmartNICs and programmable switches. Facing the limited performance of off-path SmartNICs, Epiphron successfully achieves high resource efficiency while keeping load balancing and fault tolerance by$(i)$hybridizing erasure coding with replication in storage management,$(ii)$accelerating read operations with a new data plane design (conflict detection and RDMA-compatible forwarding) on programmable switches,$(iii)$employing a network protocol extended from one-sided RDMA. We evaluate Epiphron on Barefoot Tofino switches, NVIDIA BlueField-2 SmartNICs, and commodity servers. The experimental results demonstrate that compared to existing solutions, Epiphron improves throughput by up to 2.2× and consumes 47% less memory while completely bypassing server CPUs.
Ruidong Zhu, Bingyang Wu, Xin Yao 0008, Renhai Chen, Gong Zhang 0001, Xuanzhe Liu, Xin Jin 0008
IEEE Trans. Knowl. Data Eng.4
2026 Network Functions With Dynamic State Management on Programmable Switches
abstract
Recent popular programmable switches provide programmability in packet processing at the line rate, promising to host various Network Functions (NFs). However, the limitations on the switch programmability make it unable to manage runtime dynamic NF states. In the status quo, on-switch NFs rely on the network controller for dynamic state management, suffering from high first-packet latency. This paper proposes DNF, a hardware-software co-design system for dynamic state management of network functions on programmable switches. DNF designs a dynamic State Table on the switch, which providesopportunisticservice to NF flows and sets upfallbackNFs on the server to handle flows that fail on the switch. DNF proposes a state pre-computation andruntime-bindingmethod for per-flow state initialization, which avoids a flow’s runtime interaction with the controller and the consequent latency. DNF devises astate replacementmethod, which periodically swaps hot flows into the switch. It could maximize the switch resource utilization and the throughput. We prototype DNF on P4 switches, implement six representative NFs, and compare DNF with state-of-the-art solutions. Our experiments show DNF reduces the first-packet latency by up to 98% compared with the controller-assisted architecture and improves the system throughput by up to 4.87 times compared with the software solution.
Yitao Yuan, Wenfei Wu, Xin Yao 0008, Renhai Chen, Gong Zhang 0001
IEEE Trans. Netw.3
2026 CrossFS: Improving Cross-Domain File System Performance with CRDT-Based Metadata Synchronization
abstract
Modern data-intensive applications increasingly demand efficient and scalable file systems that can operate across distributed and cross-domain environments. However, existing file systems are inefficient in metadata management, synchronization efficiency, and system scalability under high-concurrency and metadata-intensive workloads in cross-domain environments. To address these challenges, this article introduces CrossFS (CFS), a cross-domain distributed file system that enhances consistency guarantees and metadata indexing. Specifically, CFS leverages conflict-free replicated data types (CRDTs) to synchronize metadata, achieving strong eventual consistency with minimal synchronization overhead, even across network partitions. Furthermore, CFS employs a Hybrid Tree indexing structure, tailored for distributed environments, which optimizes metadata operations by reducing query latency by up to 33.4% and write amplification by 30.7%. Additionally, CFS achieves adaptive caching strategies and a hybrid synchronization model that effectively balances consistency latency with data availability. Extensive evaluations show that CFS outperforms CephFS and GlusterFS, achieving up to 33.9% higher metadata throughput, 36% lower latency, and 42% better data operation efficiency.
Qiwen Ke, Yina Lv, Zhirong Shen, Yue Yu 0001, Zhenlong Song, Xinbiao Gan, Dongsheng Li 0001, Xin Yao 0008, Yiming Zhang 0003
ACM Trans. Storage11
2026 A Tale of Two Paths: Optimizing Paravirtualized Storage I/O with eBPF
abstract
KVM is the dominant VM hypervisor on Linux, and relies on QEMU to realize the backends of the virtio family of devices such as virtio-blk. However, KVM/QEMU-based paravirtualization prolongs the guest I/O path with multiple context switches. As fast NVMe storage devices have been widely used, the software overhead becomes non-negligible. To shorten the I/O path, virtio-blk’s variations, vhost-kernel-blk and vhost-user-blk, respectively perform all guest I/O processing in kernel and user spaces. Unfortunately, they essentially forsake the collaboration between KVM and QEMU, sacrifice important QEMU features including live migration, snapshots, and flexible image format support. This article presents EXO, an extension of virtio-blk for efficient KVM/QEMU-based storage paravirtualization. The insight is that no matter how complex the QEMU backend’s processing is, to handle a guest I/O request, the host storage stack only needs to know the request’s guest-to-host address mapping. Therefore, we preserve the original slow I/O path of virtio-blk as a fallback, and leverage eBPF to introduce an in-kernel fast path that directly queries the address mapping without switching to the user-space backend processing. Extensive evaluation shows that EXO achieves similar or even higher performance compared to the variations (vhost-kernel-blk/vhost-user-blk) of virtio-blk, while preserving virtio-blk’s flexibility, safety, and compatibility.
Li Wang 0123, Shi Qiu 0012, Jianqin Yan, Zhirong Shen, Xin Yao 0008, Renhai Chen, Yiming Zhang 0003
ACM Trans. Storage6
2026 HyTorC: Hybrid Address Translation for SSDs Supporting Compression
abstract
High-capacity solid-state drives (SSDs) with expected capacities of one PByte and more will address cloud storage and archiving environments previously dominated by magnetic disks. These new applications are very cost-sensitive, so unnecessary overhead must be reduced as much as possible without sacrificing the performance advantages of SSDs. An expensive component within a scale-up SSD is the on-device memory to map host logical page numbers to flash pages. This article, therefore, proposes HyTorC, which builds on the idea of S-FTL to represent sequentially stored logical pages using bitmaps instead of providing one entry per logical page. HyTorC extends this idea by introducing, for the first time in an FTL, compression of these bitmaps using run-length encoding, and by investigating the effects of background scrubbing to realign randomly written pages into contiguous runs. This background scrubbing allows HyTorC to keep large portions of the mapping table in block mapping mode, further reducing the memory footprint. HyTorC retains the flexibility of the page mapping scheme and supports compression of logical blocks within the SSD, allowing multiple compressed logical pages to be stored within a single physical page. HyTorC is fully implemented in an open-channel SSD. Our tests show that HyTorC can reduce memory consumption by an average of 98.9% over standard page mapping, 95.6% over the DFTL scheme, 87.3% over S-FTL, and 56.5% over the learned index-based approach LeaFTL for the Alibaba Cloud block traces, and by 98.6% over standard page mapping, 95.5% over the DFTL scheme, 84.1% over S-FTL, and 61.5% over LeaFTL for the Microsoft Research Cambridge traces. HyTorC focuses on the memory footprint of the FTL and not on performance. However, the performance evaluation shows that HyTorC achieves similar performance compared to page mapping and FTLs based on learned indexes.
Yu Zhang 0294, Renhai Chen, Gong Zhang 0001, Peng Wang 0037, Xin Yao 0008, Keji Huang, André Brinkmann
ACM Trans. Storage5
2025 A Practical Learning-Based FTL for Memory Constrained Mobile Flash Storage
abstract
The rapidly growing mobile market is pushing flash storage manufacturers to expand capacity into the terabyte range. However, this presents a significant challenge for mobile storage management: more logical-to-physical page mappings are desired to be efficiently managed and cached while the available caching space is extremely limited. This motivates us to shift toward a new learning-based paradigm: rather than maintaining mappings for individual pages, the learning-based approach can represent mapping relationships for a set of continuous pages. However, to construct linear models, existing methods that either consume the already-limited memory space or reuse flash garbage collection demonstrate poor model construction capabilities or significantly degrade flash performance, making them impractical for real-world use. In this paper, we propose LFTL, a practical, learning-based on-demand flash translation layer design for flash management in mobile devices. In contrast to prior work that centered around gathering sufficient mappings for linear model construction, our key insight is that linear patterns can be extracted and refined by leveraging the orderly, LPA-aligned write stream typical of mobile devices. By doing this, highly accurate linear models can be constructed regardless of the constraints of mobile device's cache limitation. We have implemented a fully functional prototype of LFTL based on FEMU. Our evaluation results show that LFTL is more adaptable to memory-constrained storage devices than state-of-the-art learning-based approaches.
Zelin Du, Kecheng Huang, Tianyu Wang 0009, Xin Yao 0008, Renhai Chen, Zili Shao
DATE4
2025 Cheetah: Metadata Aggregation for Fast Object Storage without Distributed Ordering
abstract
Object stores usually maintain the mapping of objects to data servers' disk volumes (referred to as volume metadata) in a central directory, while storing the object data's in-volume offsets (referred to as offset metadata) together with the data on data servers. Unfortunately, the separation between volume/offset metadata complicates the processing of an object put: to ensure consistency, the multiple writes of the object's volume/offset metadata and object data have to be orchestrated in a particular order, which severely lowers object I/O performance. We propose a write-optimal structure called MetaX that aggregates all metadata of a put, including both volume and offset metadata as well as other meta information such as data checksum and temporary meta-log. Based on MetaX, we design the Cheetah object store, which organizes object storage into rich metadata storage (on meta servers) and raw data storage (on data servers). Cheetah removes the distributed ordering constraint on the multiple metadata/data writes by enforcing local atomicity of writing MetaX, while still ensuring consistency. Evaluation shows that Cheetah significantly outperforms existing object stores.
Yiming Zhang 0003, Li Wang 0123, Shengyun Liu, Shun Gai, Xin Yao 0008, Kai Chen 0005, Dongsheng Li 0001, Jiwu Shu
EuroSys6
2025 GeminiFS: A Companion File System for GPUs
Shi Qiu 0012, Jianqin Yan, Zhirong Shen, Xin Yao 0008, Renhai Chen, Gong Zhang 0001, Yiming Zhang 0003
FAST6
2025 HiDPU: A DPU-Oriented Hybrid Indexing Scheme for Disaggregated Storage Systems
Zhaoyan Shen, Renhai Chen, Xin Yao 0008, Dongxiao Yu, Zili Shao
FAST5
2025 A Dynamic Virtual Memory Management System for LLMs on AI Chips
Gaolin Wei, Chen Zhang 0013, Xin Yao 0008, Benben Liu
ICCD5
2025 Carrera: Enabling High-Performance eBPF-based Sketches in Network Measurement
abstract
To achieve dynamic network measurement, trends build sketches on eBPF to avoid service interruptions. However, existing eBPF-based sketches suffer from high CPU consumption, leading to poor throughput and high latency and making them hard to measure high-speed traffic. Optimizing their performance requires users to refactor codes based on each sketch’s characteristics on eBPF, which is highly complex and time-consuming.In this paper, we argue that users should write sketches without concerning low-level eBPF performance optimizations, with the deployment automatically activating cross-sketch performance optimizations. We present Carrera, a library that offers domain-specific optimizations for eBPF-based sketches. Our contributions are (1) systematically analyzing the performance bottlenecks of eBPF-based sketches through microbenchmarks, (2) identifying practical optimizations, including hardware offloading, SIMD-accelerated hashing, traffic-aware flow index caching, prefetched randomization, and active data collection, to address the identified bottlenecks in eBPF-based sketches, (3) evaluating these optimizations with state-of-the-art sketches and demonstrating that Carrera improves throughput by up to 65% and reduces latency by up to 93% via testbed experiments.
Xiang Chen 0017, Xin Yao 0008, Longlong Zhu, Linying Zheng, Hongyan Liu 0001, Jianshan Zhang, Dong Zhang 0010, Xuan Liu 0006, Qun Huang 0001, Haifeng Zhou, Chunming Wu 0001
ICNP2
2025 UpANNS: Enhancing Billion-Scale ANNS Efficiency with Real-World PIM Architecture
abstract
Approximate Nearest Neighbor Search (ANNS) is a critical component of modern AI systems, such as recommendation engines and retrieval-augmented large language models (RAG-LLMs). However, scaling ANNS to billion-entry datasets exposes critical inefficiencies: CPU-based solutions are bottlenecked by memory bandwidth limitations, while GPU implementations underutilize hardware resources, leading to suboptimal performance and energy consumption. To address these challenges, we introduce UpANNS, a novel framework leveraging Processing-in-Memory (PIM) architecture to accelerate billion-scale ANNS. UpANNS integrates four key innovations, including 1) architecture-aware data placement to minimize latency through workload balancing, 2) dynamic resource management for optimal PIM utilization, 3) co-occurrence optimized encoding to reduce redundant computations, and 4) an early-pruning strategy for efficient top-k selection. Evaluation on commercial UPMEM hardware demonstrates that UpANNS achieves 4.3x higher QPS than CPU-based Faiss, while matching GPU performance with 2.3x greater energy efficiency. Its near-linear scalability ensures practicality for growing datasets, making it ideal for applications like real-time LLM serving and large-scale retrieval systems.
Sitian Chen, Amelie Chi Zhou, Yusen Li, Xin Yao 0008
SC5
2025 Phoenix: A Refactored I/O Stack for GPU Direct Storage without Phony Buffers
abstract
GPU Direct Storage (GDS) plays a vital role in GPU-based training and inference systems, leveraging Peer-to-Peer Direct Memory Access (P2P-DMA) to establish a direct data transfer path between the GPU and the storage device. The direct I/O path reduces GPU storage access latency and CPU overhead, thus improving the efficiency of data transfer. Currently, however, GDS employs a phony buffer in the host memory to interact with the Linux kernel, which results in suboptimal I/O performance, extra resource consumption, and high deployment complexity.
Jianqin Yan, Shi Qiu 0012, Yina Lv, Hao Chen 0080, Zhirong Shen, Xin Yao 0008, Renhai Chen, Jiwu Shu, Gong Zhang 0001, Yiming Zhang 0003
SC7
2025 Opera: Achieving Secure and High-Performance OLAP with Parallelized Homomorphic Comparisons
abstract
Fully Homomorphic Encryption (FHE) is increasingly adopted in Online Analytical Processing (OLAP) systems to protect against data breaches. However, existing FHE-based OLAP systems must sequentially execute computationally intensive homomorphic comparisons for query processing on FHE ciphertexts, leading to significantly lower performance compared to traditional OLAP systems. We present Opera, the first high-performance FHE-based OLAP system on the GPU. Observing the redundancy in re-executing homomorphic comparisons from scratch, we design Homcache to create a GPU-accelerated parallel query execution workflow: Opera selectively caches comparison results and allows subsequent comparisons to reuse them, thereby reducing the computational cost per comparison and facilitating concurrent execution of multiple comparisons on the GPU. Nevertheless, due to the large size of FHE ciphertexts, Homcache can grow substantially, and naively applying traditional plaintext-oriented cache management strategies like LRU results in suboptimal performance. To ensure stable high performance, we develop a density-driven algorithm tailored for managing ciphertexts in Homcache. Compared to notable baselines running on CPUs, Opera reduces query latency by up to 9612x with 1.2GB cache storage without compromising security. OPERA's source code, complete benchmark suite, and raw results are available at github.com/hku-systems/Opera.
Wei Chen 0161, Tianxiang Shen, Xin Yao 0008, Nicholas Zhang, Heming Cui, Siu-Ming Yiu
SP4
2025 HLN-Tree: A memory-efficient B+-Tree with huge leaf nodes and locality predictors
abstract
Key-value stores in Cloud environments can contain more than 2 45 unique elements and be larger than 100 PByte. B + -Trees are well suited for these larger-than-memory datasets and seamlessly index data stored on thousands of secondary storage devices. Unfortunately, it is often uneconomical to even store all inner tree nodes in memory for these dataset sizes. Therefore, lookup performance is affected by the additional IOs for reading inner nodes. This number of inner nodes can be reduced by increasing the size of leaf nodes. We propose HLN-Trees, which support huge leaf nodes without increasing the IO sizes for individual index operations. They partition leaf nodes in arrays of independent subnodes and combine ideas from BD-trees with rebalancing, learning key deviations, and storing locality predictors. HLN-Trees have been initially designed for uniform random key distributions and support arbitrary key distributions through an additional layer of hashing in leaf nodes. HLN-Trees decrease the number of inner nodes by up to 256× for uniform random key distributions and by 16× to 64× for arbitrary ones compared to B + -Trees, while keeping their performance at the same level even at high concurrency levels. We show analytically and through real-world and synthetic benchmarks that HLN-Trees also outperform state-of-the-art learned indexes for secondary storage.
André Brinkmann, Reza Salkhordeh, Florian Wiegert, Peng Wang 0037, Xin Yao 0008, Renhai Chen, Keji Huang, Gong Zhang 0001
ACM Trans. Storage5
2024 RB2: Narrow the Gap between RDMA Abstraction and Performance via a Middle Layer
abstract
Although the native RDMA interface allows for high throughput and low latency, its low-level abstraction raises significant programming challenges. Consequently, numerous systems encapsulate the RDMA interface into more user-friendly high-level abstractions such as Socket, MPI, and RPC. However, this ease of development often incurs considerable performance degradation. To address this trade-off, this paper introduces RB2, a high-performance RDMA-based Distributed Ring Buffer (DRB). RB2serves as a middle layer that effectively conceals the low-level details of the RDMA interface while also facilitating extension to other high-level abstractions.Nonetheless, it is non-trivial for DRBs to preserve the RDMA performance. We optimize the performance of RB2in three aspects. First, we perform micro-benchmarks to identify the pointer synchronization methods that are seemingly counter-intuitive but offer optimal performance improvements. Second, we propose an adaptive batching mechanism to alleviate the limitations of conventional fixed batching. Finally, we build an efficient memory subsystem using various optimization techniques. RB2outperforms SOTA designs by achieving 2.5 × to 7.5 × throughput while maintaining comparable tail latency for small messages.
Haifeng Sun 0004, Yixuan Tan, Yongtong Wu, Qun Huang 0001, Xin Yao 0008, Gong Zhang 0001
INFOCOM6
2024 Accelerating Sketch-based End-Host Traffic Measurement with Automatic DPU Offloading
abstract
Sketch-based traffic measurement is a crucial building block for monitoring traffic statistics and ensuring the quality of services of end-host applications. However, existing approaches for building sketches in end-hosts exhibit poor packet processing performance or high CPU consumption. In this paper, we propose MPU, which automatically offloads sketch-based measurement to the emerging hardware, DPU. MPU consists of a sketch analyzer that profiles sketch resource consumption and an optimization framework that formulates the offloading problem and maximizes sketch performance on DPU. We implement MPU on the NVIDIA BlueField DPU. Our testbed results indicate that MPU achieves 85% lower per-packet processing latency and 47% higher traffic measurement accuracy when compared to existing approaches.
Xiang Chen 0017, Wenbin Zhang 0011, Xin Yao 0008, Zizheng Wang, Hongyan Liu 0001, Qun Huang 0001, Xuan Liu 0006, Haifeng Zhou, Chunming Wu 0001
INFOCOM4
2024 Fat-B+Tree: Fast B+tree Indexing with In-Network Memory
abstract
In-memory database in the data center plays an indispensable role in many fields. B+tree is the most recognized index in in-memory database, but its indexing latency has become the bottleneck that prevents the database from achieving higher performance. The existing work reduces latency by caching B+tree nodes using slow DRAM on computing clients, or directly caching data using fast SRAM on programmable switch. However, no existing work can meet all three key requirements: (1) Efficiency: providing enough fast memory to accelerate indexing. (2) Compatibility: compatible with multiple architectures and query types. (3) Adaptability: adapting to various workloads and database scales. Inspired by structrual similarity between the network topology of modern data centers and the B+tree structure, we propose Fat-B+Tree, which embeds the B+tree into the in-network fast memory provided by the hierarchical connected programmable switches, thus meeting all design requirements. We have fully implemented the Fat-B+Tree prototype, and the experimental results show that compared with the baseline system, it reduces query latency by up to 76% and improves throughput by up to 3.93 times. The source codes of Fat-B+Tree are open-sourced at GitHub.
Yikai Zhao 0001, Yuanpeng Li 0002, Zicang Xu, Tong Yang 0003, Kaicheng Yang 0001, Li Chen 0008, Xin Yao 0008, Gong Zhang 0001
IPCCC7
2024 AutoSketch: Automatic Sketch-Oriented Compiler for Query-driven Network Telemetry
Haifeng Sun 0004, Qun Huang 0001, Jinbo Sun, Wei Wang 0011, Fuliang Li, Yungang Bao, Xin Yao 0008, Gong Zhang 0001
NSDI8
2024 Hyper: A High-Performance and Memory-Efficient Learned Index via Hybrid Construction
abstract
Learned indexes use machine learning techniques to improve index construction. However, they often face a fundamental trade-off between performance and memory consumption, especially in dynamic environments with frequent insert and delete operations. This trade-off stems from the construction approaches used in learned indexes: The top-down approach increases performance at the cost of significant memory overhead, while the bottom-up approach focuses on memory efficiency but introduces performance issues due to prediction errors. % A unified solution that simultaneously optimizes performance and memory consumption in dynamic data management scenarios is therefore highly desirable. We propose Hyper, a highly efficient learned index with a novel two-phase hybrid construction approach. Our approach combines bottom-up construction for leaf nodes with top-down construction for inner nodes to achieve an optimal balance between performance and memory consumption. Hyper effectively handles concurrent writes and structure adjustments without sacrificing query performance. We evaluated Hyper on both simple and complex real-world datasets and compared it to seven state-of-the-art learned indexes and several traditional data structures for dynamic workloads. The evaluation results show that Hyper achieves a remarkable performance boost of up to 3.75× with significantly reduced index memory consumption of up to 1610× in the single-thread evaluation. In high concurrency scenarios, Hyper even achieves improvements up to 5.73×, 3.72×, and 3.99× in read-only, read-write, and write-only workloads.
Shunkang Zhang, Ji Qi 0002, Xin Yao 0008, André Brinkmann
Proc. ACM Manag. Data3
2023 LMSFC: A Novel Multidimensional Index based on Learned Monotonic Space Filling Curves
abstract
The recently proposed learned indexes have attracted much attention as they can adapt to the actual data and query distributions to attain better search efficiency. Based on this technique, several existing works build up indexes for multi-dimensional data and achieve improved query performance. A common paradigm of these works is to (i) map multi-dimensional data points to a one-dimensional space using a fixed space-filling curve (SFC) or its variant and (ii) then apply the learned indexing techniques. We notice that the first step typically uses a fixed SFC method, such as row-major order and z -order. It definitely limits the potential of learned multi-dimensional indexes to adapt variable data distributions via different query workloads. In this paper, we propose a novel idea of learning a space-filling curve that is carefully designed and actively optimized for efficient query processing. We also identify innovative offline and online optimization opportunities common to SFC-based learned indexes and offer optimal and/or heuristic solutions. Experimental results demonstrate that our proposed method, LMSFC, outperforms state-of-the-art non-learned or learned methods across three commonly used real-world datasets and diverse experimental settings.
Xin Cao 0001, Xin Yao 0008, Gong Zhang 0001, Wei Wang 0011
Proc. VLDB Endow.3
2021 FedSCR: Structure-Based Communication Reduction for Federated Learning
abstract
Federated Learning allows edge devices to collaboratively train a shared model on their local data without leaking user privacy. The non-independent-and-identically-distributed (Non-IID) property of data distribution, which leads to severe accuracy degradation, and enormous communication overhead for aggregating parameters should be tackled in federated learning. In this article, we conduct a detailed analysis of parameter updates on the Non-IID datasets and compare the difference with the IID setting. Experimental results exhibit that parameter update matrices are structure-sparse and show that more gradients could be identified as negligible updates on the Non-IID data. As a result, we propose a structure-based communication reduction algorithm, called FedSCR, that reduces the number of parameters transported through the network while maintaining the model accuracy. FedSCR aggregates the parameter updates over channels and filters, identifies and removes the redundant updates by comparing the aggregated values with a threshold. Unlike the traditional structured pruning methods, FedSCR retains the complete model that does not require to be retrained and fine-tuned. The local loss and weight divergence on each device vary a lot because of the unbalanced data distribution. We further propose an adaptive FedSCR, that dynamically changes the bounded threshold, to enhance the model robustness on the Non-IID data. Evaluation results show that our proposed strategies achieve almost 50 percent upstream communication reduction without loss of accuracy. FedSCR can be integrated into state-of-the-art federated learning algorithms to dramatically reduce the number of parameters pushed to the global server with a tolerable accuracy reduction.
Xueyu Wu 0001, Xin Yao 0008, Cho-Li Wang
IEEE Trans. Parallel Distributed Syst.2
2020 Probabilistic Consistency Guarantee in Partial Quorum-Based Data Store
abstract
Many NoSQL databases support quorum-based protocols, which require a subset of replicas (called a quorum) to respond to each write/read operation. These systems configure the quorum size to tune the operation latency and adopt multiple consistency levels. Some recent works illustrate that using probability models to quantify the chance of reading the last update is important because it could avoid returning stale values under eventual consistency. There are two challenging issues: (1) from inconsistent replicas, how to determine the minimum quorum size (i.e., the lowest access latency) to read the newest data at a specified probability; (2) node failure frequently happens in large-scale systems, how to guarantee the probability-based consistent reads. This article presents Probabilistic Consistency Guarantee (PCG), which is the first dynamic quorum decision and failure-aware quantification model. PCG model respectively quantifies the server-side consistency after the latest write, which reflects the object's time-varying update progress, and the possibility of reading this update when responding to the end-users. Our theoretical analysis derives several formulas to determine the quorum size of a read quorum and the consensus result selected from this quorum is the data updated by the last write at the user-specified probability. When some replicas are unavailable, our model knows how to rescale the quorum and read values from surviving replicas could reduce the stale reads caused by node failures. The experimental results in Cassandra demonstrate that the PCG model can achieve up to 77.7 percent more accurate predictions and reduce up to 48.9 percent read latency than those of the previous model.
Xin Yao 0008, Cho-Li Wang
IEEE Trans. Parallel Distributed Syst.1
2019 EC-Shuffle: Dynamic Erasure Coding Optimization for Efficient and Reliable Shuffle in Spark
abstract
Fault-tolerance capabilities attract increasing attention from existing data processing frameworks, such as Apache Spark. To avoid replaying costly distributed computation, like shuffle, local checkpoint and remote replication are two popular approaches. They incur significant runtime overhead, such as extra storage cost or network traffic. Erasure coding is another emerging technology, which also enables data resilience. It is perceived as capable of replacing the checkpoint and replication mechanisms for its high storage efficiency. However, it suffers heavy network traffic due to distributing data partitions to different locations. In this paper, we propose EC-Shuffle with two encoding schemes and optimize the shuffle-based operations in Spark or MapReduce-like frameworks. Specifically, our encoding schemes concentrate on optimizing the data traffic during the execution of shuffle operations. They only transfer the parity chunks generated via erasure coding, instead of a whole copy of all data chunks. EC-Shuffle also provides a strategy, which can dynamically select the per-shuffle biased encoding scheme according to the number of senders and receivers in each shuffle. Our analyses indicate that this dynamic encoding selection can minimize the total size of parity chunks. The extensive experimental results using BigDataBench with hundreds of mappers and reducers shows this optimization can reduce up to 50% network traffic and achieve up to 38% performance improvement.
Xin Yao 0008, Cho-Li Wang, Mingzhe Zhang 0003
CCGRID1
2019 FluentPS: A Parameter Server Design with Low-frequency Synchronization for Distributed Deep Learning
abstract
With pursuing high accuracy on big datasets, current research prefers designing complex neural networks, which need to maximize data parallelism for short training time. Many distributed deep learning systems, such as MXNet and Petuum, widely use parameter server framework with relaxed synchronization models. Although these models could cost less on each synchronization, its frequency is still high among many workers, e.g., the soft barrier introduced by Stale Synchronous Parallel (SSP) model. In this paper, we introduce our parameter server design, namely FluentPS, which can reduce frequent synchronization and optimize communication overhead in a large-scale cluster. Different from using a single scheduler to manage all parameters' synchronization in some previous designs, our system allows each server to independently adjust schemes for synchronizing its parameter shard and overlaps the push and pull processes of different servers. We also explore two methods to improve the SSP model: (1) lazy execution of buffered pull requests to reduce the synchronization frequency and (2) a probability-based strategy to pause the fast worker at a probability under SSP condition, which avoids unnecessary waiting of fast workers. We evaluate ResNet-56 with the same large batch size at different cluster scales. While guaranteeing robust convergence, FluentPS gains up to 6× speedup and reduce 93.7% communication time costs than PS-Lite. The raw SSP model causes up to 131× delayed pull requests than our improved synchronization model, which can provide fine-tuned staleness controls and achieve higher accuracy.
Xin Yao 0008, Xueyu Wu 0001, Cho-Li Wang
CLUSTER1
2018 SIMPO: A Scalable In-Memory Persistent Object Framework Using NVRAM for Reliable Big Data Computing
abstract
While CPU architectures are incorporating many more cores to meet ever-bigger workloads, advance in fault-tolerance support is indispensable for sustaining system performance under reliability constraints. Emerging non-volatile memory technologies are yielding fast, dense, and energy-efficient NVRAM that can dethrone SSD drives for persisting data. Research on using NVRAM to enable fast in-memory data persistence is ongoing. In this work, we design and implement a persistent object framework, dubbed scalable in-memory persistent object (SIMPO) , which exploits NVRAM, alongside DRAM, to support efficient object persistence in highly threaded big data applications. Based on operation logging, we propose a new programming model that classifies functions into instant and deferrable groups. SIMPO features a streamlined execution model, which allows lazy evaluation of deferrable functions and is well suited to big data computing workloads that would see improved data locality and concurrency. Our log recording and checkpointing scheme is effectively optimized towards NVRAM, mitigating its long write latency through write-combining and consolidated flushing techniques. Efficient persistent object management with features including safe references and memory leak prevention is also implemented and tailored to NVRAM. We evaluate a wide range of SIMPO-enabled applications with machine learning, high-performance computing, and database workloads on an emulated hybrid memory architecture and a real hybrid memory machine with NVDIMM. Compared with native applications without persistence, experimental results show that SIMPO incurs less than 5% runtime overhead on both platforms and even gains up to 2.5× speedup and 84% increase in throughput in highly threaded situations on the two platforms, respectively, thanks to the streamlined execution model.
Mingzhe Zhang 0003, King Tin Lam, Xin Yao 0008, Cho-Li Wang
ACM Trans. Archit. Code Optim.3