Demo Data from SIGIR 2026 / reviewers in the wild / expert
Zhaoyan Shen
dblp:150/0554
· DBLP profile ↗
101ranked-venue papers
12as first author
69since 2021 · last 2026
0000-0001-9526-6634ORCID · conflict
Domains — the database's venue-derived domains; a paper can count in several
Systems, architecture and hardware · 78 · 11 first-author · 52 since 2021Software engineering, systems software and programming languages · 10 · 6 since 2021Databases, data management, data science and information retrieval · 10 · 1 first-author · 9 since 2021Computer networks · 7 · 4 since 2021Artificial intelligence and machine learning · 3 · 3 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 2 since 2021Security and privacy · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Computer architecture, parallel and distributed computing, and storage systems
45 papers |
Storage systems · 70% Memory systems · 12% Hardware accelerators and domain-specific architectures · 5% | |
| Artificial intelligence
8 papers |
Efficient and distributed learning · 62% Graph learning · 16% Autonomous driving · 5% | |
| Network and information security
6 papers |
Cryptographic protocols and secure computation · 56% Cryptographic primitives and cryptanalysis · 18% Blockchain and cryptocurrency security · 17% | |
| Databases, data mining, and information retrieval
4 papers |
Indexing and storage engines · 39% Database system architecture and tuning · 33% Distributed and cloud data management · 23% |
Topics — the 30 heaviest of 110, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Storage systems
key-value storage |
7.1 | 10 | 2026 | Reducing I/O Amplification for Key-Value Stores With a Log-Assisted Log-Structured Merge Tree · IEEE Trans. Knowl. Data Eng. 2026 A ReRAM-Based Processing-in-Memory Framework for LSM-Based Key-Value Store · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2026 PIRacle: A Fast and Scalable Private Information Retrieval System for Key-Value Stores · IEEE Trans. Computers 2026 |
Storage systems › key-value storage
LSM-tree |
3.9 | 6 | 2026 | Reducing I/O Amplification for Key-Value Stores With a Log-Assisted Log-Structured Merge Tree · IEEE Trans. Knowl. Data Eng. 2026 A Semantic-Integrated LSM-Tree-Based Key-Value Storage Engine for Blockchain Systems · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2024 ChainKV: A Semantics-Aware Key-Value Store for Ethereum System · Proc. ACM Manag. Data 2023 |
Storage systems
storage reliability |
3.5 | 8 | 2026 | Reducing I/O Amplification for Key-Value Stores With a Log-Assisted Log-Structured Merge Tree · IEEE Trans. Knowl. Data Eng. 2026 Rebirth-FTL: Lifetime Optimization via Approximate Storage for NAND Flash Memory · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2022 Leveraging the Interplay of RAID and SSD for Lifetime Optimization of Flash-Based SSD RAID · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2021 |
Storage systems
flash and SSD |
3.2 | 8 | 2023 | Reinforcement Learning-Assisted Management for Convertible SSDs · DAC 2023 Prism-SSD: A Flexible Storage Interface for SSDs · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2022 Rebirth-FTL: Lifetime Optimization via Approximate Storage for NAND Flash Memory · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2022 |
Memory systems
processing-in-memory |
3.1 | 5 | 2026 | A ReRAM-Based Processing-in-Memory Framework for LSM-Based Key-Value Store · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2026 HMC-FHE: A Heterogeneous Near Data Processing Framework for Homomorphic Encryption · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2024 A Practical Highly Paralleled ReRAM-Based DNN Accelerator by Reusing Weight Pattern Repetitions · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2022 |
Storage systems
computational storage |
2.6 | 3 | 2026 | Conflux: A High-Performance Keyword Private Retrieval System for Dynamic Datasets · HPCA 2026 SmartPIR: A Private Information Retrieval System using Computational Storage Devices · MICRO 2025 NICE: A Nonintrusive In-Storage-Computing Framework for Embedded Applications · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2024 |
Storage systems › magnetic recording
shingled magnetic recording |
2.5 | 5 | 2023 | A Multiagent Reinforcement Learning-Assisted Cache Cleaning Scheme for DM-SMR · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2023 Tiler: An Autonomous Region-Based Scheme for SMR Storage · IEEE Trans. Computers 2021 Reinforcement Learning-Assisted Cache Cleaning to Mitigate Long-Tail Latency in DM-SMR · DAC 2021 |
Storage systems
file systems |
2.2 | 5 | 2024 | LightFS: A Lightweight Host-CSD Coordinated File System Optimizing for Heavy Small File Accesses · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2024 UniBuffer: Optimizing Journaling Overhead With Unified DRAM and NVM Hybrid Buffer Cache · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2020 An Efficient Directory Entry Lookup Cache With Prefix-Awareness for Mobile Devices · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2020 |
Storage systems › flash and SSD › flash memory management
flash translation layer |
1.9 | 5 | 2022 | Rebirth-FTL: Lifetime Optimization via Approximate Storage for NAND Flash Memory · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2022 Bridging Mismatched Granularity Between Embedded File Systems and Flash Memory · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2021 DCR: Deterministic Crash Recovery for NAND Flash Storage Systems · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2019 |
Cryptographic protocols and secure computation
private information retrieval |
1.9 | 2 | 2026 | Conflux: A High-Performance Keyword Private Retrieval System for Dynamic Datasets · HPCA 2026 SmartPIR: A Private Information Retrieval System using Computational Storage Devices · MICRO 2025 |
Storage systems
private information retrieval |
1.9 | 2 | 2026 | PIRacle: A Fast and Scalable Private Information Retrieval System for Key-Value Stores · IEEE Trans. Computers 2026 SmartPIR: A Private Information Retrieval System using Computational Storage Devices · MICRO 2025 |
Memory systems › processing-in-memory
ReRAM-based processing-in-memory |
1.8 | 3 | 2026 | A ReRAM-Based Processing-in-Memory Framework for LSM-Based Key-Value Store · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2026 PattPIM: A Practical ReRAM-Based DNN Accelerator by Reusing Weight Pattern Repetitions · DAC 2020 A Novel ReRAM-Based Processing-in-Memory Architecture for Graph Traversal · ACM Trans. Storage 2018 |
Machine learning › Graph learning
graph neural network training |
1.8 | 2 | 2026 | VeloxGNN: Efficient Out-of-Core GNN Training with Delayed Gradient Propagation · HPCA 2026 Celeritas: Out-of-Core Based Unsupervised Graph Neural Network via Cross-Layer Computing 2024 · HPCA 2024 |
Machine learning › Efficient and distributed learning › memory-efficient training
out-of-core training |
1.8 | 2 | 2026 | VeloxGNN: Efficient Out-of-Core GNN Training with Delayed Gradient Propagation · HPCA 2026 Celeritas: Out-of-Core Based Unsupervised Graph Neural Network via Cross-Layer Computing 2024 · HPCA 2024 |
Storage systems
i/o optimization |
1.8 | 2 | 2026 | VeloxGNN: Efficient Out-of-Core GNN Training with Delayed Gradient Propagation · HPCA 2026 Celeritas: Out-of-Core Based Unsupervised Graph Neural Network via Cross-Layer Computing 2024 · HPCA 2024 |
Storage systems › flash and SSD
write amplification reduction |
1.5 | 2 | 2026 | Reducing I/O Amplification for Key-Value Stores With a Log-Assisted Log-Structured Merge Tree · IEEE Trans. Knowl. Data Eng. 2026 Bridging Mismatched Granularity Between Embedded File Systems and Flash Memory · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2021 |
Reconfigurable computing and FPGAs › FPGA architecture
nonvolatile FPGA |
1.4 | 2 | 2025 | CoaCAD: Correlation-Assisted Computer-Aided Design for Nonvolatile FPGAs · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2025 Pearl: Performance-Aware Wear Leveling for Nonvolatile FPGAs · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2021 |
Storage systems › flash and SSD › flash memory management
wear leveling |
1.4 | 2 | 2025 | CoaCAD: Correlation-Assisted Computer-Aided Design for Nonvolatile FPGAs · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2025 Pearl: Performance-Aware Wear Leveling for Nonvolatile FPGAs · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2021 |
Memory systems
non-volatile memory |
1.2 | 4 | 2023 | Pearl: Performance-Aware Wear Leveling for Nonvolatile FPGAs · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2021 UniBuffer: Optimizing Journaling Overhead With Unified DRAM and NVM Hybrid Buffer Cache · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2020 A Multiagent Reinforcement Learning-Assisted Cache Cleaning Scheme for DM-SMR · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2023 |
Storage systems › storage performance
i/o amplification |
1.1 | 2 | 2026 | Reducing I/O Amplification for Key-Value Stores With a Log-Assisted Log-Structured Merge Tree · IEEE Trans. Knowl. Data Eng. 2026 Less is More: De-amplifying I/Os for Key-value Stores with a Log-assisted LSM-tree · ICDE 2021 |
Storage systems › file systems › file system design
mobile file system |
1.1 | 2 | 2022 | ELOFS: An Extensible Low-Overhead Flash File System for Resource-Scarce Embedded Devices · IEEE Trans. Computers 2022 Bridging Mismatched Granularity Between Embedded File Systems and Flash Memory · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2021 |
Storage systems › flash and SSD › flash memory management › garbage collection
write amplification |
1.1 | 2 | 2022 | Removing Double-Logging with Passive Data Persistence in LSM-tree based Relational Databases · FAST 2022 Less is More: De-amplifying I/Os for Key-value Stores with a Log-assisted LSM-tree · ICDE 2021 |
Storage systems › file systems
flash file system |
1.0 | 2 | 2022 | ELOFS: An Extensible Low-Overhead Flash File System for Resource-Scarce Embedded Devices · IEEE Trans. Computers 2022 LOFFS: A Low-Overhead File System for Large Flash Memory on Embedded Devices · DAC 2020 |
Hardware accelerators and domain-specific architectures
machine learning accelerator |
1.0 | 2 | 2022 | A Practical Highly Paralleled ReRAM-Based DNN Accelerator by Reusing Weight Pattern Repetitions · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2022 PattPIM: A Practical ReRAM-Based DNN Accelerator by Reusing Weight Pattern Repetitions · DAC 2020 |
Cryptographic protocols and secure computation › private information retrieval
keyword private information retrieval |
1.0 | 1 | 2026 | Conflux: A High-Performance Keyword Private Retrieval System for Dynamic Datasets · HPCA 2026 |
Storage systems
data migration |
1.0 | 1 | 2026 | VeloxGNN: Efficient Out-of-Core GNN Training with Delayed Gradient Propagation · HPCA 2026 |
Storage systems › key-value storage
LSM-tree key-value store |
1.0 | 1 | 2026 | A ReRAM-Based Processing-in-Memory Framework for LSM-Based Key-Value Store · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2026 |
Hardware accelerators and domain-specific architectures › domain-specific accelerator
storage accelerator |
1.0 | 1 | 2026 | A ReRAM-Based Processing-in-Memory Framework for LSM-Based Key-Value Store · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2026 |
Storage systems
metadata management |
0.9 | 2 | 2024 | LightFS: A Lightweight Host-CSD Coordinated File System Optimizing for Heavy Small File Accesses · IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2024 ELOFS: An Extensible Low-Overhead Flash File System for Resource-Scarce Embedded Devices · IEEE Trans. Computers 2022 |
Machine learning › Efficient and distributed learning
model compression |
0.9 | 1 | 2025 | Enabling On-Tiny-Device Model Personalization via Gradient Condensing and Alternant Partial Update · DAC 2025 |
Methods — techniques the papers use, named apart from their topics
graph partitioning · 3.5bloom filter · 2.5protocol-architecture co-design · 2.0private information retrieval · 2.0oblivious filtering · 2.0delayed gradient propagation · 2.0zeroth-order optimization · 1.7trusted execution environment · 1.7self-supervised learning · 1.7oblivious RAM · 1.7multimodal feature fusion · 1.7diffusion model · 1.7reinforcement learning · 1.2q-learning · 1.2hybrid file structures · 1.0index table · 1.0gradient condensing · 0.9computational storage · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | SysVCoder: An LLM-Driven Framework for Systematic Generation of System-Level Design
Jian Zuo, Junzhe Liu, Xianyong Wang, Navya Goli, Umamaheswara Rao Tida, Zhenge Jia, Zhaoyan Shen, Mengying Zhao |
APPT | 8 |
| 2026 | EEMU: A FEMU-based Accurate, Parametric Ethernet-SSD EmulatorabstractEthernet-SSDs incorporate built-in Ethernet connectivity, allowing them to function as standalone network-attached storage devices. This architecture enables efficient and scalable disaggregated storage by providing direct network access without host dependencies. Understanding their internal architecture and fine-grained performance interactions is critical for advancing this emerging design, yet is difficult to study on proprietary hardware. In this paper, we present EEMU, a configurable and accurate Ethernet-SSD emulator built on the FEMU framework. EEMU reproduces the end-to-end NVMeoF I/O translation path and models latency across three key components: the Network Interface, the NVMeoF Target Module, and the AXI Bus. It further employs a fine-grained parametric latency model that decomposes end-to-end latency into component-level contributions, enabling systematic exploration of architectural trade-offs via controlled parameterization. Experiments show that EEMU closely matches both component-level behaviors and end-to-end performance across diverse Ethernet-SSD configurations. Xikun Jiang, Tianyu Wang 0009, Zhaoyan Shen, Zili Shao |
DATE | 5 |
| 2026 | Conflux: A High-Performance Keyword Private Retrieval System for Dynamic DatasetsabstractHomomorphic Encryption (HE)-based Private Information Retrieval (PIR) allows clients to retrieve plaintext records from untrusted servers without revealing query content. While promising in theory, existing solutions fall short in practice due to two fundamental limitations: (1) poor support for dynamic datasets, which limits applicability in real-world, evolving workloads; and (2) excessive I/O overhead from full-database scans. These bottlenecks prevent current designs from bridging the gap between cryptographic privacy and system efficiency. In this paper, we introduce Conflux, an efficient keyword PIR system for dynamic data environments through a protocolarchitecture co-design approach. At the protocol level, Conflux employs a novel two-phase retrieval mechanism, consisting of an oblivious filtering phase followed by a precise retrieval phase. This design natively supports efficient online insertions, deletions, and updates, while maintaining near-optimal computational complexity. At the system level, Conflux adopts a heterogeneous accelerator architecture that tightly couples computational storage devices and incorporates software-hardware co-optimization techniques to mitigate I/O bottlenecks. Experimental results show that Conflux reduces query processing time by up to$2.64 \times$compared to the state-of-the-art methods, while retaining full support for dynamic datasets. Zhaoyan Shen, Lei Ju 0001 |
HPCA | 2 |
| 2026 | VeloxGNN: Efficient Out-of-Core GNN Training with Delayed Gradient PropagationabstractTraining Graph Neural Networks (GNNs) on large-scale data is essential in various applications, e.g., transportation, and molecular biology. As graph sizes increasingly surpass main memory capacities, the out-of-core (OOC) GNN training system (OOC-based) has been proposed, a scheme that storing graphs on external storage, such as SSD or HDD, sequentially loading and processing smaller partitions. However, existing OOC-based systems face the key challenges: excessive data migration between storage and memory, as well as reduced model accuracy. In this paper, we theoretically and empirically analyze the limitations of state-of-the-art OOC-based systems and identify opportunities for optimization. Guided by our theoretical insights, we propose VeloxGNN, a novel system to improve data migration efficiency while maintaining high model accuracy. First, we introduce a novel algorithm, named Delayed Gradient Propagation (DGP), which specifically designed for OOC-based system. DGP leverages both historical node embeddings and unbiased gradients to achieve two key objectives simultaneously: minimizing the data migration (by ensuring that dataset is read at most once) while maintaining model accuracy. To support DGP, we then propose system-level optimizations: dynamic memory management, DGP-aware loading order, and a new graph partitioning method that separates labeled and unlabeled data. Experimental results show that VeloxGNN achieves memory-based accuracy while reducing training time by 17.7% to 73.3% across various datasets and GNN models, outperforming state-of-the-art methods. This result highlights VeloxGNN's potential for efficient and scalable GNN training on large-scale graph data. Tsun-Yu Yang, Zhaoyan Shen, Ming-Chang Yang, Bingzhe Li |
HPCA | 3 |
| 2026 | CSD-CoKV: Host-CSD Collaborative Offloading for High-Performance LSM-Tree Based KV Stores
Zhining Cao, Jinrun Yang, Shikun Ma, Junbo Yin, Zhaoyan Shen |
ICDE | 11 |
| 2026 | An Asymmetric Consistency Protocol for Raft-Based Distributed Key-Value Stores
Jinrun Yang, Zhaoyan Shen, Dongxiao Yu, Xiuzhen Cheng |
IEEE Internet Things J. | 4 |
| 2026 | A survey on data management for Out-of-Core GNN systems
Junchi Ren, Yao Chen 0003, Zhaoyan Shen |
J. Syst. Archit. | 7 |
| 2026 | PIRacle: A Fast and Scalable Private Information Retrieval System for Key-Value Stores
Zhaoyan Shen, Yi Wang 0003, Lei Ju 0001 |
IEEE Trans. Computers | 2 |
| 2026 | A ReRAM-Based Processing-in-Memory Framework for LSM-Based Key-Value StoreabstractLog-structured merge (LSM) tree-based key-value (KV) stores organize writes into hierarchical batches to optimize write performance. However, the notorious compaction process and multi-level query mechanism of LSM-tree severely hurt system performance. Our preliminary experiments show that (1) When compaction occurs in the L0 and L1 of the LSM-tree, it may saturate system computation and memory resources, ultimately causing the entire system to stall, and (2) large number of iterative retrievals across multiple levels is usually required to locate the queried data, while redundant key range overlap in L0 further increases the overhead. Based on these observations, we introduce Re-LSM+, a ReRAM-based Processing-in-Memory framework for LSM-based Key-Value Stores. In Re-LSM+, we offload compaction tasks from the higher levels of the LSM-tree to the PIM processing part. A highly parallel ReRAM compaction accelerator is designed by breaking down the three-phase compaction process into basic logic operations. Additionally, we design an index table and a multi-layer Bloom filter for different levels to improve the query efficiency of the LSM-tree. Evaluation results from db_bench show that Re-LSM+ achieves a 2.37× improvement in random write throughput compared to RocksDB. Furthermore, the ReRAM-based compaction accelerator achieves a 68.16× speedup over the CPU-based implementation and reduces energy consumption to 25.5×. Yuhao Zhang 0006, Zhaoyan Shen, Dongxiao Yu, Lei Ju 0001 |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 6 |
| 2026 | Reducing I/O Amplification for Key-Value Stores With a Log-Assisted Log-Structured Merge Tree
Kecheng Huang, Minyang Bao, Zhaoyan Shen, Zili Shao |
IEEE Trans. Knowl. Data Eng. | 5 |
| 2026 | C-CIM: A Multi-Mode Convolution-Capable SRAM-CIMabstractSRAM is widely used in computing-in-memory (CIM) neural network accelerators because of its relatively mature technology and good compatibility with complementary metal oxide semiconductor logic process. Digital SRAM-CIM is favored by researchers because of its stability and accuracy. However, the current digital SRAM-CIM macro only supports the weight-stationary dataflows, which means the repeated movement of graph data. Some special deep neural network layers, such as depth-wise, make the utilization of computing resources inside CIM low. To overcome these problems, we propose C-CIM, which can switch between input-stationary and weight-stationary dataflows and support matrix multiplication as well as convolution operations with multiple mainstream convolution kernel sizes (1×1, 3×3, 5×5 and 7×7). The C-CIM achieves an average performance of 27.31TOPS/W@8b at a frequency of 1GHz. Experimental results show that our proposed SRAM-CIM successfully outperforms baseline in terms of performance optimization, achieving up to 7.6× performance speedup and up to 86.84% reduction in activation relocation. Renyu Yang, Xin Ju 0005, Mei Wen, Jinjin Deng, Junzhong Shen, Tianyu Wang 0003, Zhaoyan Shen, Zili Shao |
ACM Trans. Design Autom. Electr. Syst. | 9 |
| 2025 | Exploiting Large Language Models for Software-Defined Solid-State Drives Design
Tianren Zhou, Zhenge Jia, Mengying Zhao, Zhaoyan Shen |
APPT | 7 |
| 2025 | Enabling On-Tiny-Device Model Personalization via Gradient Condensing and Alternant Partial UpdateabstractOn-device training enables the model to adapt to user-specific data by fine-tuning a pre-trained model locally. As embedded devices become ubiquitous, on-device training is increasingly essential since users can benefit from the personalized model without transmitting data and model parameters to the server. Despite significant efforts toward efficient training, ondevice training still faces a major challenge: The prohibitive cost of multi-layer backpropagation strains the limited resources of tiny devices. In this paper, we propose an algorithm-system cooptimization framework TinyMP that enables self-adaptive on-tiny-device model personalization. To mitigate backpropagation costs, we introduce Gradient Condensing to condense the gradient map structure, significantly reducing the computational complexity and memory consumption of backpropagation while preserving model performance. To further reduce computation overhead, we propose Alternant Partial Update, a mechanism that locally and alternatively selects essential parameters to update without requiring retraining or offline evolutionary search. Our framework is evaluated through extensive experiments using various CNN models (e.g., MobileNetV2, MCUNet) on embedded devices with minimal resources (e.g., OpenMV-H7 with less than 1MB SRAM and 2 MB Flash). Experimental results show that our framework achieves up to $2.4 \times$ speedup, 80.8% memory saving, and 30.3% accuracy improvement on downstream tasks, outperforming SOTA approaches. Zhenge Jia, Yiyang Shi, Zeyu Bao, Xin Pang, Huiguo Liu, Zhaoyan Shen, Mengying Zhao |
DAC | 8 |
| 2025 | One Gray Code Fits All: Optimizing Access Time with Bi-Directional Programming for QLC SSDsabstractGray code, a voltage-level-to-data-bit translation scheme, is widely used in QLC SSDs. However, it causes the four data bits in QLC to exhibit significantly different read and write performance with up to 8 × latency variation, severely impacting the worst-case performance of QLC SSDs. This paper presents BDP, a novel Bi-Directional Programming scheme. Based on a fixed Gray code, BDP combines both the normal (forward) and reverse programming directions to enable runtime programming direction arbitration. Experimental results show that BDP can effectively improve the read and write performance of SSD compared to representative schemes. Shaoqi Li, Tianyu Wang 0009, Yongbiao Zhu, Chenlin Ma, Yi Wang 0003, Zhaoyan Shen, Zili Shao |
DATE | 6 |
| 2025 | HaSiS: A Hardware-assisted Single-index Store for Hybrid Transactional and Analytical Processing
Kecheng Huang, Zhaoyan Shen, Zili Shao, Feng Chen 0005, Tong Zhang 0002 |
FAST | 2 |
| 2025 | HiDPU: A DPU-Oriented Hybrid Indexing Scheme for Disaggregated Storage Systems
Zhaoyan Shen, Renhai Chen, Xin Yao 0008, Dongxiao Yu, Zili Shao |
FAST | 2 |
| 2025 | A Deep Dive into Protocol Design: How to Improve IPFS Performance without Sacrificing DecentralizationabstractThe InterPlanetary File System (IPFS) is a prominent decentralized storage solution; however, it struggles with performance issues. To address this challenge, the IPFS team has patched a series of centralized components, resulting in improved performance while giving more significant roles to specific entities. Balancing speed and decentralization has always posed a complex dilemma for storage systems. In this paper, we conduct a series of experiments and analyses to identify the performance advantages and constraints associated with the IPFS decentralized protocol. Based on thorough analysis, we propose a novel scheme named XIPFS to optimize IPFS. This scheme includes facilitating parallel block exchange across multiple nodes, refining content Publication strategies, and improving node selection algorithms for content routing. Our goal is to maximize the benefits of decentralized multi-source parallel downloading while minimizing the negative impact of decentralized indexing on execution time. Compared to previous approaches, the proposed optimizations are lightweight and fully compatible with the decentralized protocol, enabling autonomous execution and utility realization at each node. Experimental results demonstrate that XIPFS significantly improves node performance without compromising decentralization. Zhaoyan Shen, Mengying Zhao, Dongxiao Yu, Bingzhe Li |
ICDE | 2 |
| 2025 | DiffECG: Diffusion Model-Powered Label-Efficient and Personalized Arrhythmia DiagnosisabstractArrhythmia diagnosis using electrocardiogram (ECG) is critical for preventing cardiovascular risks. However, existing deep learning-based methods struggle with label scarcity and contrastive learning-based methods suffer from false-negative samples, which lead to poor model generalization. Besides, due to inter-subject variability, pre-trained models cannot achieve evenly performance across individuals. Conducting model fine-tuning for each individual is computationally expensive and does not guarantee improvement. We propose DiffECG, a diffusion-based self-supervised learning framework for label-efficient and personalized arrhythmia detection. Our method utilizes a diffusion model to extract robust ECG representations, coupled with a novel feature extractor and a multi-modal feature fusion strategy to obtain a well-generalized model. Moreover, we propose an efficient model personalization mechanism based on zeroth-order optimization. It personalizes the model by tuning the noise-adding step t in the diffusion process, significantly reducing computational costs compared to model fine-tuning. Experimental results show that our proposed method outperforms the SOTA method by 37.9% and 23.9% in generalization and personalization performance, respectively. The source code is available at: https://github.com/Auguuust/DiffEC Tianren Zhou, Zhenge Jia, Dongxiao Yu, Zhaoyan Shen |
IJCAI | 4 |
| 2025 | CAMO: A High-Performance CIM-based Lightweight CNN Accelerator for Mobile DevicesabstractDigital Compute-in-Memory (CIM) macros revolutionize the Von Neumann architecture by significantly reducing data movements between CPU and memory. However, when dealing with lightweight CNNs with various convolution types, existing GEMM (general matrix multiplication)-oriented solutions suffer from underutilization and large activation traffic, leading to unsatisfied energy and area efficiencies. In this context, we propose CAMO, in which the key contributions are: (1) A novel convolution mapping mechanism suitable for CIM macros, that maximizes data reuse and reduces activation traffic. (2) A convolution-capable CIM macro, that also supports small-scale GEMM. (3) A CIM-based architecture that supports multiple computing modes. The experimental results show that CAMO achieves up to 31.49× performance speedup and 77.5% activation traffic reduction compared to the baseline architecture. Xin Ju 0005, Renyu Yang, Mei Wen, Junzhong Shen, Tianyu Wang 0009, Zhaoyan Shen, Zili Shao |
ISCAS | 6 |
| 2025 | SmartPIR: A Private Information Retrieval System using Computational Storage Devices
Honghui You, Lei Ju 0001, Zhaoyan Shen |
MICRO | 6 |
| 2025 | CoaCAD: Correlation-Assisted Computer-Aided Design for Nonvolatile FPGAsabstractNonvolatile field-programmable gate arrays (FPGAs) offer advantages in terms of high logic density and near-zero leakage power when contrasted with conventional static random access memory-based FPGAs. However, they have a lifetime issue. To deal with this problem, a series of configuration files can be generated with various logical-to-physical mappings. This enables intensive writing to be distributed across different physical regions for wear leveling. Currently, the configuration files are independently generated, which is time consuming. In this article, we propose to investigate correlations and use them to assist the computer-aided design (CAD) flow to speed up the procedure of generating configuration files. First, we develop dynamic probabilities to drive the swapping of placement stage in CAD flow, so as to push components to locate appropriate positions quickly. Second, we design the congestion information inheritance strategy to adjust routing parameters in the routing stage, aiming to reduce the number of routing attempts. Evaluation shows that the proposed schemes can deliver 44.15% decrease in placement and routing runtime, while maintaining comparable performance and lifetime, when compared with existing strategies. Mengying Zhao, Yuqing Xiong, Huichuan Zheng, Dongxiao Yu, Zhaoyan Shen |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 6 |
| 2025 | TELEX: Two-Level Learned Index for Rich Queries on Enclave-Based Blockchain SystemsabstractBlockchain has become a popular paradigm for secure and immutable data storage. Despite its numerous applications across various fields, concerns regarding the user privacy and result integrity during data queries persist. Additionally, the need for rich query functionalities to harness the full potential of blockchain data remains an area ripe for exploration. In order to address these challenges, our paper first utilizes a framework based on the Trusted Execution Environment (TEE) and oblivious RAM technique to achieve both privacy and data integrity. To enhance the query efficiency over the entire blockchain, we then devise a two-level learned indexing methodology named TELEX within the TEE for both integer and string keys. We also propose different query processing algorithms for versatile query types, including exact queries, aggregate queries, Boolean queries, and range queries. By implementing the prototype and conducting extensive evaluation, we demonstrate the feasibility and remarkable improvement in efficiency compared to existing solutions. Haotian Wu 0001, Yuzhe Tang, Zhaoyan Shen, Jun Tao 0003, Chenhao Lin, Zhe Peng |
IEEE Trans. Knowl. Data Eng. | 3 |
| 2024 | Towards High-Throughput Neural Network Inference with Computational BRAM on Nonvolatile FPGAsabstractField-programmable gate arrays (FPGAs) have been widely used in artificial intelligence applications. As the capacity requirements of both computation and memory resources continuously increase, emerging nonvolatile memory has been proposed to replace static random access memory (SRAM) in FPGAs to build nonvolatile FPGAs (NV-FPGAs), which have advantages of high density and near-zero leakage power. Features of emerging nonvolatile memory should be fully explored to improve performance, energy efficiency as well as lifetime of NV-FPGAs. In this paper, we study an intrinsic characteristic of emerging nonvolatile memory, i.e., computing-in-memory, in nonvolatile block random access memory (BRAM) of NV-FPGAs. Specifically, we present a computational BRAM architecture (C-BRAM), and propose a computational density aware operator allocation strategy to fully utilize C-BRAM. Neural network inference is taken as an example to evaluate the proposed architecture and strategy, showing 68% and 62% improvement in computational density compared to traditional SRAM-based FPGA and existing NV-FPGA, respectively. Mengying Zhao, Huichuan Zheng, Yuqing Xiong, Yuhao Zhang 0006, Zhaoyan Shen |
DATE | 6 |
| 2024 | Federation-Paced Learning: Towards Efficient Federated Learning with Synchronized PaceabstractFederated learning (FL) is a distributed machine learning approach that allows multiple devices or computing nodes to jointly train models without sharing raw data. However, in real-world application scenarios, FL usually encounters a critical challenge of data heterogeneity. Recent studies have revealed that the client’s model suffers severe bias between the local model and global model, leading to global performance degradation. Improving the generalization of local learning would inherently reduce bias. It has been proved that self-paced learning on a single device can greatly achieve a better generalization result. However, it is not well explored how it can be applied to federated learning with a number of distributed nodes working cooperatively. Specifically, self-paced learning suggests using easy data and then gradually difficult data during model training. It is not straightforward to differentiate “easy” and “difficult” data at the local since global data distribution is not available, especially with severe data heterogeneity. To address the above issues, we propose a novel federated learning framework, Federation-Paced Learning (FedPL), which enables a self-paced process in federated learning and effectively improves the model performance. First, we propose schemes to analyze the data characteristics in terms of difficulty. Then we define a stage controller to synchronize the learning process across cooperative nodes to follow the easy-to-hard rule. Finally, we propose a client selection strategy to further improve the learning efficacy. We evaluate the performance of FedPL on several generic public datasets. Experiment results show that the proposed FedPL outperforms existing methods by up to 13.50% in terms of accuracy. Code is available at https://github.com/tnghua/FedPL. Mei Cao, Zhenge Jia, Jianbo Lu 0001, Zhaoyan Shen, Dongxiao Yu, Mengying Zhao |
ECAI | 5 |
| 2024 | Celeritas: Out-of-Core Based Unsupervised Graph Neural Network via Cross-Layer Computing 2024abstractGraph neural networks (GNN) one of the most popular neural network models, are extensively applied in graph-related fields, including drug discovery, recommendation systems, etc. Unsupervised graph learning as one type of GNN plays a crucial role in various graph-related missions like node classification and edge prediction. However, with the increasing size of real-world graph datasets, processing such massive graphs in host memory becomes impractical, and GNN training demands a substantial storage volume to accommodate the vast amount of graph data. Consequently, GNN training results in significant I/O migration between the host and storage. Although state-of-the-art frameworks have made strides in mitigating I/O overhead by considering embedding locality, their GNN frameworks still suffer from long training times. In this paper, we propose a fully out-of-core framework, called Celeritas, which speeds up the unsupervised GNN training on a single machine by co-designing the GNN algorithm and storage systems. First, based on the theoretical analysis, we propose a new partial combination operation to enable the embedding updates across GNN layers. This cross-layer computing achieves future computation for the embedding stored in memory to save data migration. Second, due to the dependency between embedding and edges, we consider their data locality together. Based on the cross-layer computing property, we propose a new loading order to fully utilize the data stored in the main memory to save I/O. Finally, a new sampling scheme called two-level sampling is proposed associated with a new partition algorithm to further reduce data migration and computation overhead while maintaining similar training accuracy. The real system experiments indicate that the proposed Celeritas can reduce the total training time of different G NN models from 44.76 % to 73.85 % compared to state-of-art schemes for different graph datasets. Tsun-Yu Yang, Ming-Chang Yang, Zhaoyan Shen, Bingzhe Li |
HPCA | 4 |
| 2024 | An Access Pattern-aware Hybrid Learning-based and Conventional Mapping for Solid-State DrivesabstractLearning-based address mapping strategy has been proposed as an alternative to the conventional one-to-one mapping strategy for logical to physical address translation in flash-based Solid-State Drives (SSDs). This strategy employs a machine learning (ML)-based index to replace the memory-intensive mappings, thereby saving memory space. However, current learning-based mapping strategies mainly focus on the sequential characteristics of I/O workloads, making them less effective in scenarios with frequent updates. In this work, we introduce an access pattern-aware hybrid learning-based and conventional mapping scheme for SSDs, called APH-FTL. This approach features a machine learning-driven data classifier that employs distinct address mapping strategies for data requests with varying access patterns. Additionally, we develop a benefit-guided space regulation strategy to manage in-device memory space effectively and provide a solution to the challenge of mapping policies transformation. We evaluate APH-FTL through simulations using various real-world workloads. Experimental results demonstrate that APH-FTL significantly improves performance, reducing response time by up to 76.59% and write amplification (WA) by up to 82.97% compared with state-of-the-art schemes. Xiaosu Guo, Jie Wang 0128, Zhaoyan Shen, Dongxiao Yu, Zhiping Jia, Bingzhe Li |
ICCAD | 4 |
| 2024 | ISVDA: An in Storage Processing Accelerator for Visual Data AnalysisabstractDeep neural networks(DNNs) have been widely applied in visual data analysis. To accelerate DNN-based visual data inference, contemporary visual data analytics systems employ strategies like model specialization and model cascading to alleviate the computational demands of DNN processes. In addition, some existing systems seek to reduce the overhead of data decoding by directly storing decoded RGB data on storage devices, albeit at the expense of significantly increased storage costs and data transfer volumes. In this paper, we introduce ISVDA, a visual data analysis accelerator based on In-storage computing. ISVDA proposes to offload the data-intensive video preprocessing tasks, encompassing data decoding and resizing, to the computational storage device, leveraging its ample internal bandwidth and computational advantages. Concurrently, ISVDA introduces a dynamic sampling algorithm that intelligently adjusts sampling strides based on spatiotemporal information encoded in motion vectors, thereby skipping more video frames for DNN inferences in both retrospective and streaming analysis scenarios. Experiments conducted on real hardware demonstrate that compared to CPU-based preprocessing systems, ISVDA can achieve average 6.8x speedup for image data analysis and 2.8x speedup for video data analysis. Zhaoyan Shen, Xiaojun Cai |
ICCD | 2 |
| 2024 | FedMQ: Multi-grained Quantization for Heterogeneous Federated Learning
Mei Cao, Jianbo Lu 0001, Zhaoyan Shen, Mengying Zhao |
WASA (2) | 5 |
| 2024 | ASHL: An Adaptive Multi-Stage Distributed Deep Learning Training Scheme for Heterogeneous EnvironmentsabstractWith the increment of data sets and models sizes, distributed deep learning has been proposed to accelerate training and improve the accuracy of DNN models. The parameter server framework is a popular collaborative architecture for data-parallel training, which works well for homogeneous environments by properly aggregating the computation/communication capabilities of different workers. However, in heterogeneous environments, the resources of different workers vary a lot. Some stragglers may seriously limit the whole speed, which impacts the overall training process. In this paper, we propose an adaptive multi-stage distributed deep learning training framework, named ASHL, for heterogeneous environments. First, a profiling scheme is proposed to capture the capabilities of each worker to reasonably plan the training and communication tasks on each worker, and lay the foundation for the formal training. Second, a hybrid-mode training scheme (i.e., coarse-grained and fined-grained training) is proposed to balance the model accuracy and training speed. The coarse-grained training scheme (named AHL) adopts an asynchronous communication strategy, which involves less frequent communications. Its main goal is to make the model quickly converge to a certain level. The fine-grained training stage (named SHL) uses a semi-asynchronous communication strategy and adopts a high communication frequency. Its main goal is to improve the model convergence effect. Finally, a compression-based communication scheme is proposed to further increase the communication efficiency of the training process. Our experimental results show that ASHL reduces the overall training time by more than 35% to converge to the same degree and has better generalization ability compared with state-of-the-art schemes like ADSP. Zhaoyan Shen, Qingxiang Tang, Tianren Zhou, Yuhao Zhang 0006, Zhiping Jia, Dongxiao Yu, Zhiyong Zhang 0006, Bingzhe Li |
IEEE Trans. Computers | 1 |
| 2024 | HMC-FHE: A Heterogeneous Near Data Processing Framework for Homomorphic EncryptionabstractFully homomorphic encryption (FHE) offers a promising solution to ensure data privacy by enabling computations directly on encrypted data. However, its notorious performance degradation severely limits the practical application, due to the explosion of both the ciphertext volume and computation. In this article, leveraging the diversity of computing power and memory bandwidth requirements of FHE operations, we present HMC-FHE, a robust acceleration framework that combines both GPU and hybrid memory cube (HMC) processing engines to accelerate FHE applications cooperatively. HMC-FHE incorporates four key hardware/software co-design techniques: 1) a fine-grained kernel offloading mechanism to efficiently offload FHE operations to relevant processing engines; 2) a ciphertext partitioning scheme to minimize data transfer across decentralized HMC processing engines; 3) an FHE operation pipeline scheme to facilitate pipelined execution between GPU and HMC engines; and 4) a kernel tuning scheme to guarantee the parallelism of GPU and HMC engines. We demonstrate that the GPU-HMC architecture with proper resource management serves as a promising acceleration scheme for memory-intensive FHE operations. Compared with the state-of-the-art GPU-based acceleration scheme, the proposed framework achieves up to$2.65\times $performance gains and reduces$1.81\times $energy consumption with the same peak computation capacity. Zhining Cao, Zhaoyan Shen, Lei Ju 0001 |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 3 |
| 2024 | LightFS: A Lightweight Host-CSD Coordinated File System Optimizing for Heavy Small File AccessesabstractComputational storage drive (CSD) improves the data processing efficiency by processing the data within the storage. However, existing CSDs rely on the host-centric file systems to manage the data, where the layouts of files are retrieved by the host and sent to the CSD, resulting in additional I/O overhead and reduced processing efficiency, especially in heavy small file accesses. Moreover, the lack of consistency mechanisms poses potential consistency issues. To address these challenges, we propose LightFS, a lightweight host-CSD coordinated file system for the CSD file management. To reduce task offloading overhead, LightFS builds an index file$.ndpmeta$which summarizes the files’ metadata and shares between the host and CSD to enable CSD to retrieve the file layout in storage directly. To ensure consistency, LightFS employs a metadata locker and an update synchronizer. The metadata locker leverages the out-of-place update feature of the flash to capture a snapshot of the file to be written without any data copy, while the update synchronizer triggers metadata updates by monitoring the addresses of written blocks to ensure that the modified file is successfully written to the CSD. We implement and evaluate LightFS on a real testbed, and the results demonstrate that LightFS achieves$3.66\times $performance improvement on the average in real-world operations. Zhaoyan Shen, Duo Liu 0002, Xianzhang Chen, Kan Zhong, Zhaoyang Zeng, Yujuan Tan |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 2 |
| 2024 | A Bloom-Filter-Based Unique Address Checking Approach for DAG-Based Blockchain SystemsabstractWinternitz one-time signature (WOTS) is a quantum-resistant signature mechanism that has been widely used in direct acyclic graph (DAG)-based blockchain systems. However, it needs to generate a unique private/public key pair for each transaction, which severely limits blockchain performance by performing a time-consuming unique address checking process when generating transactions. This article proposes a bloom-filter-based approach, called ABACUS, to optimize the unique address checking process in WOTS. In ABACUS, we separate the large address space into multiple small subspaces and apply bloom filters to perform uniqueness checking for all addresses in one subspace. Specifically, we propose a two-level address space mechanism to strike a balance between the checking efficiency and the memory/storage space overhead of the bloom filter design. A bucket-based scalable bloom filter (SBF) design is proposed to match the growth of used addresses with efficient I/O access by storing all sub-bloom-filters together in one bucket. To further reduce disk I/Os, ABACUS incorporates an in-memory write buffer and a read-only cache. To reclaim wasted addresses, we also propose a layered address recycling mechanism by efficiently checking and reusing unused addresses that were identified as used due to false positives of bloom filters. We have implemented a fully functional prototype of ABACUS and integrated it into IOTA, a widely used DAG-based blockchain system. A series of experiments have been conducted on a private IOTA system. Experimental results show that ABACUS can significantly reduce the transaction generation time by up to four orders of magnitude, and achieve up to$3\times $boost on the system throughput with more than 80% space-saving. We have released the open-source code of ABACUS for public access. Tianyu Wang 0009, Zizhan Chen, Zhaoyan Shen, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 5 |
| 2024 | NICE: A Nonintrusive In-Storage-Computing Framework for Embedded ApplicationsabstractEmbedded machine learning applications face challenges related to massive data movement and high computational intensity, exacerbated by the limited performance of mobile devices. Computational storage devices (CSDs) pose huge potential for accelerating both data-intensive and computation-intensive embedded machine learning tasks by effectively reducing data movement and leveraging built-in accelerators. However, existing in-storage-computing (ISC) frameworks either require invasive customization of existing host driver layers or necessitate complex device firmware modifications, hindering the widespread deployment of CSDs. In addition, the lack of file semantics and the constrained internal resources within CSD implicitly compromise system performance and impact normal read/write performance. In this article, we aim to provide a nonintrusive in-storage-computing framework for embedded applications, named NICE. This framework includes an easy-to-use ISC programming interface that bypasses the kernel stack and requires no modification to the host NVMe driver, which is achieved through a novel hyper-addressing-based programming library and a file-aware page data layout within the CSD. In addition, we incorporate a lightweight kernel with coroutine-based command scheduling and several FPGA-based accelerators within the storage device firmware to enhance the performance of embedded machine learning applications while ensuring that the normal I/O performance remains unaffected. NICE is implemented on real CSD hardware integrated with ARM and FPGA. Experimental results demonstrate that our NICE framework can achieve an average latency performance improvement of$43.5\times $($9.32\times $) compared to CPU-(GPU-) based embedded machine learning solutions using the state-of-the-art NVIDIA Jetson NX platform, with$27.5\times $($4.3\times $) higher energy efficiency. NICE also has$34.2\times $less software and I/O performance overheads than state-of-the-art ISC frameworks. Tianyu Wang 0009, Yongbiao Zhu, Shaoqi Li, Jin Xue, Chenlin Ma, Yi Wang 0003, Zhaoyan Shen, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 7 |
| 2024 | A Semantic-Integrated LSM-Tree-Based Key-Value Storage Engine for Blockchain SystemsabstractBlockchain systems play an important role in distributed ledgers, database systems, etc. As more and more blocks are mined, the storage burden of blockchain system is significantly increased. The current blockchain system uniformly transforms all its data into key-value (KV) items and stores them to the underlying Log-Structure Merged tree (LSM-tree) storage engine ignoring the software semantics. Consequently, it not only aggravates the write amplification effect of the storage engine, but also increases the redundancy of data query steps, resulting in the performance bottleneck of blockchain system. In this paper, we propose a semantic-integrated LSM-tree based Key-Value storage engine for blockchain systems, called Block-LSM, which significantly improves the data synchronization and data query efficiency of blockchain system. Specifically, we first design a shared prefix scheme to transform blockchain data into ordered KV pairs to alleviate the key range overlaps of different levels in the underlying LSM-tree based storage engine. Moreover, we propose to maintain several semantic-orientated memory buffers to isolate different kinds of blockchain data, and implement memory buffer space management strategy to further improve memory efficiency. To save space overhead, Block-LSM further aggregates multiple blocks into a group and assigns the same prefix to all KV items from the same block group. We also reduce step redundancy in transaction queries by modifying the body data storage format. Finally, we implement Block-LSM in a real blockchain environment and conduct a series of comparative experiments with the typical blockchain system Ethereum. The evaluation results show that Block-LSM significantly reduces up to 7.56× storage write amplification and increases throughput by 8.64× compared with the original Ethereum design. In terms of data lookups (i.e. transaction and account lookup), Block-LSM improves the throughput by 50% compared to the original Ethereum design. Yuhao Zhang 0006, Xiaojun Cai, Zhiping Jia, Zhaoyan Shen, Yi Wang 0003, Zili Shao, Bingzhe Li |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 7 |
| 2024 | Static Scheduling of Weight Programming for DNN Acceleration with Resource Constrained PIMabstractMost existing architectural studies on ReRAM-based processing-in-memory (PIM) DNN accelerators assume that all weights of the DNN can be mapped to the crossbar at once. However, these studies are over-idealized. ReRAM crossbar resources for calculation are limited because of technological limitations, so multiple weight mapping procedures are required during the inference process. In this article, we propose a static scheduling framework which generates the mapping between DNN weights and ReRAM cells with minimum runtime weight programming cost. We first build a ReRAM crossbar programming latency model by simultaneously considering the DNN weight patterns, ReRAM programming operations, and PIM architecture characteristics. Then, the model is used in the searching process to obtain an optimized weight-to-OU mapping table with minimum online programming latency. Finally, an OU scheduler is used to coordinate the activation sequences of OUs in the crossbars to perform the inference computation correctly. Evaluation results show the proposed framework significantly reduces the weight programming overhead and the overall inference latency for various DNN models with different input datasets. Xin Gao 0012, Yuhao Zhang 0006, Zhaoyan Shen, Lei Ju 0001 |
ACM Trans. Embed. Comput. Syst. | 5 |
| 2024 | Robust Embedded Autonomous Driving Positioning System Fusing LiDAR and Inertial SensorsabstractAutonomous driving emphasizes precise multi-sensor fusion positioning on limit resource embedded systems. LiDAR-centered sensor fusion system serves as a mainstream navigation system due to its insensitivity to illumination and viewpoint change. However, these types of systems suffer from handling large-scale sequential LiDAR data using limited resources on board, leading LiDAR-centralized sensor fusion unpractical. As a result, hand-crafted features such as plane and edge are leveraged in majority mainstream positioning methods to alleviate this unsatisfaction, triggering a new cornerstone in LiDAR Inertial sensor fusion. However, such super light weight feature extraction, although it achieves real-time constraint in LiDAR-centered sensor fusion, encounters severe vulnerability under high speed rotational or translational perturbation. In this paper, we propose a sparse tensor based LiDAR Inertial fusion method for autonomous driving embedded system. Leveraging the power of sparse tensor, the global geometrical feature is fetched so that the point cloud sparsity defect is alleviated. Inertial sensor is deployed to conquer the time-consuming step caused by the coarse level point-wise inlier matching. We construct our experiments on both representative dataset benchmarks and realistic scenes. The evaluation results show the robustness and accuracy of our proposed solution compared to classical methods. Zhijian He, Bohuan Xue, Xiangcheng Hu, Zhaoyan Shen, Xiangyue Zeng, Ming Liu 0001 |
ACM Trans. Embed. Comput. Syst. | 4 |
| 2023 | Reinforcement Learning-Assisted Management for Convertible SSDsabstractConvertible SSDs, which allow flash cells to convert between different types of flash cells (e.g., SLC/MLC/TLC/QLC), are designed for achieving both high performance and high density. However, previous designs with two types of flash cells encounter a performance cliff degradation once the flash cells of single bit mode are consumed. In this work, we propose a novel level-based convertible SSD (e.g., including SLC-MLC-QLC), named RL-cSSD, that adopts an intermediate layer (e.g., MLC) as a performance cushion. A reinforcement learning-assisted device management scheme is designed to coordinate the data allocation, garbage collection and flash conversion processes considering both the SSD internal status and workload patterns. We evaluated RL-cSSD with various real-world workloads based on simulation. The experimental results show that the proposed RL-cSSD provides 72.98% higher performance on average compared with state-of-the-art schemes. Zhiping Jia, Mengying Zhao, Zhaoyan Shen, Bingzhe Li |
DAC | 5 |
| 2023 | MDCF: Multiple Dynamic Cuckoo Filters for LSM-Tree
Xingfei Yao, Taotao Xie, Zhaoyan Shen, Xiaojun Cai |
ICA3PP (6) | 4 |
| 2023 | Analysis of Augmentations in Contrastive Learning for Parkinson's Disease Diagnosis
Shuangyi Wang, Tianren Zhou, Zhaoyan Shen, Zhiping Jia |
ICANN (4) | 3 |
| 2023 | Runtime Row/Column Activation Pruning for ReRAM-based Processing-in-Memory DNN AcceleratorsabstractResistive random access memory (ReRAM)-based processing-in-memory (PIM) DNN accelerators have shown great potential in improving model efficiency and saving energy. To further improve memory and computation efficiency, model weight sparsity has been widely explored in ReRAM-based accelerator designs. However, these optimized accelerators rarely touched the model activation sparsity. In this paper, we observe that there exist plenty sparse rows/columns in the DNN model activation matrix which have negligible effect on accuracy, termed as insensitive rows/columns. Pruning them has little impact on model accuracy but would have significant potential to improve the performance and energy efficiency of DNN accelerators. Therefore, we propose a new ReRAM-based PIM accelerator, named as RapPIM, to take advantage of the model activation sparsity. In RapPIM, we first propose an insensitive activation rows/columns pruning method to search and prune the insensitive rows/columns. Then, we present an activation low-bits skipping strategy and a forward propagation delay hiding strategy to further improve model performance and minimize the latency of activation pruning on forward propagation. Our evaluations with several well-known DNN models show that the RapPIM achieves up to 2.40× speedup and 44.82% power reduction compared with the state-of-the-art ReRAM-based accelerator. Xikun Jiang, Zhaoyan Shen, Siqing Sun, Ping Yin, Zhiping Jia, Lei Ju 0001, Zhiyong Zhang 0006, Dongxiao Yu |
ICCAD | 2 |
| 2023 | PRAP-PIM: A weight pattern reusing aware pruning method for ReRAM-based PIM DNN acceleratorsabstractResistive Random-Access Memory (ReRAM) based Processing-in-Memory (PIM) frameworks are proposed to accelerate the working process of DNN models by eliminating the data movement between the computing and memory units. To further mitigate the space and energy consumption, DNN model weight sparsity and weight pattern repetition are exploited to optimize these ReRAM-based accelerators. However, most of these works only focus on one aspect of this software/hardware co-design framework and optimize them individually, which makes the design far from optimal. In this paper, we propose PRAP-PIM, which jointly exploits the weight sparsity and weight pattern repetition by using a weight pattern reusing aware pruning method. By relaxing the weight pattern reusing precondition, we propose a similarity-based weight pattern reusing method that can achieve a higher weight pattern reusing ratio. Experimental results show that PRAP-PIM achieves 1.64× performance improvement and 1.51× energy efficiency improvement in popular deep learning benchmarks, compared with the state-of-the-art ReRAM-based DNN accelerators. Zhaoyan Shen, Jinhao Wu, Xikun Jiang, Yuhao Zhang 0006, Lei Ju 0001, Zhiping Jia |
High Confid. Comput. | 1 |
| 2023 | ChainKV: A Semantics-Aware Key-Value Store for Ethereum SystemabstractThe Log-Structure Merged tree (LSM-tree) based key-value (KV) store has been widely adopted as the storage engine for blockchain systems, such as Ethereum, in which blockchain data are uniformly transformed into randomly distributed KV items for persistence. However, blockchain semantics are ignored during this process, making the blockchain storage suffer from heavy read/write amplification problems. Moreover, as the Ethereum network scales up, tremendous data further exacerbates its storage burden. Until now, most studies have focused on sharding, data archiving, decentralized distributed storage, etc., to mitigate the burden of the storage layer. However, the incompatibility between Ethereum semantics and the characteristics of the storage engine is ignored. In this paper, we present ChainKV, a new semantics-aware storage paradigm to improve the storage management performance for the Ethereum system. Firstly, based on Ethereum blockchain semantics, ChainKV separately stores different types of data in multiple storage zones in the KV store to mitigate the read/write amplification problem. Secondly, following the mechanism of the verification process in the authenticated data structure (ADS), a new ADS data transformer is proposed to exploit the data locality when persisting ADS. Moreover, a new space gaming caching policy is adopted to coordinate the cache space management for two independent storage zones. Finally, we propose an optional lightweight node crash recovery mechanism to eliminate functional redundancy between the Ethereum protocol and the storage engine. The experimental results indicate that ChainKV outperforms the prior Ethereum systems by up to 1.99× and 4.20× for synchronization and query operations, respectively Bingzhe Li, Xiaojun Cai, Zhiping Jia, Lei Ju 0001, Zili Shao, Zhaoyan Shen |
Proc. ACM Manag. Data | 7 |
| 2023 | EmPointMovSeg: Sparse Tensor-Based Moving-Object Segmentation in 3-D LiDAR Point Clouds for Autonomous Driving-Embedded SystemabstractObject segmentation is a per-pixel label prediction task that targets at providing context analysis for autonomous driving. Moving-object segmentation (MOS) serves as a subbranch of object segmentation, targeting to separating the surrounding objects into binary options: dynamic and static. MOS is vital for the safety-critical task in autonomous driving because dynamic objects are often a true potential threat to self-driving cars compared to static ones. Current methods typically address the MOS problem as a category feature to label the mapping task, which is not rational in reality. For example, a parking car should be considered as static instead of a moving-object category. There is a little systematic theory to differentiate object moving characteristics from nonmoving characteristics in MOS. Furthermore, restricted by limited resources in the embedded system, MOS is often in an offline manner due to huge computational requirements. An online and low computational cost MOS is an urgent demand for the practical safety-critical mission which takes immediate reaction as compulsory. In this article, we propose EmPointMovSeg, an efficient and practical 3-D LiDAR MOS solution for autonomous driving. Leveraging the power of the well-adapted autoregressive system identification (AR-SI) theory, EmPointMovSeg theoretically explains the moving-object feature in large-scale 3-D LiDAR semantic segmentation. An end-to-end sparse tensor-based CNN which balances segmentation accuracy and online process ability is proposed. We construct our experiment on both representative dataset benchmarks and practical embedded systems. The evaluation result shows the effectiveness and accuracy of our proposed solution, conquering the bottleneck in the online large-scale 3-D LiDAR semantic segmentation. Zhijian He, Xueli Fan, Zhaoyan Shen, Jianhao Jiao, Ming Liu 0001 |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 4 |
| 2023 | A Multiagent Reinforcement Learning-Assisted Cache Cleaning Scheme for DM-SMRabstractTo support nonsequential writes, persistent cache (PC) is constructed in drive managed SMR (DM-SMR) drive. However, PC cleaning introduces drastic performance degradation and enlarges tail latencies. In this article, we propose to utilize reinforcement learning (RL) to mitigate the long-tail latency of PC cleaning. Our scheme uses the lightweight$Q$-learning method to monitor and learn the idle time of I/O workloads, based on which PC cleaning is intelligently guided, thus maximally exploit idle time between requests and hiding tail latency from normal requests. In addition, a multiagent RL scheme with clustering algorithm is adopted to further mitigate the tail latencies and adapt to variable workloads. We emulate a DM-SMR drive inside a Linux device driver to implement our proposed scheme. According to the experimental results, our scheme can effectively reduce the tail latency by 59.45% at the 99.9th percentile and the average latency by 48.75% compared with a typical shingled magnetic recording (SMR) design. Zhaoyan Shen, Yungang Pan, Yuhao Zhang 0006, Zhiping Jia, Xiaojun Cai, Bingzhe Li, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 1 |
| 2022 | Work-in-Progress: ExpCache: Online-Learning based Cache Replacement Policy for Non-Volatile MemoryabstractAs emerging memory technologies (e.g., non-volatile memory (NVM)) coming out and machine learning algorithms successfully applying to different fields, the potentials of cache replacement policy for NVM-based systems with the integration of machine learning algorithms are worthy of being exploited to improve the performance of computer systems. In this work, we proposed a machine learning based cache replacement algorithm, named ExpCache, to improve the system performance with NVM as the main memory. By considering the non-volatility characteristic of the NVM devices, we split the whole NVM into two caches, including a read cache and a write cache, for retaining different types of requests. The pages in each cache are managed by both LRU and LFU policies for balancing the recency and frequency of workloads. The online Expert machine learning algorithm is responsible for selecting a proper policy to evict a page from one of the caches based on the access patterns of workloads. In experimental results, the proposed ExpCache outperforms previous studies in terms of hit ratio and the number of dirty pages written back to storage. Jinfeng Yang, Bingzhe Li, Zhaoyan Shen, David Hung-Chang Du, David J. Lilja |
CASES | 4 |
| 2022 | Removing Double-Logging with Passive Data Persistence in LSM-tree based Relational Databases
Kecheng Huang, Zhaoyan Shen, Zhiping Jia, Zili Shao, Feng Chen 0005 |
FAST | 2 |
| 2022 | Re-LSM: A ReRAM-Based Processing-in-Memory Framework for LSM-Based Key-Value StoreabstractLog-structured merge (LSM) tree based key-value (KV) stores organize writes into hierarchical batches for high-speed writing. However, the notorious compaction process of LSM-tree severely hurts system performance. It not only involves huge I/O operations but also consumes tremendous computation and memory resources. In this paper, first we find that when compaction happens in the high levels (i.e., L0, L1) of the LSM-tree, it may saturate all system computation and memory resources, and eventually stall the whole system. Based on this observation, we present Re-LSM, a ReRAM-based Processing-in-Memory (PIM) framework for LSM-based Key-Value Store. Specifically, in Re-LSM, we propose to offload certain computation and memory-intensive tasks in the high levels of the LSM-tree to the ReRAM-based PIM space. A high parallel ReRAM compaction accelerator is designed by decomposing the three-phased compaction into basic logic operating units. Evaluation results based on db_bench and YCSB show that Re-LSM achieves 2.2× improvement on the throughput of random writes compared to RocksDB, and the ReRAM-based compaction accelerator speedups the CPU-based implementation by 64.3× and saves 25.5× energy. Zhaoyan Shen, Yiheng Tong, Zhiping Jia, Lei Ju 0001, Jiezhi Chen, Bingzhe Li |
ICCAD | 2 |
| 2022 | CNN Acceleration with Joint Optimization of Practical PIM and GPU on Embedded DevicesabstractThe lightweight AI models are proposed for embedded devices to mitigate computation and memory requirements. However, it still faces the memory wall problem (i.e., data movement between computing units and memory). Many processing-in-memory (PIM) based accelerators have been proposed to conquer this problem. Whereas, in practical deployment, there are still many challenges that need to be addressed.In this paper, we propose an embedded GPU-PIM integrated framework, with a fabricated HBM-PIM device from Samsung, to accelerate lightweight CNN inference. Considering various characteristics of different layers in lightweight CNNs, we first propose a fine-grained roofline model to guide the layer offloading to PIM cores. To fully utilize the computation and bandwidth resources of both GPU and PIM, we model the task allocation into a multi-dimensional knapsack problem (MDKP), which is addressed by a dynamic programming algorithm. Meanwhile, considering some practical issues such as PIM mode switch and memory address interleaving during the offloading, we further introduce a PIM-aware memory layout optimization strategy to reduce unnecessary inter-channel memory accesses and PIM mode switches. Experiment results show that our proposed framework achieves averagely the 5.9X and 37.9% inference performance boosts compared to the original GPU-only approach and the GPU-HBM approach, respectively. Tianyu Wang 0009, Zhaoyan Shen, Zili Shao |
ICCD | 2 |
| 2022 | An old friend is better than two new ones: dual-screen AndroidabstractDual-screen foldable Android smartphones such as Microsoft Surface Duo are emerging. However, due to its internal design, the Android framework cannot support combined mode, by which two screens can be integrated into one, without modifications, thus requiring new display management. Android introduces a new dual-screen display method, called presentation class, to handle this problem; however, existing apps need to be redesigned based on the new class. In this paper, we propose Dual-Screen Android (DSA), a semantics-aware display scheme for dual-screen foldable Android smartphones. DSA is transparent to apps, thus requiring no changes for existing apps, and incurs minimum modification to the Android framework. Specifically, inside Android, DSA duplicates and maps single-screen views provided by apps to dual screens and maps input events backward correspondingly, thus being transparent to apps. DSA also opens the door to store other hardware states (e.g., screen brightness, screen-touch events, etc.), which can be utilized to bridge other software/hardware semantic gaps for further system optimization. To demonstrate this, we design an effective Q-learning energy optimization scheme within DSA to control screen brightness based on predicted users' behaviors. We have implemented DSA based on Android 10 with real hardware and conducted a series of experiments. Experimental results show that based on DSA, without any modifications, existing apps can directly run and fully exploit dual screens with negligible time and memory overheads, and our energy optimization scheme can effectively reduce energy. We have released the open-source code of DSA for public access. Zizhan Chen, Siqi Shang, Qihong Wu, Jin Xue, Zhaoyan Shen, Zili Shao |
LCTES | 5 |
| 2022 | Co-mining: a processing-in-memory assisted framework for memory-intensive PoW accelerationabstractRecently, HBM (High Bandwidth Memory) and PIM (Processing in Memory) integrated technology such as Samsung function-in-memory DRAM opens a new door for memory-intensive PoW acceleration by jointly exploiting GPU, PIM and HBM. In this paper, we for the first time propose a GPU/PIM Co-Mining framework to accelerate memory intensive PoW by fully exploiting HBM-PIM's bandwidth and coordinately scheduling mining tasks in both GPU and PIM. Specifically, we first design a linear programming model to intelligently guide the GPU/PIM task scheduling. An extended finite-state-machine model is designed for the GPU memory controller to switch PIM working mode (compute/memory mode) accordingly. Finally, considering the speed difference between intra-/inter-channel memory accesses, a hybrid memory access method is proposed to minimize inter-channel data movements. We evaluate Co-Mining based on Samsung's HBM2-based function-in-memory architecture. The experimental results show that it can achieve up to 38.5% hashrate improvement compared with the method by directly integrating PIM into PoW acceleration with GPU. Tianyu Wang 0009, Zhaoyan Shen, Zili Shao |
LCTES | 2 |
| 2022 | ISKEVA: in-SSD key-value database engine for video analytics applicationsabstractKey-value databases are widely used to store the features or metadata generated from the neural network based video processing platforms. Due to the large volumes of video data, these databases use solid state drives (SSDs) as the primary data storage platform, and user query-based filtering, and retrieval operations on data incur large volume of data movement between the SSD and the host processor. In this paper, we present an in-SSD key-value database which uses the embedded CPU core, and DRAM memory on the SSD to support various queries with predicates and reduce the data movement between SSD and host processor significantly. We augment the SSD flash translation layer with key-value database functions and auxiliary data structures to support the user queries using the embedded core and DRAM memory on SSD. The proposed key-value store prototype on the Cosmos plus OpenSSD board reduces data movement between host processor and SSD by 14.57x, achieves an application-level speedup by 1.16x, and reduced energy consumption by 56% across different types of user queries. Joshua Fixelle, Nagadastagiri Challapalle, Pingyi Huo, Zhaoyan Shen, Zili Shao, Mircea R. Stan, Narayanan Vijaykrishnan |
LCTES | 5 |
| 2022 | Understanding Characteristics and System Implications of DAG-Based Blockchain in IoT EnvironmentsabstractBlockchain is starting to be deployed in the Internet of Things (IoT) to enable autonomous device-to-device transactions. However, traditional block-based blockchain techniques, such as Bitcoin and Ethereum, are not suitable for IoT environments due to their low throughput, high computation overhead, and costly transaction fee. To satisfy the requirements of IoT environments, directed-acyclic-graph (DAG)-based approaches, aiming to provide cheap blockchain services with low latency and high throughput, are emerging. This article presents a set of comprehensive experimental studies on IOTA, a representative DAG-based blockchain. We aim to exhibit its unique characteristics mainly from three aspects: 1) performance; 2) security; and 3) system robustness. We have developed a series of benchmark tools and judiciously selected typical configurations to perform experimental examinations with a real private IOTA network. Our studies reveal several interesting findings: 1) the throughput of IOTA is higher than the traditional block-based blockchain but far less than the reported thousands of transactions per second (TPS) in its whitepaper, even with scaling-up configurations; 2) the database query heavily impacts the performance of IOTA, even more than its mining [i.e., Proof of Work (PoW)] process; and 3) the system robustness of IOTA is closely related to the frequency of the incoming transactions while the milestone sent by the centralized coordinator has little effect on the system robustness. We make our benchmark tools public and expect our works can inspire system architects, application designers, and practitioners with new optimization directions and potential application cases for further exploration. Tianyu Wang 0009, Qian Wang 0042, Zhaoyan Shen, Zhiping Jia, Zili Shao |
IEEE Internet Things J. | 3 |
| 2022 | PQ-PIM: A pruning-quantization joint optimization framework for ReRAM-based processing-in-memory DNN accelerator
Yuhao Zhang 0006, Xikun Jiang, Zhaoyan Shen, Zhiping Jia |
J. Syst. Archit. | 5 |
| 2022 | ELOFS: An Extensible Low-Overhead Flash File System for Resource-Scarce Embedded DevicesabstractEmerging applications like machine learning in embedded devices (e.g., satellites and vehicles) require huge storage space, which recently stimulates the widespread deployment of large-scale flash memory in IoT devices. However, existing embedded file systems fall short in managing large-capacity storage efficiently for two reasons. First, prior arts store data structures of file systems either in flash or in main memory, which severely magnifies the scarcity of computing and memory resources. Moreover, the fine-grained metadata management in the existing embedded file systems induces significant energy consumption for large-capacity storage. In this paper, we propose a novel embedded file system, ELOFS, to tackle the above issues and manage large-capacity NAND flash on resource-scarce devices. ELOFS is made efficient through three novel techniques. First, we redefine the space management granularity and streamline the metadata to speed up the mounting performance. In addition, we design hybrid file structures to adapt dissimilar access patterns of embedded devices. Furthermore, ELOFS provides opportunities for in-depth cooperation with application-specific systems. We implement ELOFS with Memory Technology Device (MTD) interfaces, and the experimental results show that ELOFS outperforms YAFFS and UBIFS in terms of write, read, and deletions with orders of magnitude reductions on memory footprint and mounting time. Runyu Zhang 0002, Duo Liu 0002, Xianzhang Chen, Xiongxiong She, Chaoshu Yang, Yujuan Tan, Zhaoyan Shen, Zili Shao, Lei Qiao 0002 |
IEEE Trans. Computers | 7 |
| 2022 | Rebirth-FTL: Lifetime Optimization via Approximate Storage for NAND Flash MemoryabstractThe lifetime of NAND flash cells significantly degrades with feature-size reductions and multilevel cell technology. On the other hand, we have more and more approximate data, such as images and videos that are more error tolerant than regular data like text. In this article, we propose Rebirth-FTL, which reuses faulty blocks that contain uncorrectable errors to store approximate data for lifetime optimization. Rebirth-FTL effectively manages two spaces, namely, the approximate space and the normal space, with an efficient address translator, a coordinated garbage collection, and a differential wear leveler. In addition, we develop an migration times restriction (MTR) policy to restrict the movement of the approximate data in the approximate space. We also develop a scheme to pass approximate information from userland to kernel space in Linux. Finally, a lifetime model is presented for lifetime analysis. Our experimental results show that Rebirth-FTL can extend the lifetime by 41.63% on average. Chenlin Ma, Zhuokai Zhou, Zhaoyan Shen, Yi Wang 0003, Renhai Chen, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 4 |
| 2022 | Prism-SSD: A Flexible Storage Interface for SSDsabstractThe rapid adoption of solid-state drives (SSDs) as a major storage component has been made possible, thanks to their ability to export a standard block I/O interface to the file system and application developers. Meanwhile, this high-level abstraction has been shown to limit the utilization of the devices and the performance of applications running on top of them. Indeed, many optimizations of performance-critical applications bypass the standard block interface and rely on low-level control over SSD internal processes. However, the need to directly manage the physical device significantly increases development complexity and cost, and reduces its portability. Thus, application developers must choose between two extreme options, eithereasy developmentoroptimal performance, without a real possibility to balance between these two objectives. To bridge this gap, we propose aflexible storage interfacethat exports the SSD hardware in three levels of abstraction: 1) as a raw flash media with its low-level details; 2) as a group of functions to manage flash capacity; or 3) as a configurable block device. This multilevel abstraction allows developers to choose the degree in which they desire to control the flash hardware in a manner that best suits the applications’ semantics and performance objectives. We demonstrate the usability of this new model withPrism-SSD—a prototype of this interface as a user-level library on the Open-Channel SSD platform. We use each of the interface’s three abstraction levels to modify the I/O module of three representative applications: 1) a key-value cache system; 2) a user-level file system; and 3) a graph processing engine. Prism-SSD improves application performance by 5%–27%, at varying development costs, between 200 and 3500 lines of code. Zhaoyan Shen, Feng Chen 0005, Gala Yadgar, Zhiping Jia, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 1 |
| 2022 | A Practical Highly Paralleled ReRAM-Based DNN Accelerator by Reusing Weight Pattern RepetitionsabstractResistive random access memory (ReRAM)-based processing-in-memory (PIM) architecture has been designed to accelerate deep neural networks (DNNs) by concurring computation and memory barriers. To further improve memory and computation efficiency, the weight sparsity characteristic has been explored to optimize the ReRAM-based DNN accelerators. However, these designs only focus on compressing zero weights to eliminate ineffectual computation. In this article, we thoroughly analyze the weight distribution characteristics of several typical DNN models and observe many nonzero weight pattern repetitions (WPRs). Therefore, there is an opportunity to further improve the performance and energy efficiency by reusing these WPR. We propose a novel ReRAM-based accelerator—PattPIM, to achieve space compression and computation reuse by exploring DNN WPR based on practical ReRAM crossbars. In PattPIM, we propose a configurable WPR-aware DNN engine and a WPR-to-OU mapping scheme to save both space and computation resources. An intraprocessing engine (PE) pipeline is designed to improve the parallelism of the computation process. Furthermore, we adopt an approximate weight pattern transform algorithm to improve the DNN WPR ratio to enhance the reuse efficiency with negligible accuracy loss. Our evaluation with 6 DNN models shows that the proposed PattPIM delivers significant performance improvement, ReRAM resource efficiency and energy saving. Yuhao Zhang 0006, Zhiping Jia, Hongchao Du, Runzhen Xue, Zhaoyan Shen, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 5 |
| 2022 | A Survey of Blockchain Data Management SystemsabstractBlockchain has been widely deployed in various fields, such as finance, education, and public services. Blockchain has decentralized mechanisms with persistency and auditability and runs as an immutable distributed ledger, where transactions are jointly performed through cryptocurrency-based consensus algorithms by worldwide distributed nodes. There have been many survey papers reviewing the blockchain technologies from different perspectives, e.g., digital currencies, consensus algorithms, and smart contracts. However, none of them have focused on the blockchain data management systems. To fill in this gap, we have conducted a comprehensive survey on the data management systems, based on three typical types of blockchain, i.e., standard blockchain, hybrid blockchain, and DAG ( Directed Acyclic Graph )-based blockchain. We categorize their data management mechanisms into three layers: blockchain architecture, blockchain data structure, and blockchain storage engine, where block architecture indicates how to record transactions on a distributed ledger, blockchain data structure refers to the internal structure of each block, and blockchain storage engine specifies the storage form of data on the blockchain system. For each layer, the works advancing the state-of-the-art are discussed together with technical challenges. Furthermore, we lay out several possible future research directions for the blockchain data management systems. Bingzhe Li, Wanli Chang 0001, Zhiping Jia, Zhaoyan Shen, Zili Shao |
ACM Trans. Embed. Comput. Syst. | 5 |
| 2021 | Reinforcement Learning-Assisted Cache Cleaning to Mitigate Long-Tail Latency in DM-SMRabstractDM-SMR adopts Persistent Cache (PC) to accommodate non-sequential write operations. However, the PC cleaning process induces severe long-tail latency. In this paper, we propose to mitigate the tail latency of PC cleaning by using Reinforcement Learning (RL). Specifically, a real-time lightweight Q-learning model is built to analyze the idle window of I/O workloads, based on which PC cleaning is judiciously scheduled, thereby maximally utilizing the I/O idle window and effectively hiding the tail latency from regular requests. We implement our technique inside a Linux device driver with an emulated SMR drive. Experimental results show that our technique can reduce the tail latency by 57.65% at 99.9th percentile and the average response time by 46.11% compared to a typical SMR design. Yungang Pan, Zhiping Jia, Zhaoyan Shen, Bingzhe Li, Wanli Chang 0001, Zili Shao |
DAC | 3 |
| 2021 | Accelerating DCNNs via Cooperative Weight/Activation Compression
Yuhao Zhang 0006, Xikun Jiang, Yudong Pan, Pusen Dong, Zhaoyan Shen, Zhiping Jia |
ICA3PP (3) | 7 |
| 2021 | Block-LSM: An Ether-aware Block-ordered LSM-tree based Key-Value Storage EngineabstractEthereum as one of the largest blockchain systems plays an important role in the distributed ledger, database systems, etc. As more and more blocks are mined, the storage burden of Ethereum is significantly increased. The current Ethereum system uniformly transforms all its data into key-value (KV) items and stores them to the underlying Log-Structure Merged tree (LSM-tree) storage engine ignoring the software semantics. Consequently, it not only exacerbates the write amplification effect of the storage engine but also hurts the performance of Ethereum. In this paper, we proposed a new Ethereum-aware storage model called Block-LSM, which significantly improves the data synchronization of the Ethereum system. Specifically, we first design a shared prefix scheme to transform Ethereum data into ordered KV pairs to alleviate the key range overlaps of different levels in the underlying LSM-tree based storage engine. Moreover, we propose to maintain several semantic-orientated memory buffers to isolate different kinds of Ethereum data. To save space overhead, Block-LSM further aggregates multiple blocks into a group and assigns the same prefix to all KV items from the same block group. Finally, we implement Block-LSM in the real Ethereum environment and conduct a series of experiments. The evaluation results show that Block-LSM significantly reduces up to 3.7× storage write amplification and increases throughput by 3× compared with the original Ethereum design. Bingzhe Li, Xiaojun Cai, Zhiping Jia, Zhaoyan Shen, Yi Wang 0003, Zili Shao |
ICCD | 5 |
| 2021 | Less is More: De-amplifying I/Os for Key-value Stores with a Log-assisted LSM-treeabstractIn recent years, Log-Structured Merge Tree (LSMtree) based key-value stores, such as LevelDB and RocksDB, have been widely adopted in data center systems. Though optimized for high-speed write processing, the severe I/O amplification remains a critical constraint that hinders them from reaching their maximum performance potential. Unfortunately, this problem is deeply rooted in the fundamental design of the LSMtree structure. A small number of frequently updated key-value items could quickly pollute the entire tree structure, causing repeated changes in the structure and quickly amplifying the amount of disk IOs across the levels in the tree. In this paper, we present a novel scheme, called Log-assisted LSM-tree (L2SM), to fundamentally address the long-existing I/O amplification problem. L2SM adopts a small-size, multi-level log structure to isolate selected key-value items that have a disruptive effect on the tree structure, accumulates and absorbs the repeated updates in a highly efficient manner, and removes obsolete and deleted key-value items at an early stage. We have prototyped the L2SM structure based on LevelDB. Our evaluation with the YCSB benchmark shows promising results by reducing the amount of disk IOs by up to 40.2%, increasing the throughput by up to 67.4%, and decreasing the average latency by up to 40.1%. Kecheng Huang, Zhiping Jia, Zhaoyan Shen, Zili Shao, Feng Chen 0005 |
ICDE | 3 |
| 2021 | DAP-Sketch: An accurate and effective network measurement sketch with Deterministic Admission Policy
Rui Wang 0075, Hongchao Du, Zhaoyan Shen, Zhiping Jia |
Comput. Networks | 3 |
| 2021 | A lightweight online backup manager for energy harvesting powered nonvolatile processor systemsabstractWith the explosive growth of battery-free and energy-harvesting devices, the energy harvesting powered system has gained more attentions and been widely used in different fields. However, unstable harvested energy is a challenge of energy-harvesting devices since the program execution would be interrupted frequently. Non-volatile processor (NVP) is proposed to back up volatile logics before energy depletion and recover the system status after energy resumption . This paper takes the challenge of forward progress improvement issue in NVP system and proposes a lightweight online backup strategy which tries to aggressively use energy in capacitor after receiving energy warnings. We also build a flexible and accurate simulation tool for NVP system evaluation. The experimental results show an average of 24.2% and 13.7% improved forward progress compared with instant backup method and the most related work, respectively. Weining Song, Xiaojun Cai, Mengying Zhao, Zhaoyan Shen, Zhiping Jia |
J. Syst. Archit. | 4 |
| 2021 | An efficient highly parallelized ReRAM-based architecture for motion estimation of HEVC
Yuhao Zhang 0006, Zhiping Jia, Renhai Chen, Zhaoyan Shen |
J. Syst. Archit. | 5 |
| 2021 | Tiler: An Autonomous Region-Based Scheme for SMR StorageabstractShingled Magnetic Recording (SMR) Disks are adopted as a high-density, non-volatile media that significantly precedes conventional disks in both the storage capacity and cost. However, inefficient read-modify-writes (RMWs) greatly challenge the management of SMR disks. This article for the first time presents an approach called Tiler to manage SMR disks by dividing the physical space into small autonomous regions (ARs). Each AR can manage its space allocation, address mapping, and cleaning independently. By managing these ARs in a log-structured way, RMWs can be avoided; besides, ARs can also help update data when the adjacent tracks contain no valid data. Tiler is capable of partitioning a large-scale cleaning into self-contained-small-scale cleaning and thus, the data that need to be relocated are limited inside independent ARs, which further minimizes the performance overhead. Our experimental results show that Tiler can shorten the overall system response time by 50.21 percent and reduce the cleaning time by 90.24 percent on average. Chenlin Ma, Zhaoyan Shen, Yi Wang 0003, Renhai Chen, Zili Shao |
IEEE Trans. Computers | 2 |
| 2021 | Leveraging the Interplay of RAID and SSD for Lifetime Optimization of Flash-Based SSD RAIDabstractFlash-based SSD RAID arrays are increasingly being deployed in data centers. Compared with HDD arrays, SSD arrays drastically enhance I/O performance and density, and reduce power, cooling, and rack space. Nevertheless, SSDs suffer aging issues. Especially, an SSD has limited endurance and needs to be replaced when it reaches to the end of its lifetime. Although prior studies have been conducted to address this disadvantage, effective techniques of RAID/SSD controllers are urgently needed to extend the lifetime of SSD arrays. In this article, we propose a novel RAID architecture, called FreeRAID, to leverage the interplay of RAID and SSD controllers to optimize the lifespan of flash-based SSD arrays. FreeRAID adds a new exploitable phase to the life cycle of flash blocks. In FreeRAID, flash space is separated into normal space and exploitable space, and they are used to serve normal data and approximate data, respectively. We design a dual-space management scheme for RAID controllers to intelligently allocate SSD spaces based on their aging status. Inside an SSD, we propose an adaptive flash translation layer for the SSD controller to maintain the reliability and space efficiency of flash memories. We implemented a prototype of FreeRAID based on an SSD array simulator. Our experiments show that FreeRAID can significantly increase the lifetime by up to 3.07 × compared with conventional SSD-based RAID arrays. Zhaoyan Shen, Chenlin Ma, Zhiping Jia, Tao Li 0006, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 1 |
| 2021 | Bridging Mismatched Granularity Between Embedded File Systems and Flash MemoryabstractThe mismatch between logical and physical I/O granularity inhibits the deployment of embedded file systems. Most existing embedded file systems manage logical space with a small unit, which is no longer the case of the flash operation granularity. Manually enlarging the logical I/O granularity of file systems requires enormous transplanting efforts. Moreover, large logical pages signify the write amplification problem, which turns to severe space consumption and performance collapse. This article designs a novel storage middleware, NV-middle, for legacy-embedded file systems with large-capacity flash memories. Legacy-embedded storage schemes can be smoothly transplanted into new platforms with different hardware read/write granularity. Moreover, the legacy optimization schemes can be maximally reserved, without inducing write amplification problems. We implement NV-middle with the state-of-the-art embedded file system, YAFFS2. Comprehensive evaluations show that NV-middle can achieve times of performance improvement over manually transplanted YAFFS2 with various workloads. Runyu Zhang 0002, Duo Liu 0002, Zhaoyan Shen, Xiongxiong She, Chaoshu Yang, Xianzhang Chen, Yujuan Tan, Chengliang Wang 0002 |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 3 |
| 2021 | Pearl: Performance-Aware Wear Leveling for Nonvolatile FPGAsabstractSince static random access memory (SRAM)-based field-programmable gate array (FPGA) has limited density and comparatively high leakage power, researchers have proposed FPGA architectures based on emerging nonvolatile memories (NVMs) to satisfy the requirements of data-intensive and low-power applications. Among all components, block random access memory (BRAM) has the severest endurance problem in FPGA. Unluckily, traditional wear leveling (TWL) strategies cannot be directly applied to nonvolatile FPGA because it may induce large performance overhead. In this article, we propose performance-aware wear leveling schemes for nonvolatile FPGA to improve its lifetime. Two strategies pertaining to coarse-grained wear leveling (C-Pearl) and fine-grained wear leveling (F-Pearl) are developed to balance inter-BRAM and intra-BRAM writes. Procedures, including static analysis, wear leveling-guided placement, and reconfiguration are discussed. A supportive circuit design is proposed, too. The evaluation shows that C-Pearl and F-Pearl can achieve 34% and 46% higher lifetime improvement and simultaneously 8% and 11% lower performance overhead than TWL. Mengying Zhao, Zhaoyan Shen, Xiaojun Cai, Zhiping Jia |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 4 |
| 2020 | KFR: Optimal Cache Management with K-Framed Reclamation for Drive-Managed SMR DisksabstractShingled Magnetic Recording (SMR) disks have been proposed as a promising solution to satisfy the increasing capacity need in the big data era. Drive-Managed SMR (DM-SMR) disk which acts as a traditional block device is favored for providing high compatibility. However, DM-SMR disks suffer from high performance recovery time (PRT) due to the "SMR space reclamation" issue. This paper proposes an optimal cache management named K-Framed Reclamation (KFR) to minimize PRT within the DM-SMR disk. The effectiveness of our proposed design was evaluated with realistic and intensive I/O workloads and the results are encouraging. Chenlin Ma, Yi Wang 0003, Zhaoyan Shen, Zili Shao |
DAC | 3 |
| 2020 | PattPIM: A Practical ReRAM-Based DNN Accelerator by Reusing Weight Pattern RepetitionsabstractWeight sparsity has been explored to achieve energy efficiency for Resistive Random-access Memory (ReRAM) based DNN accelerators. However, most existing ReRAM-based DNN accelerators are based on an overidealized crossbar architecture and mainly focus on compressing zero weights. In this paper, we propose a novel ReRAM-based accelerator — PattPIM, to achieve space compression and computation reuse by studying DNN weight patterns based on practical ReRAM crossbars. We first thoroughly analyze the weight distribution characteristics of several typical DNN models and observe many non-zero weight pattern repetitions (WPRs). Thus, in PattPIM, we propose a WPR-aware DNN engine and a WPR-to-OU mapping scheme to save both space and computation resources. Furthermore, we adopt an approximate weight pattern transform algorithm to improve the DNN WPRs ratio to enhance the reuse efficiency with negligible inference accuracy loss. Our evaluation with 6 DNN models shows that the proposed PattPIM delivers significant performance improvement, ReRAM resources efficiency and energy saving. Yuhao Zhang 0006, Zhiping Jia, Yungang Pan, Hongchao Du, Zhaoyan Shen, Mengying Zhao, Zili Shao |
DAC | 5 |
| 2020 | LOFFS: A Low-Overhead File System for Large Flash Memory on Embedded DevicesabstractEmerging applications like machine learning in embedded devices (e.g., satellite and vehicles) require huge storage space, which recently stimulates the widespread deployment of large-capacity flash memory in IoT devices. However, existing embedded file systems fall short in managing large-capacity storage efficiently for excessive memory consumption and poor booting performance. In this paper, we propose a novel embedded file system, LOFFS, to tackle the above issues and manage large-capacity NAND flash on resource-limited embedded devices. We redesign the space management mechanisms and construct hybrid file structures to achieve high performance with minimum resource occupation. We have implemented LOFFS in Linux, and the experimental results show that LOFFS outperforms YAFFS by 55.8% on average with orders of magnitude reductions on memory footprint. Runyu Zhang 0002, Duo Liu 0002, Xianzhang Chen, Xiongxiong She, Chaoshu Yang, Yujuan Tan, Zhaoyan Shen, Zili Shao |
DAC | 7 |
| 2020 | Q-learning Based Backup for Energy Harvesting Powered Embedded SystemsabstractNon-volatile processors (NVPs) are used in energy harvesting powered embedded systems to preserve data across interruptions. In NVP systems, volatile data are backed up to non-volatile memory upon power failures and resumed after power comes back. Traditionally, backup is triggered immediately when energy warning occurs. However, it is also possible to more aggressively utilize the residual energy for program execution to improve forward progress. In this work, we propose a Q-learning based backup strategy to achieve maximal forward progress in energy harvesting powered intermittent embedded systems. The experimental results show an average of 307.4% and 43.4% improved forward progress compared with traditional instant backup and the most related work, respectively. Yujie Zhang 0007, Weining Song, Mengying Zhao, Zhaoyan Shen, Zhiping Jia |
DATE | 5 |
| 2020 | Maximizing CNN Throughput on FPGA ClustersabstractField Programmable Gate Array (FPGA) platform has been a popular choice for deploying Convolutional Neural Networks (CNNs) as a result of its high parallelism and low energy consumption. Due to the limitation of on-chip resources on a single board, FPGA clusters become promising solutions to improve the throughput of CNNs. In this paper, we firstly put forward strategies to optimize the resource allocation intra and inter FPGA boards. Then we model the multi-board cluster problem and design algorithms based on knapsack problem and dynamic programming to calculate the optimal topology of the FPGA clusters. We also give a quantitative analysis of the inter-board data transmission bandwidth requirement. To make our design accommodate for more situations, we provide solutions for deploying fully connected layers and special convolution layers with large memory requirement. Experimental results show that typical well-known CNNs with the proposed topology of FPGA clusters could obtain a higher throughput per board than single-board solutions and other multi-board solutions. Ruihao Li 0002, Mengying Zhao, Zhaoyan Shen, Xiaojun Cai, Zhiping Jia |
FPGA | 4 |
| 2020 | Sequence-To-Subsequence Learning With Conditional Gan For Power DisaggregationabstractNon-intrusive load monitoring (a.k.a. power disaggregation) refers to identifying and extracting the consumption patterns of individual appliances from the mains which records the whole-house energy consumption. Recently, deep learning has been shown to be a promising method to solve this problem and many approaches based on it have been proposed. In this paper, we propose a sequence-to-subsequence learning method, which makes a trade-off between traditional sequence-to-sequence and sequence-to-point method, to balance the convergence difficulty in deep neural networks and the amount of computation in the inference period. We build our model based on conditional generative adversarial network that helps us avoid designing the loss function manually. In addition, we apply U-Net and Instance Normalization techniques to our model and demonstrate their effectiveness. Evaluations are performed on real-world data sets and we achieve the state-of-the-art performance. Yungang Pan, Zhaoyan Shen, Xiaojun Cai, Zhiping Jia |
ICASSP | 3 |
| 2020 | ABACUS: Address-partitioned Bloom filter on Address Checking for UniquenesS in IoT BlockchainabstractDAG-based blockchain systems have been deployed to enable trustworthy peer-to-peer transactions for IoT devices. Unique address checking, as a key part of transaction generation for privacy and security protection in DAG-based blockchain systems, incurs big latency overhead and degrades system throughput. Tianyu Wang 0009, Qun Ma, Zhaoyan Shen, Zili Shao |
ICCAD | 4 |
| 2020 | Optimizing Motion Estimation with an ReRAM-Based PIM Architecture
Zhaoyan Shen, Zhiping Jia, Xiaojun Cai |
WASA (1) | 2 |
| 2020 | A Highly Parallelized PIM-Based Accelerator for Transaction-Based Blockchain in IoT EnvironmentabstractBlockchain has gained a lot of attention from both academia and industry. However, traditional standard blockchains, such as Bitcoin and Ethereum, suffer from low throughput, high computation overhead, and large transaction fee, which is not suitable for Internet of Things (IoT) transactions. Recently, transaction-based approaches, such as Tangle structure which is based on a directed acyclic graph (DAG), have emerged to solve blockchain scalability issues for IoT environment. In transaction-based blockchain, for a transaction, namely, a node, to be attached to the Tangle, it needs to verify two other transactions. However, with the Tangle expanding, this attaching process consumes huge computational resources and energy, which severely limits the performance of the transaction-based blockchain. In this article, we present Re-Tangle, a highly parallelized processing-in-memory (PIM)-based accelerator for transaction-based blockchain. Re-Tangle is composed of a random walking module, a transaction validation module, and a PoW module, to improve the Tangle system performance. These modules transfer Tangle functions, such as fast exponentiation and modular, into ReRAM-based logic analog computation units. In the random walking module, Re-Tangle maintains an exponentiation table to reduce its design complexity and improve its computation efficiency. In the transaction validation module, Re-Tangle further proposes a highly parallel modular unit to accelerate the validation of different tags in a transaction. In the PoW module, we decompose the Curl hash function into basic logic OR, AND, SHIFT, and XOR operations, and map these logic operations to ReRAM crossbars in parallel to accelerate the working process. The experimental results show that Re-Tangle distinguishes itself from other architectures with significant performance improvement and energy saving. The throughput of Re-Tangle is about 22.4× and 2.38× higher compared with CPU and GPU, respectively, and the energy consumption of Re-Tangle is 83.5× and 5.77× less for equal workload. Qian Wang 0042, Zhiping Jia, Tianyu Wang 0009, Zhaoyan Shen, Mengying Zhao, Renhai Chen, Zili Shao |
IEEE Internet Things J. | 4 |
| 2020 | An Efficient Directory Entry Lookup Cache With Prefix-Awareness for Mobile DevicesabstractModern mobile devices, such as smartphones, maintain a directory cache (DCache) to accelerate directory and file accesses. However, the original DCache recursively walks through all the components of a path name for each directory entry (dentry) lookup operation, leading to low lookup efficiency. In this article, we first investigate intrinsic characteristics of dentry lookup operations in smartphones and make several interesting findings: 1) file path lookup operations are called frequently (up to 104times per second) by mobile applications; 2) file path lookup operations present high temporal and spatial locality; and 3) the latency of a file path lookup is linear to the depth of the path name. Based on our findings, we further propose an efficient directory entry lookup cache architecture, named dynamic skipping cache (DS-Cache), which adopts an ASCII-based hash table to simplify the path lookup complexity. In DS-Cache, a dynamic skip lookup algorithm is proposed to skip the common prefixes of different accessing paths. A rename algorithm and a delete algorithm are designed to promise the consistence of DS-Cache and the backend file system. We also design a prefix-aware cache replacement scheme to optimize the DS-Cache hit ratio. We have implemented and deployed DS-Cache on a Google Nexus 6P smartphone. The experimental results show that we can significantly reduce the latency of invoking system calls by up to 81%, and further reduce the completion time of real-world mobile applications by up to 67%. Zhaoyan Shen, Renhai Chen, Chenlin Ma, Zhiping Jia, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 1 |
| 2020 | UniBuffer: Optimizing Journaling Overhead With Unified DRAM and NVM Hybrid Buffer CacheabstractJournaling techniques play an important role in addressing the reliability issue of filesystems caused by the volatile dynamic random access memory (DRAM)-based buffer cache. However, journaling techniques introduce a large number of extra storage writes, which greatly degrades system performance, especially for mobile devices. Emerging nonvolatile memory (NVM) technologies bring a new perspective of solving the write amplification issue caused by journaling. By adopting NVM as the buffer cache, the committed data can be maintained in NVM before being written back to the storage, thus, eliminating the journaling overhead. However, simply utilizing NVM as the buffer cache suffers from the limited lifetime and the relatively longer write latency of NVM. In this paper, we present a hybrid buffer cache architecture, named UniBuffer, by combing NVM with dynamic random access memory (DRAM) to reduce the journaling overhead and overcome the inherent constraints of NVM. In UniBuffer, we first propose a journaling-aware page management (JAPM) policy to smartly allocate data to DRAM and NVM pages. JAPM puts infrequently updated data in NVM to reduce the journaling overhead and frequently updated data in DRAM to improve the write performance and lifetime of the hybrid buffer cache. In addition, since data in one journaling transaction may be dispersed in NVM and DRAM simultaneously, different committing policies are required for different storage media, respectively. In order to guarantee the atomicity of the transaction execution in the hybrid cache architecture, a partial in-place commit (PIPC) journaling scheme is proposed to coordinate different committing patterns for NVM and DRAM. We have implemented the proposed techniques on Linux 3.14.52 and measured the performance with representative I/O-intensive benchmarks. The experimental results show that our scheme effectively improves the I/O performance compared with the ext4 filesystem and prolongs the lifetime of the hybrid buffer cache compared with the union of buffer cache and journaling (UBJ) scheme. Zhiyong Zhang 0006, Zhaoyan Shen, Zhiping Jia, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 2 |
| 2020 | MNFTL: An Efficient Flash Translation Layer for MLC NAND Flash MemoryabstractThe write constraints of Multi-Level Cell (MLC) NAND flash memory make most of the existing flash translation layer (FTL) schemes inefficient or inapplicable. In this article, we solve several fundamental problems in the design of MLC flash translation layer. The objective is to reduce the garbage collection overhead to reduce the average system response time. We make the key observation that the valid pages copy is the essential garbage collection overhead. Based on this observation, we propose two approaches, namely, concentrated mapping and postponed reclamation, to effectively reduce the valid pages copy. Besides, we propose a progressive garbage collection that can well utilize the system idle time to reclaim more spaces. We conduct a series of experiments on an embedded developing board with a set of benchmarks. The experimental results show that our scheme can achieve a significant reduction in the average system response time compared with the previous work. Chenlin Ma, Yi Wang 0003, Zhaoyan Shen, Renhai Chen, Zili Shao |
ACM Trans. Design Autom. Electr. Syst. | 3 |
| 2019 | ReRAM-based processing-in-memory architecture for blockchain platformsabstractBlockchain's decentralized and consensus mechanism has attracted lots of applications, such as IoT devices. Blockchain maintains a linked list of blocks and grows by mining new blocks. However, the Blockchain mining consumes huge computation resource and energy, which is unacceptable for resource-limited embedded devices. This paper for the first time presents a ReRAM-based processing-in-memory architecture for Blockchain mining, called Re-Mining. Re-Mining includes a message schedule module and a SHA computation module. The modules are composed of several basic ReRAM-based logic operations units, such as ROR, RSF and XOR. Re-Mining further designs intra-transaction and inter-transaction parallel mechanisms to accelerate the Blockchain mining. Simulation results show that the proposed Re-Mining architecture outperforms CPU-based and GPU-based implementations significantly. Fang Wang 0012, Zhaoyan Shen, Zili Shao |
ASP-DAC | 2 |
| 2019 | DS-Cache: A Refined Directory Entry Lookup Cache with Prefix-Awareness for Mobile DevicesabstractOur modern devices are filled with files, directories upon directories. Applications generate huge I/O activities in mobile devices. Directory cache is adopted to accelerate file lookup operations in the virtual file system. However, the original directory cache recursively walks all the components of a path for each lookup, leading to inefficient lookup performance and lower cache hit ratio. In this paper, we for the first time fully investigate the characteristics of the directory entry lookup in mobile devices. Based on our findings, we further propose a new directory cache scheme, called Dynamic Skipping Cache, which adopts an ASCII-based hash table to simplify the path lookup complexity by skipping the common prefixes of paths. We also design a novel lookup scheme to optimize the directory cache hit ratio. We have implemented and deployed DS-Cache on a Google Nexus 6P smartphone. Experimental results show that we can significantly reduce the latency of invoking system calls by up to 57.4%, and further reduce the completion time of real-world mobile applications by up to 64%. Bin Xiao 0001, Xuwei Dong, Zhaoyan Shen, Zili Shao |
DATE | 4 |
| 2019 | Accurate Network Flow Measurement with Deterministic Admission Policy
Hongchao Du, Rui Wang 0075, Zhaoyan Shen, Zhiping Jia |
ICA3PP (2) | 3 |
| 2019 | Re-Tangle: A ReRAM-based Processing-in-Memory Architecture for Transaction-based BlockchainabstractBlockchain has gained a lot of attentions from both academic and industry. Transaction-based approaches such like Tangle structure, which is based on a DAG (Directed Acyclic Graph), are emerging to solve the blockchain scalability issues for IoT environment. In transaction-based blockchain, for a transaction, namely a node, to be attached to the Tangle, it needs to verify two other transactions. However, with the Tangle expanding, this attaching process consumes huge computational resources and energy, which severely limits the performance of the transaction-based blockchain. In this paper, we present Re-Tangle, a novel transaction-based blockchain acceleration architecture that explores the opportunity of performing massive parallel operations with low hardware and energy cost. Re-Tangle consists of a random walking module and a transaction validation module, which transfer Tangle functions into ReRAM-based logic analog computation units. In the random walking module, Re-Tangle maintains a exponentiation translator to reduce its design complexity and improve its computation efficiency for exponentiation. In the transaction validation module, Re-Tangle further proposes a highly parallel modular unit to accelerate the validation of different tags in a transaction. The experience results show that Re-Tangle distinguishes itself from other architectures, with significant performance improvement and energy saving. The throughput of Re-Tangle is about 19.4× and 2.13× higher compared with CPU and GPU, respectively, and the energy consumption of Re-Tangle is 63.35 × and 4.92 × less. Qian Wang 0042, Tianyu Wang 0009, Zhaoyan Shen, Zhiping Jia, Mengying Zhao, Zili Shao |
ICCAD | 3 |
| 2019 | One Size Never Fits All: A Flexible Storage Interface for SSDsabstractThe rapid adoption of solid-state drives (SSDs) as a major storage component has been made possible thanks to their ability to export a standard block I/O interface to file system and application developers. Meanwhile, this high-level abstraction has been shown to limit the utilization of the devices and the performance of applications running on top of them. Indeed, many optimizations of performance-critical applications bypass the standard block interface and rely on low-level control over SSD internal processes. However, the need to directly manage the physical device significantly increases development complexity and cost, and reduces its portability. Thus, application developers must choose between two extreme options, either easy development or optimal performance, without a real possibility to balance between these two objectives. To bridge this gap, we propose a flexible storage interface that exports the SSD hardware in three levels of abstraction: as a raw flash media with its low-level details, as a group of functions to manage flash capacity, or as a configurable block device. This multi-level abstraction allows developers to choose the degree in which they desire to control the flash hardware in a manner that best suits their applications' semantics and performance objectives. We demonstrate the usability of this new model with Prism-SSD-a prototype of this interface as a user-level library on the Open-Channel SSD platform. We use each of the interface's three abstraction levels to modify the I/O module of three representative applications: a key-value cache system, a user-level file system, and a graph processing engine. Prism-SSD improves application performance by 5% to 27%, at varying development costs, between 200 and 3,500 lines of code. Zhaoyan Shen, Feng Chen 0005, Gala Yadgar, Zili Shao |
ICDCS | 1 |
| 2019 | FC: Built-in flash cache with fast cleaning for SMR storage systems
Chenlin Ma, Zhaoyan Shen, Renhai Chen, Zili Shao |
J. Syst. Archit. | 2 |
| 2019 | DCR: Deterministic Crash Recovery for NAND Flash Storage SystemsabstractNAND flash memory has been widely adopted as the storage medium. As power failure may occur at any time and result in data loss, crash recovery becomes vitally important in NAND flash memory storage systems. Since flash translation layers (FTLs) are used to manage flash memory, the crash recovery problem in NAND flash is how to efficiently and effectively recover FTL metadata with consistency after system crash. In this paper, we present deterministic crash recovery (DCR) that adopts a deterministic approach for crash recovery in NAND flash storage systems. The basic idea is to exploit the determinism of FTLs and reproduce events that happened between the last checkpoint and the crash point during crash recovery. Different from existing approaches that need to scan the whole flash memory chip, DCR can recover the system more efficiently by only checking a limited number of blocks based on deterministic FTL operations. We have implemented DCR in an FTL and compared it with the representative version-based and power loss recovery schemes based on an ARM-based embedded system. Experimental results show that DCR can greatly reduce the recovery time and guarantee the consistency of FTL metadata after recovery. Renhai Chen, Yi Wang 0003, Zhaoyan Shen, Duo Liu 0002, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 4 |
| 2019 | Alleviating Hot Data Write Back Effect for Shingled Magnetic Recording Storage SystemsabstractShingled magnetic recording (SMR) is a novel technology that can significantly increase the disk capacity and reduce the cost. However, this new technology leads to write constraint that prohibits random writes to SMR disks. In order to solve this, current solutions utilize a persistent cache (PC) to change random writes to sequential ones. By doing this, nevertheless, the hot-data write-back effect will be triggered which inevitably incurs extra read-modify-write (RMW) operations. This paper presents a cache management scheme calleddual-bufferto manage the overall SMR space, by which the PC is partitioned into the persistent buffer and the filter buffer. It leaves hot data in the filter buffer and moves cold data back to the SMR disk so that the hot data write-back effect can be alleviated. Since the PC may contain a large amount of valid data,dual-bufferalso presents a prediction-based dynamic configuration strategy so hot data can be cached as much as possible. We conducted a series of experiments with synthetic traces. Experimental results show that ourdual-bufferscheme can shorten the average response time by 51.66% on average and reduce the total number of RMW operations by 98.76% on average compared to the previous work. Chenlin Ma, Zhaoyan Shen, Yi Wang 0003, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 2 |
| 2019 | An Efficient LSM-Tree-Based SQLite-Like Database Engine for Mobile DevicesabstractSQLite has been deployed in millions of mobile devices from Web to smartphone applications on various mobile operating systems. However, due to the uncoordinated IO interactions with the underlying file system (e.g., ext4), SQLite is not efficient with low transactions per second. In this paper, we for the first time propose a new SQLite-like database engine, called SQLiteKV, which adopts the LSM-tree-based data structure but retains the SQLite operation interfaces. With its SQLite interface, SQLiteKV can be utilized by existing applications without any modification, while providing high performance with its LSM-tree-based data structure. We separate SQLiteKV into the front-end and back-end. In the front-end, we develop a light-weight SQLite-to-KV compiler to solve the semantic mismatch, so SQL statements can be efficiently translated into KV operations. We also design a novel coordination caching mechanism with memory defragmentation so query results can be effectively cached inside SQLiteKV by alleviating the discrepancy of data management between front-end SQLite statements and back-end data organization. In the back-end, we adopt an LSM-tree-based key-value database engine, and propose a lightweight metadata management scheme to mitigate the memory requirement. We have implemented and deployed SQLiteKV on a Google Nexus 6P smartphone. Experimental results with various workloads show that SQLiteKV outperforms SQLite up to six times. Zhaoyan Shen, Yuanjing Shi, Zili Shao |
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. | 1 |
| 2019 | RMW-F: A Design of RMW-Free Cache Using Built-in NAND-Flash for SMR StorageabstractShingled Magnetic Recording (SMR) disks have been proposed as a high-density, non-volatile media and precede traditional hard disk drives in both storing capacity and cost. However, the intrinsic characteristics of SMR disks raise a major performance challenge named read-modify-write operations (RMWs) that are time-consuming and can significantly degrade the overall system performance. Current designs of SMR disks usually adopt a persistent cache to alleviate the negative effect brought by RMWs and the cache is used as a first-level cache to buffer all the incoming writes of the whole SMR storage system. In this paper, we propose to change the functionality of the cache, that is, the cache will no longer serve as a first-level cache like previous. Incoming data are distinguished according to their different write-back behavior and those data which will incur RMWs will be left in our built-in NAND flash cache called RMW-free Cache (RMW-F) to eliminate the need of RMWs. Besides, RMW-F improves the cleaning efficiency by a model that takes both write-back cost and data popularity into considerations. Our experimental results show that RMW-F can achieve both system performance and cleaning efficiency improvements. Chenlin Ma, Zhaoyan Shen, Zili Shao |
ACM Trans. Embed. Comput. Syst. | 2 |
| 2018 | SQLiteKV: An efficient LSM-tree-based SQLite-like database engine for mobile devicesabstractSQLite has been deployed in millions of mobile devices from web to smartphone applications on various mobile operating systems. However, SQLite is not efficient with low transactions per second. In this paper, we for the first time propose a new SQLite-like database engine, called SQLiteKV, which adopts the LSM-tree-based data structure but retains the SQLite operation interfaces. With its SQLite interface, SQLiteKV can be utilized by existing applications without any modification, while providing high performance with its LSM-tree-based data structure. In SQLiteKV, we develop a light-weight SQLite to key-value compiler to solve the semantic mismatch, so SQL statements can be efficiently translated into KV operations. We also design a novel coordination caching mechanism so query results can be effectively cached inside SQLiteKV by alleviating the discrepancy of data management between front-end SQLite statements and back-end key-value data organization. We have implemented and deployed SQLiteKV on a Google Nexus 6P smartphone. Experiments results show that SQLiteKV outperforms SQLite up to 6 times. Yuanjing Shi, Zhaoyan Shen, Zili Shao |
ASP-DAC | 2 |
| 2018 | Optimizing RAID/SSD controllers with lifetime extension for flash-based SSD arrayabstractFlash-based SSD RAID arrays are increasingly being deployed in data centers. Compared with HDD arrays, SSD arrays drastically enhance storage density and I/O performance, and reduce power and rack space. Nevertheless, SSDs suffer aging issues. Though prior studies have been conducted to address this disadvantage, effective techniques of RAID/SSD controllers are urgently needed to extend the lifetime of SSD arrays. Zhaoyan Shen, Zili Shao, Tao Li 0006 |
LCTES | 2 |
| 2018 | Attitude Fusion of Inertial and Magnetic Sensor under Different Magnetic Filed DistortionsabstractBy virtue of gravity measurement from a handheld inertial measurement unit (IMU) sensor, current indoor attitude estimation algorithms can provide accurate roll/pitch dimension angles. Acquisition of precise heading is limited by the absence of accurate magnetic reference. Consequently, initial stage magnetometer calibration is deployed to alleviate this bottleneck in attitude fusion. However, available algorithms tackle magnetic distortion based on time-invariant surroundings, casting the post-calibration magnetic data into unchanged ellipsoid centered in the calibration place. Consequently, inaccurate fusion results are formulated in a more common case of random walk in time-varying magnetic indoor environment. This article proposes a new fusion algorithm from various kinds of IMU sensors, namely gyroscope, accelerometer, and magnetometer. Compared to state-of-the-art attitude fusion approaches, this article addresses the indoor time-varying magnetic perturbation problem in a geometric view. We propose an extend Kalman filter--based algorithm based on this detailed geometric model to eliminate the position-dependent effect of a compass sensor. Experimental data demonstrate that, under different indoor magnetic distortion environments, our proposed attitude fusion algorithm has the maximum angle error of 2.02°, outperforming 7.17° of a gradient-declining-based algorithm. Additionally, this attitude fusion result is constructed in a low-cost handheld arduino core--based IMU device, which can be widely applied to embedded systems. Zhijian He, Yao Chen 0003, Zhaoyan Shen |
ACM Trans. Embed. Comput. Syst. | 3 |
| 2018 | A Novel ReRAM-Based Processing-in-Memory Architecture for Graph TraversalabstractGraph algorithms such as graph traversal have been gaining ever-increasing importance in the era of big data. However, graph processing on traditional architectures issues many random and irregular memory accesses, leading to a huge number of data movements and the consumption of very large amounts of energy. To minimize the waste of memory bandwidth, we investigate utilizing processing-in-memory (PIM), combined with non-volatile metal-oxide resistive random access memory (ReRAM), to improve both computation and I/O performance. We propose a new ReRAM-based processing-in-memory architecture called RPBFS, in which graph data can be persistently stored and processed in place. We study the problem of graph traversal, and we design an efficient graph traversal algorithm in RPBFS. Benefiting from low data movement overhead and high bank-level parallel computation, RPBFS shows a significant performance improvement compared with both the CPU-based and the GPU-based BFS implementations. On a suite of real-world graphs, our architecture yields a speedup in graph traversal performance of up to 33.8×, and achieves a reduction in energy over conventional systems of up to 142.8×. Zhaoyan Shen, Duo Liu 0002, Zili Shao, H. Howie Huang, Tao Li 0006 |
ACM Trans. Storage | 2 |
| 2018 | DIDACache: An Integration of Device and Application for Flash-based Key-value CachingabstractKey-value caching is crucial to today’s low-latency Internet services. Conventional key-value cache systems, such as Memcached, heavily rely on expensive DRAM memory. To lower Total Cost of Ownership, the industry recently is moving toward more cost-efficient flash-based solutions, such as Facebook’s McDipper [14] and Twitter’s Fatcache [56]. These cache systems typically take commercial SSDs and adopt a Memcached-like scheme to store and manage key-value cache data in flash. Such a practice, though simple, is inefficient due to the huge semantic gap between the key-value cache manager and the underlying flash devices. In this article, we advocate to reconsider the cache system design and directly open device-level details of the underlying flash storage for key-value caching. We propose an enhanced flash-aware key-value cache manager, which consists of a novel unified address mapping module, an integrated garbage collection policy, a dynamic over-provisioning space management, and a customized wear-leveling policy, to directly drive the flash management. A thin intermediate library layer provides a slab-based abstraction of low-level flash memory space and an API interface for directly and easily operating flash devices. A special flash memory SSD hardware that exposes flash physical details is adopted to store key-value items. This co-design approach bridges the semantic gap and well connects the two layers together, which allows us to leverage both the domain knowledge of key-value caches and the unique device properties. In this way, we can maximize the efficiency of key-value caching on flash devices while minimizing its weakness. We implemented a prototype, called DIDACache, based on the Open-Channel SSD platform. Our experiments on real hardware show that we can significantly increase the throughput by 35.5%, reduce the latency by 23.6%, and remove unnecessary erase operations by 28%. Zhaoyan Shen, Feng Chen 0005, Zili Shao |
ACM Trans. Storage | 1 |
| 2017 | DIDACache: A Deep Integration of Device and Application for Flash Based Key-Value Caching
Zhaoyan Shen, Feng Chen 0005, Zili Shao |
FAST | 1 |
| 2017 | A Multi-Quadcopter Cooperative Cyber-Physical System for Timely Air Pollution LocalizationabstractWe propose a cyber-physical system of unmanned quadcopters to locate air pollution sources in a timely manner. The system consists of a physical part and a cyber part. The physical part includes unmanned quadcopters equipped with multiple sensors. The cyber part carries out control laws. We simplify the control laws by decoupling the quadcopters’ horizontal-plane motion control from vertical motion control. To control the quadcopter’s horizontal-plane motions, we propose a controller that combines pollutant dynamics with quadcopter physics. To control the quadcopter’s vertical motions, we adopt an anti-windup proportional-integral (PI) controller. We further extend the horizontal-plane control laws from a single quadcopter to multiple quadcopters. The multi-quadcopter control laws are distributed and convergent. We implement a prototype quadcopter and carry out experiments to verify the vertical control laws. We also carry out simulations to evaluate the horizontal-plane control laws. With quadcopter parameters set commensurate with our prototype implementation’s, our simulations show that the control laws can drive quadcopters to locate pollution source(s) in a timely way. Zhaoyan Shen, Zhijian He, Shuai Li 0002, Qixin Wang 0001, Zili Shao |
ACM Trans. Embed. Comput. Syst. | 1 |
| 2016 | Optimizing Flash-based Key-value Cache Systems
Zhaoyan Shen, Feng Chen 0005, Zili Shao |
HotStorage | 1 |
| 2016 | NVMRA: utilizing NVM to improve the random write operations for NAND-flash-based mobile devicesabstractNAND flash memory has become the major storage media in mobile devices, such as smartphones. However, the random write operations of NAND flash memory heavily affect the I/O performance, thus seriously degrading the application performance in mobile devices. The main reason for slow random write operations is the out-of-place update feature of NAND flash memory. Newly emerged non-volatile memory, such as phase-change memory, spin transfer torque, supports in-place updates and presents much better I/O performance than that of flash memory. All these good features make non-volatile memory (NVM) as a promising solution to improve the random write performance for NAND flash memory. In this paper, we propose a non-volatile memory for random access (NVMRA) scheme to utilize NVM to improve the I/O performance in mobile devices. NVMRA exploits the I/O behaviors of applications to improve the random write performance for each application. Based on different I/O behaviors, such as random write-dominant I/O behavior, NVMRA adopts different storing decisions. The scheme is evaluated on a real Android 4.2 platform. The experimental results show that the proposed scheme can effectively improve the I/O performance and reduce the I/O energy consumption for mobile devices. Copyright © 2015 John Wiley & Sons, Ltd. Renhai Chen, Zhaoyan Shen, Chenlin Ma, Zili Shao |
Softw. Pract. Exp. | 2 |
| 2015 | Ard-mu-Copter: A Simple Open Source Quadcopter PlatformabstractWith the emergence of many commercial-off-the-shelf (COTS) and/or open-source hardware and software, we can now build cheap Unmanned Aerial Vehicles (UAVs). This will enable a broad spectrum of potential UAV based mobile applications. In this work, we propose a simple open UAV platform: Ard-μ-copter. Ard-μ-copter is a quadcopter built upon the open source ArduPilot [1] infrastructure library and hardware. Comparing to the many existing commercial quadcopters platforms and open source quadcopter platforms, Ard-μ-copter platform is fully open source, simple (i.e. what the "μ" stands for), and with good documentations. Zhijian He, Zhaoyan Shen, Enyan Huang, Shuai Li 0002, Zili Shao, Qixin Wang 0001 |
MSN | 3 |