Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data.

Shaohua Duan

dblp:164/0525 · DBLP profile ↗
← Back
11ranked-venue papers
8as first author
6since 2021 · last 2026
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Systems, architecture and hardware · 5 · 4 first-author · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 1 first-author · 2 since 2021Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021Security and privacy · 1 · 1 first-authorApplied, interdisciplinary, general and emerging computing · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer architecture, parallel and distributed computing, and storage systems
3 papers
Storage systems · 39% High-performance computing · 30% Hardware reliability and fault tolerance · 16%
Artificial intelligence
1 paper
Language models and text generation · 50% Reinforcement learning · 50%

Topics — the 11 heaviest of 12, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Reinforcement learning
multi-armed bandit
1.012026
Chunks as Arms: Multi-Armed Bandit-Guided Sampling for Long-Context LLM Preference Optimization · ACL (1) 2026
Natural language and speech › Language models and text generation
preference optimization
1.012026
Chunks as Arms: Multi-Armed Bandit-Guided Sampling for Long-Context LLM Preference Optimization · ACL (1) 2026
Storage systems
crash consistency
0.912025
Crash Consistency in Block-Level Caching Systems: An Open CAS Case Study · USENIX ATC 2025
Storage systems
storage reliability
0.912025
Crash Consistency in Block-Level Caching Systems: An Open CAS Case Study · USENIX ATC 2025
High-performance computing › HPC storage systems
data staging
0.722019
Addressing data resiliency for staging based scientific workflows · SC 2019
Stacker: an autonomic data movement engine for extreme-scale data staging-based in-situ workflows · SC 2018
High-performance computing › scientific workflow
in-situ workflow
0.722019
Addressing data resiliency for staging based scientific workflows · SC 2019
Stacker: an autonomic data movement engine for extreme-scale data staging-based in-situ workflows · SC 2018
Hardware reliability and fault tolerance
error detection
0.412019
Addressing data resiliency for staging based scientific workflows · SC 2019
Hardware reliability and fault tolerance › error detection
silent data corruption detection
0.412019
Addressing data resiliency for staging based scientific workflows · SC 2019
Memory systems
data movement
0.312018
Stacker: an autonomic data movement engine for extreme-scale data staging-based in-situ workflows · SC 2018
Memory systems
cache
0.312025
Crash Consistency in Block-Level Caching Systems: An Open CAS Case Study · USENIX ATC 2025
Distributed systems › fault tolerance › failure models
silent errors
0.112019
Addressing data resiliency for staging based scientific workflows · SC 2019

Methods — techniques the papers use, named apart from their topics

preference optimization · 1.0multi-armed bandit · 1.0spatial outlier detection · 0.4checkpoint/restart · 0.4CPU-GPU hybrid staging · 0.4in-situ workflow orchestration · 0.3
YearPublicationVenuePosition
2026 Chunks as Arms: Multi-Armed Bandit-Guided Sampling for Long-Context LLM Preference Optimization
abstract
Shaohua Duan, Pengcheng Huang, Xinze Li, Zhenghao Liu, Xiaoyuan Yi, Yukun Yan, Shuo Wang, Yu Gu, Ge Yu, Maosong Sun. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026.
Shaohua Duan, Pengcheng Huang 0004, Zhenghao Liu 0001, Xiaoyuan Yi, Yukun Yan, Shuo Wang 0013, Yu Gu 0002, Ge Yu 0001, Maosong Sun 0001
ACL (1)1
2025 PANGOLIN: a Comprehensive Testing Framework for Configuration-Rich Key-Value Stores
abstract
In this paper, we present Pangolin, a comprehensive testing framework for configuration-rich key-value stores. To better understand bugs in modern key-value stores and explore domain knowledge for efficiently identifying new ones, we first comprehensively study historical bugs in five mature key-value stores during the last eight years. Then, we design and implement Pangolin, which is motivated by insights from our bug study, which indicated most bugs could be identified by systematically testing a small sequence of operations and configurations. Specifically, Pangolin practices these insights by introducing a bounded testing strategy into a spectrum of black-box and fuzzing test procedures. Finally, we utilize Pangolin to find 20 bugs and reproduce 443 historical bugs in five mature key-value stores (RocksDB, LevelDB, HyperlevelDB, BadgerDB, and Redis), making it an attractive supplement to handwritten test suites.
Shaohua Duan, Sudarsun Kannan, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau
SYSTOR1
2025 Crash Consistency in Block-Level Caching Systems: An Open CAS Case Study
Shaohua Duan, Youmin Chen
USENIX ATC1
2025 24-h Lane Line Detection via Parallel Scene Information Collaboration
abstract
Lane detection is a critical technology for autonomous driving, but current deep learning-based methods face significant challenges due to the lack of diverse datasets, especially for nighttime conditions. Most datasets are predominantly composed of daytime images, making it difficult to develop models that perform reliably around the clock. Inspired by the parallel system theory, we explore a novel approach to generate comprehensive 24-hour datasets from daytime images alone. In this paper, we propose the Parallel Scene Information Collaboration (PSIC) framework, designed to enhance 24-hour lane detection using only daytime data. The PSIC framework consists of three key components: artificial scene generation, information collaboration, and lane line detection. First, we address the limitations of existing datasets by proposing two generators—one that transforms daytime images into realistic nighttime scenes, and another that refines nighttime images by adding daytime characteristics. Next, to mitigate noise in the generated scenes, we propose a Multi-Spatial Feature Fusion (MSFF) module that effectively integrates features from both real and artificial scenes through spatial collaboration. Finally, the combined information is used by an anchor-based detection head to accurately identify lane positions. Our experiments on the TuSimple, Night TuSimple, and CULane datasets demonstrate that our method achieves state-of-the-art performance in 24-hour lane line detection, significantly improving reliability and robustness across varying conditions.
Shaohua Duan, Chunjie Zhang 0001, Xiaolong Zheng 0001, Yutong Wang 0001, Hui Zhang 0091, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.1
2023 Reversible robust fragile multi-watermarking scheme for color images
Shaohua Duan, Yuhan Qian, Xiaoyi Zhou
Multim. Tools Appl.1
2022 A self-embedding secure fragile watermarking scheme with high quality recovery
Da Kuang, Yu-Jian Zhuang, Shaohua Duan, Xiaoyi Zhou
J. Vis. Commun. Image Represent.5
2020 A Novel Comprehensive Watermarking Scheme for Color Images
abstract
Watermarking technology is commonly used to solve various problems in digital rights management and multimedia security. If a watermarking scheme with multiple purposes applies single method, it will easily cause the destruction of the hidden messages in particular attacks. For the copyright protection and tamper detection of color images, this research proposed a robust-fragile watermarking scheme. The two different embedding schemes embed the watermark into the R layer and G layer after NSST (nonsubsampled shearlet transform) and DWT (discrete wavelet transform) transformation. The hash sequence generated by the R layer and the G layer is served as fragile watermarks and is embedded into the B layer by the LSB (least significant bit) method. Finally, an improved rotation correction is applied to better extract the watermark under the rotation attack. Experimental results show that the proposed method is more accurate than the existing ones in terms of rotation angle correction and can effectively resist general attacks such as noise, filtering, and JEPG compression. Moreover, the proposed fragile watermark can locate the tamper position when malicious tamper occurs. Except cropping attack, the true-positive rate (TPR) reaches 1 for all attacks.
Shaohua Duan, Xiaoyi Zhou
Secur. Commun. Networks1
2019 Addressing data resiliency for staging based scientific workflows
abstract
As applications move towards extreme scales, data-related challenges are becoming significant concerns, and in-situ workflows based on data staging and in-situ/in-transit data processing have been proposed to address these challenges. Increasing scale is also expected to result in an increase in the rate of silent data corruption errors, which will impact both the correctness and performance of applications. Furthermore, this impact is amplified in the case of in-situ workflows due to the dataflow between the component applications of the workflow. While existing research has explored silent error detection at the application level, silent error detection for workflows remains an open challenge. This paper addresses silent error detection for extreme scale in-situ workflows. The presented approach leverages idle computation resource in data staging to enable timely detection and recovery from silent data corruption, effectively reducing the propagation of corrupted data and end-to-end workflow execution time in the presence of silent errors. As an illustration of this approach, we use a spatial outlier detection approach in staging to detect errors introduced in data transfer and storage. We also provide a CPU-GPU hybrid staging framework for error detection in order to achieve faster error identification. We have implemented our approach within the DataSpaces staging service, and evaluated it using both synthetic and real workflows on a Cray XK7 system (Titan) at different scales. We demonstrate that, in the presence of silent errors, enabling error detection on staged data alongside a checkpoint/restart scheme improves the total in-situ workflow execution time by up to 22% in comparison with using checkpoint/restart alone.
Shaohua Duan, Pradeep Subedi, Philip E. Davis, Manish Parashar
SC1
2018 Scalable Data Resilience for In-memory Data Staging
abstract
The dramatic increase in the scale of current and planned high-end HPC systems is leading new challenges, such as the growing costs of data movement and IO, and the reduced mean times between failures (MTBF) of system components. In-situ workflows, i.e., executing the entire application workflows on the HPC system, have emerged as an attractive approach to address data-related challenges by moving computations closer to the data, and staging-based frameworks have been effectively used to support in-situ workflows at scale. However, the resilience of these staging-based solutions has not been addressed and they remain susceptible to expensive data failures. Furthermore, naive use of data resilience techniques such as n-way replication and erasure codes can impact latency and/or result in significant storage overheads. In this paper, we present CoREC, a scalable resilient in-memory data staging runtime for large-scale in-situ workflows. CoREC uses a novel hybrid approach that combines dynamic replication with erasure coding based on data access patterns. The paper also presents optimizations for load balancing and conflict avoiding encoding, and a low overhead, lazy data recovery scheme. We have implemented the CoREC runtime and have deployed with the DataSpaces staging service on Titan at ORNL, and present an experimental evaluation in the paper. The experiments demonstrate that CoREC can tolerate in-memory data failures while maintaining low latency and sustaining high overall storage efficiency at large scales.
Shaohua Duan, Pradeep Subedi, Keita Teranishi, Philip E. Davis, Hemanth Kolla, Marc Gamell, Manish Parashar
IPDPS1
2018 Stacker: an autonomic data movement engine for extreme-scale data staging-based in-situ workflows
Pradeep Subedi, Philip E. Davis, Shaohua Duan, Scott Klasky, Hemanth Kolla, Manish Parashar
SC3
2016 Multi-cache: Dynamic, Efficient Partitioning for Multi-tier Caches in Consolidated VM Environments
abstract
Every physical machine in today's typical datacenter is backed by storage devices with hundreds of Gigabytes to Terabytes in size. Data center vendors usually use hard disk drives for their back-end storage as it is cheap and reliable. However, the increase in the I/O accesses to the back-end storage from one or many of the VMs hosted on a physical machine can reduce its overall accesses time significantly due to contention. This may not be suitable for interactive applications requiring low latency that might be co-located with other I/O intensive applications. In this paper we present Multi-Cache, a multi-layer cache management system that uses a combination of cache devices of varied speed and cost such as solid state drives, non-volatile memories, etc to mitigate this problem. Multi-Cache partitions each device dynamically at runtime according to the workload of each VM and its priority. We use a heuristic optimization technique that ensures maximum utilization of the caches resulting in a high hit rate. We use a weighted partitioning policy that improves latency by up to 72% for individual workloads, and a overall hit rate increase of up to 31% for host running several workloads together in comparison to standard LRU caching algorithms.
Sundaresan Rajasekaran, Shaohua Duan, Wei Zhang 0052, Timothy Wood 0001
IC2E2