EDBT 2026 Demo / reviewers in the wild / expert
Bo Wu 0002
dblp:47/6534-2
· DBLP profile ↗
64ranked-venue papers
14as first author
27since 2021 · last 2026
0009-0001-1696-4272ORCID · conflict
Domains — the database's venue-derived domains; a paper can count in several
Systems, architecture and hardware · 28 · 7 first-author · 5 since 2021Computer networks · 15 · 4 first-author · 8 since 2021Software engineering, systems software and programming languages · 12 · 3 first-author · 3 since 2021Artificial intelligence and machine learning · 6 · 6 since 2021Applied, interdisciplinary, general and emerging computing · 6 · 4 since 2021Databases, data management, data science and information retrieval · 3 · 3 since 2021Human-computer interaction and ubiquitous computing · 3 · 3 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 first-author · 1 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Closing the Spatial Execution Gap in Digital Whiteboards via Verifiable Reinforcement LearningabstractWhile multi-modal large language models such as GPT-5 demonstrate exceptional general understanding, they suffer from a fundamental Spatial Execution Gap, failing to translate visual semantics into precise, schema-valid coordinate operations in interactive environments.In this work, we show that model scale alone cannot close this gap; instead, verifiable structured reasoning provides the key to spatial precision.We present a comprehensive pipeline that leverages Group Relative Policy Optimization to enforce a strict Identify-Reason-Verify protocol, effectively shifting the computational burden from parameters to test-time reasoning.By utilizing a multi-agent system to distill optimal reasoning schemas and training on execution-verifiable rewards, our specialized 3B agent achieves 100% format coherence and 81.12% operation accuracy on digital whiteboard tasks.Crucially, our approach outperforms a state-of-the-art frontier model, GPT-5, by 16.75% in operation accuracy.The results suggest that for complex user interface manipulation, small, RL-aligned models with dedicated reasoning protocols are superior to generalist frontier models, offering a promising direction for building reliable web agents. Chang Liu 0122, Benjamin Wagley, Mehmet Esat Belviranli, Bo Wu 0002 |
ACL (1) | 5 |
| 2026 | Multi-CDN as a Collective Service: Towards Hot Start in Congestion Control at Scale
Tong Li 0014, Jiuxiang Zhu, Bo Wu 0002, Haoyi Fang, Ke Xu 0002 |
APNet | 3 |
| 2026 | A Measurement Study on QUIC Deployment and Performance in the WildabstractThis paper evaluates QUIC deployment and performance through active measurements of 1,572 Chinese and 1,953 non-Chinese websites. Results show clear regional and categorical differences: HTTP/3 support is 35.0% for non-Chinese websites but only 5.7% for Chinese websites. Performance gains also depend on network conditions, reducing transfer time by 17.06% in Chinese long-tail networks while slightly regressing by 0.79% in optimized low-latency CDN edge scenarios. Overall, QUIC’s deployment and benefits are highly scenario-dependent. Tong Li 0014, Jiuxiang Zhu, Bo Wu 0002, Long Yao |
APNet | 5 |
| 2026 | A Large-Scale Analysis of Student Behavior with Pedagogically Constrained LLM Tutors
Chang Liu 0122, Loc Hoang, René F. Kizilcec, Bo Wu 0002 |
L@S | 4 |
| 2026 | AutoRec: Accelerating Loss Recovery for Live Streaming in a Multi-Supplier MarketabstractDue to the limited permissions for upgrading dual-side (i.e., server-side and client-side) loss tolerance schemes from the perspective of CDN vendors in a multi-supplier market, modern large-scale live streaming services are still using the automatic-repeat-request (ARQ) based paradigm for loss recovery, which only requires server-side modifications. In this paper, we first conduct a large-scale measurement study with up to 50 million live streams. We find that loss showsdynamicsand live streaming contains frequenton-off mode switchingin the wild. We further find that the recovery latency, enlarged by the ubiquitous retransmission loss, is a critical factor affecting live streaming’s client-side QoE (e.g., video freezing). We then propose an enhanced recovery mechanism called AutoRec, which can transform the disadvantages of on-off mode switching into an advantage for reducing loss recovery latency without any modifications on the client side. AutoRec allows users to customize overhead tolerance and recovery latency tolerance and adaptively adjusts strategies as the network environment changes to ensure that recovery latency meets user demands whenever possible while keeping overhead under control. We implement AutoRec upon QUIC and evaluate it via testbed and real-world commercial services deployments. The experimental results demonstrate the practicability and profitability of AutoRec. Tong Li 0014, Bo Wu 0002, Fuyu Wang 0006, Jiuxiang Zhu, Haoyi Fang, Xinle Du, Ke Xu 0002 |
IEEE Trans. Netw. | 3 |
| 2025 | Understanding Student Engagement with Large Language Model-Powered Course Assistants
Chang Liu 0122, Loc Hoang, Andrew Stolman, René F. Kizilcec, Bo Wu 0002 |
AIED (6) | 5 |
| 2025 | Quack the Code: A Computer Game Show Offers Learning Through Teaching AI in Undergraduate Software Engineering
Kathleen Marie Kelly, Bo Wu 0002, Christine Liebe |
ITiCSE (1) | 2 |
| 2025 | FLEXIS: FLEXible Frequent Subgraph Mining using Maximal Independent SetsabstractFrequent Subgraph Mining (FSM) is the process of identifying common subgraph patterns that occur over a certain threshold. The NP-hardness of FSM makes it a complex and time-consuming task. FSM is generally solved in 2 steps, 1). Generation step: determining the possible patterns that can be frequent and 2). Metric step: determining if the pattern is frequent. In the literature, the generation step is usually solved by vertex or edge extension methods. These methods produce a lot of redundant candidate patterns which must be removed, and hence increasing the latency. To address these challenges, the paper introduces a vertex based merging method which reduces the redundancies, and introduces effective pruning mechanisms. Moreover, the existing metrics to determine if a pattern is frequent or not, either is highly accurate while demanding significant computational time (Maximum Independent Set (MIS)) or overestimates the pattern count while taking less time (Minimum Node Image (MNI)). Thus, the paper introduces ''Maximal Independent Set (mIS)'' metric, which minimizes latency while obtaining accuracy close to MIS, which is controlled by a pattern overlap parameter (łambda).Through extensive experimentation, our proposed method achieves an average of 10.58× speedup when compared to GraMi and an average of 3× speedup when compared to T-FSM. Akshit Sharma, Sam Reinehr, Dinesh Mehta, Bo Wu 0002 |
KDD (2) | 4 |
| 2025 | Accelerating Loss Recovery for Content Delivery NetworkabstractPacket losses significantly impact the user experience of content delivery network (CDN) services such as live streaming and data backup-and-archiving. However, our production network measurement studies show that the legacy loss recovery is far from satisfactory due to the wide-area loss characteristics (i.e., dynamics and burstiness) in the wild. In this paper, we propose a sender-side Adaptive ReTransmission scheme, ART, which minimizes the recovery time of lost packets with minimal redundancy cost. Distinguishing itself from forward-error-correction (FEC), which preemptively sends redundant data packets to prevent loss, ART functions as an automatic-repeat-request (ARQ) scheme. It applies redundancy specifically to lost packets instead of unlost packets, thereby addressing the characteristic patterns of wide-area losses in real-world scenarios. We implement ART upon QUIC protocol and evaluate it via both trace-driven emulation and real-world deployment. The results show that ART reduces up to 34% of flow completion time (FCT) for delay-sensitive transmissions, improves up to 26% of goodput for throughput-intensive transmissions, reduces 11.6% video playback rebuffering, and saves up to 90% of redundancy cost. Tong Li 0014, Wei Liu 0230, Shuaipeng Zhu, Jingkun Cao, Duling Xu, Zhaoqi Yang, Senzhen Liu, Taotao Zhang, Yinfeng Zhu 0002, Bo Wu 0002, Kezhi Wang, Ke Xu 0002 |
IEEE Trans. Computers | 11 |
| 2024 | HiTA: A RAG-Based Educational Platform that Centers Educators in the Instructional Loop
Chang Liu 0122, Loc Hoang, Andrew Stolman, Bo Wu 0002 |
AIED (2) | 4 |
| 2024 | Reducing First-Frame Delay of Live Streaming by Simultaneously Initializing Window and RateabstractThe first-frame delay is an essential indicator for evaluating the performance of cloud CDN vendors and affects the client-side QoE of live streaming. Instead of the traditional way of tuning the initial congestion window (cwnd) for all connections to a fixed value based on expert experience, this paper explores the using of transport signals unique to each connection (e.g., application-layer framing, historical QoS metrics) to initialize the sending parameters for each connection. Thus we propose Wira, a first-frame optimization mechanism that adjusts both initial cwnd and initial rate, which are two key parameters for decreasing the first-frame completion time (FFCT). Particularly, Wira provides cross-layer Frame Perception that parses frames and adapts the initial cwnd to the first-frame size. Meanwhile, Wira introduces the Transport Cookie to enable cloud-client collaborations, in which the historical QoS metrics from the clients can be reported and reused by rate initialization in the stateless cloud. This assures the initial rate matches the actual network conditions while avoiding non-trivial storage overhead in the cloud. We implement Wira upon QUIC and evaluate it via real-world deployments of commercial services. Results demonstrate the profitability of Wira, in which the average and 90th-percentile FFCT are reduced by 10.6% and 16.7%, respectively. Bo Wu 0002, Tong Li 0014, Fuyu Wang 0006, Changkui Ouyang, Linfeng Guo, Ke Xu 0002 |
ICDCS | 1 |
| 2024 | ReND: Toward Reasoning-based BLE Neighbor Discovery by Integrating with Wi-Fi FingerprintsabstractThis paper proposes the novel concept of reasoning-based Bluetooth Low-Energy (BLE) neighbor discovery, an indirect paradigm of device-to-device sensing to address challenges (e.g., interference and power limitations) where direct sensing falls short. Inspired by the classical Rule of Syllogism, reasoning-based BLE neighbor discovery abstracts the device-to-device sensing as the presence detection of a BLE signal in a certain space. It deduces the presence of the BLE signal according to the presence of the Wi-Fi signal through the historical correlation between BLE and Wi-Fi. To demonstrate the feasibility of this new neighbor discovery paradigm, we report the design and evaluation of a prototype called ReND. By leveraging the complementary strengths of Wi-Fi and BLE, ReND reduces up to 91.3% and 65.9% of the 50thand 95thpercentile BLE neighbor discovery latency, respectively. We further discuss the feasibility and incentive of ReND in the Polygon’s Mumbai Testnet public blockchain. Zhaoqi Yang, Tong Li 0014, Bo Wu 0002, Yukuan Ding, Dulin Xu, Ke Xu 0002 |
IWQoS | 5 |
| 2024 | Scaler: Efficient and Effective Cross Flow AnalysisabstractPerformance analysis is challenging as different components (e.g., different libraries, and applications) of a complex system can interact with each other. However, few existing tools focus on understanding such interactions. To bridge this gap, we propose a novel analysis method-"Cross Flow Analysis (XFA)"- that monitors the interactions/flows across these components. We also built the Scaler profiler that provides a holistic view of the time spent on each component (e.g., library or application) and every API inside each component. This paper proposes multiple new techniques, such as Universal Shadow Table, and Relation-Aware Data Folding. These techniques enable Scaler to achieve low runtime overhead, low memory overhead, and high profiling accuracy. Based on our extensive experimental results, Scaler detects multiple unknown performance issues inside widely-used applications, and therefore will be a useful complement to existing work. Steven (Jiaxun) Tang, Mingcan Xiang, Yang Wang 0009, Bo Wu 0002, Jianjun Chen 0001, Tongping Liu |
ASE | 4 |
| 2024 | LPFormer: An Adaptive Graph Transformer for Link PredictionabstractLink prediction is a common task on graph-structured data that has seen applications in a variety of domains. Classically, hand-crafted heuristics were used for this task. Heuristic measures are chosen such that they correlate well with the underlying factors related to link formation. In recent years, a new class of methods has emerged that combines the advantages of message-passing neural networks (MPNN) and heuristics methods. These methods perform predictions by using the output of an MPNN in conjunction with a "pairwise encoding" that captures the relationship between nodes in the candidate link. They have been shown to achieve strong performance on numerous datasets. However, current pairwise encodings often contain a strong inductive bias, using the same underlying factors to classify all links. This limits the ability of existing methods to learn how to properly classify a variety of different links that may form from different factors. To address this limitation, we propose a new method, LPFormer, which attempts to adaptively learn the pairwise encodings for each link. LPFormer models the link factors via an attention module that learns the pairwise encoding that exists between nodes by modeling multiple factors integral to link prediction. Extensive experiments demonstrate that LPFormer can achieve SOTA performance on numerous datasets while maintaining efficiency. The code is available at The code is available at https://github.com/HarryShomer/LPFormer. Harry Shomer, Yao Ma 0001, Haitao Mao, Juanhui Li, Bo Wu 0002, Jiliang Tang |
KDD | 5 |
| 2024 | Toward Timeliness-Enhanced Loss Recovery for Large-Scale Live StreamingabstractDue to the limited permissions for upgrading dual-side (i.e., server-side and client-side) loss tolerance schemes from the perspective of CDN vendors in a multi-supplier market, modern large-scale live streaming services are still using the automatic-repeat-request (ARQ) based paradigm for loss recovery, which only requires server-side modifications. In this paper, we first conduct a large-scale measurement study with up to 50 million live streams. We find that loss shows dynamics and live streaming contains frequent on-off mode switching in the wild. We further find that the recovery latency, enlarged by the ubiquitous retransmission loss, is a critical factor affecting live streaming's client side QoE (e.g., video freezing). We then propose an enhanced recovery mechanism called AutoRec, which can transform the disadvantages of on-off mode switching into an advantage for reducing loss recovery latency without any modifications on the client side. AutoRec also adopts an online learning-based policy to fit the dynamics of loss, balancing the tradeoff between the recovery latency and the incurred overhead. We implement AutoRec upon QUIC and evaluate it via both testbed and real-world commercial services deployments. The experimental results demonstrate the practicability and profitability of AutoRec, in which the average times and duration of client-side video freezing can be lowered by 11.4% and 5.2%, respectively. Bo Wu 0002, Tong Li 0014, Fuyu Wang 0006, Xinle Du, Ke Xu 0002 |
ACM Multimedia | 1 |
| 2023 | Distance-Based Propagation for Efficient Knowledge Graph ReasoningabstractKnowledge graph completion (KGC) aims to predict unseen edges in knowledge graphs (KGs), resulting in the discovery of new facts.A new class of methods have been proposed to tackle this problem by aggregating path information.These methods have shown tremendous ability in the task of KGC.However they are plagued by efficiency issues.Though there are a few recent attempts to address this through learnable path pruning, they often sacrifice the performance to gain efficiency.In this work, we identify two intrinsic limitations of these methods that affect the efficiency and representation quality.To address the limitations, we introduce a new method, TAGNet, which is able to efficiently propagate information.This is achieved by only aggregating paths in a fixed window for each source-target pair.We demonstrate that the complexity of TAGNet is independent of the number of layers.Extensive experiments demonstrate that TAGNet can cut down on the number of propagated messages by as much as 90% while achieving competitive performance on multiple KG datasets 1 . Harry Shomer, Yao Ma 0001, Juanhui Li, Bo Wu 0002, Charu C. Aggarwal, Jiliang Tang |
EMNLP | 4 |
| 2023 | ART: Adaptive Retransmission for Wide-Area Loss Recovery in the WildabstractPacket losses significantly impact the user experience of wide-area applications such as content distribution and remote procedure call (RPC) based services. However, our production network measurement studies show that the legacy loss recovery is far from satisfactory due to the wide-area loss characteristics (i.e., dynamics and burstiness) in the wild. In this paper, we propose a sender-side Adaptive ReTransmission scheme, ART, which minimizes the recovery time of lost packets with minimal redundancy cost. Distinguishing itself from forward-error-correction (FEC), which preemptively sends redundant data packets to prevent loss, ART functions as an automatic-repeat-request (ARQ) scheme. It applies redundancy specifically to lost packets instead of unlost packets, thereby addressing the characteristic patterns of wide-area losses in real-world scenarios. We implement ART upon QUIC protocol and evaluate it via both trace-driven emulation and real-world deployment. The results show that ART reduces up to 34% of flow completion time (FCT) for delay-sensitive transmissions, improves up to 28 % of goodput for throughput-intensive transmissions, and saves up to 90% of redundancy cost. Tong Li 0014, Wei Liu 0230, Shuaipeng Zhu, Jingkun Cao, Senzhen Liu, Taotao Zhang, Yinfeng Zhu 0002, Bo Wu 0002, Ke Xu 0002 |
ICNP | 9 |
| 2023 | NUMAlloc: A Faster NUMA Memory AllocatorabstractThe NUMA architecture accommodates the hardware trend of an increasing number of CPU cores. It requires the cooperation of memory allocators to achieve good performance for multithreaded applications. Unfortunately, existing allocators do not support NUMA architecture well. This paper presents a novel memory allocator – NUMAlloc, that is designed for the NUMA architecture. is centered on a binding-based memory management. On top of it, proposes an “origin-aware memory management” to ensure the locality of memory allocations and deallocations, as well as a method called “incremental sharing” to balance the performance benefits and memory overhead of using transparent huge pages. According to our extensive evaluation, NUMAlloc has the best performance among all evaluated allocators, running 15.7% faster than the second-best allocator (mimalloc), and 20.9% faster than the default Linux allocator with reasonable memory overhead. NUMAlloc is also scalable to 128 threads and is ready for deployment. Hanmei Yang, Wei Wang 0054, Sandip Kundu, Bo Wu 0002, Hui Guan 0001, Tongping Liu |
ISMM | 6 |
| 2023 | Poster: TOO: Accelerating Loss Recovery by Taming On-Off Traffic PatternsabstractAs the ubiquitous phenomenon occurs in applications such as live streaming and video conferencing, the on-off traffic pattern is regarded as a disadvantage for congestion control. However, we argue that it can be transformed as an advantage for accelerating loss recovery. In this paper, we report the design of TOO, a loss recovery acceleration mechanism that tames on-off patterns for loss duplicate reinjection without incurring non-trivial traffic overhead. Tong Li 0014, Bo Wu 0002, Fuyu Wang 0006, Ke Xu 0002 |
SIGCOMM | 3 |
| 2023 | MemPerf: Profiling Allocator-Induced Performance SlowdownsabstractThe memory allocator plays a key role in the performance of applications, but none of the existing profilers can pinpoint performance slowdowns caused by a memory allocator. Consequently, programmers may spend time improving application code incorrectly or unnecessarily, achieving low or no performance improvement. This paper designs the first profiler—MemPerf—to identify allocator-induced performance slowdowns without comparing against another allocator. Based on the key observation that an allocator may impact the whole life-cycle of heap objects, including the accesses (or uses) of these objects, MemPerf proposes a life-cycle based detection to identify slowdowns caused by slow memory management operations and slow accesses separately. For the prior one, MemPerf proposes a thread-aware and type-aware performance modeling to identify slow management operations. For slow memory accesses, MemPerf utilizes a top-down approach to identify all possible reasons for slow memory accesses introduced by the allocator, mainly due to cache and TLB misses, and further proposes a unified method to identify them correctly and efficiently. Based on our extensive evaluation, MemPerf reports 98% medium and large allocator-reduced slowdowns (larger than 5%) correctly without reporting any false positives. MemPerf also pinpoints multiple known and unknown design issues in widely-used allocators. Sam Silvestro, Steven (Jiaxun) Tang, Hanmei Yang, Hongyu Liu 0005, Guangming Zeng, Bo Wu 0002, Cong Liu 0005, Tongping Liu |
Proc. ACM Program. Lang. | 7 |
| 2023 | R-AQM: Reverse ACK Active Queue Management in Multitenant Data CentersabstractTCP incast has become a practical problem for high-bandwidth, low-latency transmissions, resulting in throughput degradation of up to 90% and delays of hundreds of milliseconds, severely impacting application performance. However, in virtualized multi-tenant data centers, host-based advancements in the TCP stack are hard to deploy from the operators’ perspective. Operators only provide infrastructure in the form of virtual machines, in which only tenants can directly modify the end-host TCP stack. In this paper, we present R-AQM, a switch-powered reverse ACK active queue management (R-AQM) mechanism for enhancing ACK-clocking effects through assisting legacy TCP. Specifically, R-AQM proactively intercepts ACKs and paces the ACK-clocked in-flight data packets, preventing TCP from suffering incast collapse. We implement and evaluate R-AQM in NS-3 simulation and NetFPGA-based hardware switch. Both simulation and testbed results show that R-AQM greatly improves TCP performance under heavy incast workloads by significantly lowering packet loss rate, reducing retransmission timeouts, and supporting 16 times (i.e., 60 to 1000) more senders. Meanwhile, the forward queuing delays are also reduced by 4.6 times. Xinle Du, Ke Xu 0002, Lei Xu 0019, Kai Zheng 0003, Meng Shen 0001, Bo Wu 0002, Tong Li 0014 |
IEEE/ACM Trans. Netw. | 6 |
| 2022 | SampleMine: A Framework for Applying Random Sampling to Subgraph Pattern Mining through Loop PerforationabstractSubgraph Pattern Mining (SPM) is an important class of graph applications that aim to discover structural patterns in a graph. Due to the enormous exploration space, SPM is in general computationally challenging. To accelerate SPM, many random sampling techniques have been proposed. While the existing sampling techniques are effective for conventional SPM tasks such as motif counting and frequent subgraph mining, they cannot be easily adapted for new applications. Peng Jiang 0004, Yihua Wei, Jiya Su, Rujia Wang, Bo Wu 0002 |
PACT | 5 |
| 2021 | Dryadic: Flexible and Fast Graph Pattern Matching at ScaleabstractGraph pattern matching searches a data graph for all instances of one or more query patterns. Since it is one of the most fundamental problems in graph analytics, many graph pattern matching systems have been proposed with distinct features to provide a mix of flexibility and performance, and it is generally accepted that distinct use cases may necessitate the use of different systems. In this paper, we propose Dryadic, a system which integrates comprehensive flexibility features, yet can still outperform four state-of-the-art graph pattern matching systems on the primary use cases they target. Unlike existing systems that employ a case-by-case design strategy, all functionalities of Dryadic are centered around a powerful intermediate representation, the computation tree structure, which encodes the matching algorithms for arbitrary patterns. Dryadic implements novel techniques to optimize the computation tree and maps it to different backends to perform compiled, interpreted, or distributed graph pattern matching. Extensive experiments on nine real-world graphs of different scales show that Dryadic, despite its all-in-one nature, is often one to three orders of magnitude faster than other systems in three common usage scenarios. Daniel Mawhirter, Sam Reinehr, Noah Fields, Miles Claver, Connor Holmes, Jedidiah McClurg, Tongping Liu, Bo Wu 0002 |
PACT | 9 |
| 2021 | R-AQM: Reverse ACK Active Queue Management in Multi-tenant Data CentersabstractTCP incast has become a practical problem for high-bandwidth, low-latency transmissions, resulting in throughput degradation of up to 90% and delays of hundreds of milliseconds, severely impacting application performance. However, in virtualized multi-tenant data centers, host-based advancements in the TCP stack are hard to deploy from the operators perspective. Operators only provide infrastructure in the form of virtual machines, in which only tenants can directly modify the end-host TCP stack. In this paper, we present R-AQM, a switch-powered reverse ACK active queue management (R-AQM) mechanism for enhancing ACK-clocking effects through assisting legacy TCP. Specifically, R-AQM proactively intercepts ACKs and paces the ACK-clocked in-flight data packets, preventing TCP from suffering incast collapse. We implement and evaluate R-AQM in NS-3 simulation and NetFPGA-based hardware switch. Both simulation and testbed results show that R-AQM greatly improves TCP performance under heavy incast workloads by significantly lowering packet loss rate, reducing retransmission timeouts, and supporting 16 times (i.e., 60 → 1000) more senders. Meanwhile, the forward queuing delays are also reduced by 4.6 times. Xinle Du, Tong Li 0014, Lei Xu 0019, Kai Zheng 0003, Meng Shen 0001, Bo Wu 0002, Ke Xu 0002 |
ICNP | 6 |
| 2021 | NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMMabstractNatural Language Processing (NLP) has recently achieved great success by using huge pre-trained Transformer networks. However, these models often contain hundreds of millions or even billions of parameters, bringing challenges to online deployment due to latency constraints. Recently, hardware manufacturers have introduced dedicated hardware for NxM sparsity to provide the flexibility of unstructured pruning with the runtime efficiency of structured approaches. NxM sparsity permits arbitrarily selecting M parameters to retain from a contiguous group of N in the dense representation. However, due to the extremely high complexity of pre-trained models, the standard sparse fine-tuning techniques often fail to generalize well on downstream tasks, which have limited data resources. To address such an issue in a principled manner, we introduce a new learning framework, called NxMTransformer, to induce NxM semi-structured sparsity on pretrained language models for natural language understanding to obtain better performance. In particular, we propose to formulate the NxM sparsity as a constrained optimization problem and use Alternating Direction Method of Multipliers (ADMM) to optimize the downstream tasks while taking the underlying hardware constraints into consideration. ADMM decomposes the NxM sparsification problem into two sub-problems that can be solved sequentially, generating sparsified Transformer networks that achieve high accuracy while being able to effectively execute on newly released hardware. We apply our approach to a wide range of NLP tasks, and our proposed method is able to achieve 1.7 points higher accuracy in GLUE score than current best practices. Moreover, we perform detailed analysis on our approach and shed light on how ADMM affects fine-tuning accuracy for downstream tasks. Finally, we illustrate how NxMTransformer achieves additional performance improvement with knowledge distillation based methods. Connor Holmes, Minjia Zhang, Yuxiong He, Bo Wu 0002 |
NeurIPS | 4 |
| 2021 | Preface
Xian-He Sun, Dong Li 0001, Wen-Guang Chen, Tao Li 0006, Jiwu Shu, Bo Wu 0002, Jin Xiong, Jinging Xue, Feng Zhang 0007, Jidong Zhai, Zhiia Zhao |
J. Comput. Sci. Technol. | 6 |
| 2021 | Automatic Irregularity-Aware Fine-Grained Workload Partitioning on Integrated ArchitecturesabstractThe integrated architecture that features both CPU and GPU on the same die is an emerging and promising architecture for fine-grained CPU-GPU collaboration. However, the integration also brings forward several programming and system optimization challenges, especially for irregular applications such as graph processing. The complex interplay between heterogeneity and irregularity leads to very low processor utilization of running irregular applications on integrated architectures. Furthermore, fine-grained co-processing on the CPU and GPU is still an open problem. Particularly, in this paper, we show that the previous workload partitioning for CPU-GPU co-processing is far from ideal in terms of resource utilization and performance. To solve this problem, we propose a system software called FinePar, which considers architectural differences of the CPU and GPU and leverages fine-grained collaboration enabled by integrated architectures. Through irregularity-aware performance modeling and online auto-tuning, FinePar partitions irregular workloads and achieves both device-level and thread-level load balance. We evaluate FinePar with eight irregular applications in graphs and sparse matrices on two integrated architectures and compare it with state-of-the-art partitioning approaches. Results show that FinePar demonstrates better resource utilization and achieves an average of 1.6X speedup over the optimal coarse-grained partitioning method. Feng Zhang 0007, Jidong Zhai, Bo Wu 0002, Bingsheng He, Xiaoyong Du 0001 |
IEEE Trans. Knowl. Data Eng. | 3 |
| 2020 | I Know If the Journey Changes: Flexible Source and Path ValidationabstractNo matter from the perspective of detection or defense, source and path validations are fundamentally primitive in constructing security mechanisms to greatly enhance network immunity in the face of malicious attacks, such as injection, traffic hijacking and hidden threats. However, existing works for source and path verification still impose a non-trivial operational overhead and lack adjustment capability for path dynamic changes. In this paper, we propose a flexible and convenient source and path validation protocol called PSVM, which uses an authentication structure PIC composed of ordered pieces to carry out packet verification. Specifically, in the basic PSVM protocol, PIC (related to cryptographic computation) in the packet header does not require any update during packet verification, which thus enables a lower processing overhead in routers. To cope with the challenge of path policy changes in the running protocol, the dynamic PSVM protocol supports controllable adjustment and migration, especially in the case of avoiding a malicious node or region. Our evaluation of a prototype experiment on Click demonstrates that the verification efficiency of PSVM is barely influenced by payload size or path length. Compared to the baseline of normal IP routing, the throughput reduction ratio of the basic PSVM is about 13%, which is much better than 28% of existing best solution Origin and Path Trace (OPT). In addition, for a 35-hop path with 30 pieces of PIC needed to be adjusted in dynamic PSVM, the throughput reduction ratio of routing cross node performing the adjustment operation after normal verification is only 2.4 %. Ke Xu 0002, Qi Li 0002, Rongxing Lu, Bo Wu 0002, Yi Zhao 0011, Meng Shen 0001 |
IWQoS | 5 |
| 2019 | GRNN: Low-Latency and Scalable RNN Inference on GPUsabstractRecurrent neural networks (RNNs) have gained significant attention due to their effectiveness in modeling sequential data, such as text and voice signal. However, due to the complex data dependencies and limited parallelism, current inference libraries for RNNs on GPUs produce either high latency or poor scalability, leading to inefficient resource utilization. Consequently, companies like Microsoft and Facebook use CPUs to serve RNN models. Connor Holmes, Daniel Mawhirter, Yuxiong He, Feng Yan 0001, Bo Wu 0002 |
EuroSys | 5 |
| 2019 | SmartCrowd: Decentralized and Automated Incentives for Distributed IoT System DetectionabstractInternet of Things (IoT) devices achieve the rapid development and have been widely deployed recently. Meanwhile, inherent vulnerabilities of IoT systems (including firmware and software) have been continually uncovered and thus the systems are always exposed to various attacks. The root cause of the issue is that IoT systems always have design flaws and implementation bugs. In particular, the released systems (e.g., by third-party marketplaces and IoT vendors) may be maliciously repackaged with malware. Unfortunately, IoT consumers are not able to effectively capture such vulnerabilities because of the limited detection capabilities. In this paper, we propose SmartCrowd, a blockchain-based platform that aims to outsource security detection of IoT systems to distributed detectors with strong detection incentives. SmartCrowd enables built-in accountability for IoT providers and authoritative references of detection results for IoT consumers. By building smart contracts, we can incentivize the efficient and high-coverage security detection of IoT systems, while providing decentralized and automated incentives for both IoT providers releasing secure IoT systems and detectors uncovering vulnerabilities. We present the security and theoretical analysis that demonstrates the security of SmartCrowd and the incentives for participators. We prototype SmartCrowd by using Ethereum and the experimental results show that SmartCrowd has both technical feasibility and financial benefits, which can be applied to build a secure IoT ecosystem. Bo Wu 0002, Ke Xu 0002, Qi Li 0002, Zhuotao Liu, Yih-Chun Hu, Xinle Du, Bingyang Liu, Shoushou Ren |
ICDCS | 1 |
| 2019 | Laius: Towards latency awareness and improved utilization of spatial multitasking accelerators in datacentersabstractDatacenters use accelerators to provide the significant compute throughput required by emerging user-facing services. The diurnal user access pattern of user-facing services provides a strong incentive to co-located applications for better accelerator utilization, and prior work has focused on enabling co-location on multicore processors and traditional non-preemptive accelerators. However, current accelerators are evolving towards spatial multitasking and introduce a new set of challenges to eliminate QoS violation. To address this open problem, we explore the underlying causes of QoS violation on spatial multitasking accelerators. In response to these causes, we propose Laius, a runtime system that carefully allocates the computation resource to co-located applications for maximizing the throughput of batch applications while guaranteeing the required QoS of user-facing services. Our evaluation on a Nvidia RTX 2080Ti GPU shows that Laius improves the utilization of spatial multitasking accelerators by 20.8%, while achieving the 99%-ile latency target for user-facing services. Wei Zhang 0149, Weihao Cui, Kaihua Fu, Quan Chen 0002, Daniel Mawhirter, Bo Wu 0002, Chao Li 0009, Minyi Guo |
ICS | 6 |
| 2019 | AutoMine: harmonizing high-level abstraction and high performance for graph miningabstractGraph mining algorithms that aim at identifying structural patterns of graphs are typically more complex than graph computation algorithms such as breadth first search. Researchers have implemented several systems with high-level and flexible interfaces customized for tackling graph mining problems. However, we find that for triangle counting, one of the simplest graph mining problems, such systems can be several times slower than a single-threaded implementation of a straightforward algorithm. Daniel Mawhirter, Bo Wu 0002 |
SOSP | 2 |
| 2019 | RFL: Robust fault localization on unreliable communication channels
Bo Wu 0002, Ke Xu 0002, Qi Li 0002, Bingyang Liu, Shoushou Ren, Meng Shen 0001, Kui Ren 0001 |
Comput. Networks | 1 |
| 2018 | Graphphi: efficient parallel graph processing on emerging throughput-oriented architecturesabstractModern parallel architecture design has increasingly turned to throughput-oriented devices to address concerns about energy efficiency and power consumption. However, graph applications cannot tap into the full potential of such architectures because of highly unstructured computations and irregular memory accesses. In this paper, we present GraphPhi, a new approach to graph processing on emerging Intel Xeon Phi-like architectures, by addressing the restrictions of migrating existing graph processing frameworks on shared-memory multi-core CPUs to this new architecture. Alexander Powell, Bo Wu 0002, Tekin Bicer, Bin Ren 0002 |
PACT | 3 |
| 2018 | ApproxG: Fast Approximate Parallel Graphlet Counting Through Accuracy ControlabstractGraphlet counting is a methodology for detecting local structural properties of large graphs that has been in use for over a decade. Despite tremendous effort in optimizing its performance, even 3- and 4-node graphlet counting routines may run for hours or days on highly optimized systems. In this paper, we describe how a synergistic combination of approximate computing with parallel computing can result in multiplicative performance improvements in graphlet counting runtimes with minimal and controllable loss of accuracy. Specifically, we describe two novel techniques, multi-phased sampling for statistical accuracy guarantees and cost-aware sampling to further improve performance on multi-machine runs, which reduce the query time on large graphs from tens of hours to several minutes or seconds with only <;1% relative error. Daniel Mawhirter, Bo Wu 0002, Dinesh Mehta, Chao Ai |
CCGrid | 2 |
| 2018 | Enabling Efficient Source and Path Verification via Probabilistic Packet MarkingabstractThe Internet lacks verification of source authenticity and path compliance between the planned packet delivery paths and the real delivery paths, which allows attackers to construct attacks like source spoofing and traffic hijacking attacks. Thus, it is essential to enable source and path verification in networks to detect forwarding anomalies and ensure correct packet delivery. However, most of the existing security mechanisms can only capture anomalies but are unable to locate the detected anomalies. Besides, they incur significant computation and communication overhead, which exacerbates the packet delivery performance. In this paper, we propose a high-efficient packet forwarding verification mechanism called PPV for networks, which verifies packet source and their forwarding paths in real time. PPV enables probabilistic packet marking in routers instead of verifying all packets. Thus, it can efficiently identify forwarding anomalies by verifying markings. Moreover, it localizes packet forwarding anomalies, e.g., malicious routers, by reconstructing packet forwarding paths based on the packet markings. We implement PPV prototype in Click routers and commodity servers, and conducts real experiments in a real testbed built upon the prototype. The experimental results demonstrate the efficiency and performance of PPV. In particular, PPV significantly improves the throughput and the goodput of forwarding verification, and achieves around 2 times and 3 times improvement compared with the-state-of-art OPT scheme, respectively. Bo Wu 0002, Ke Xu 0002, Qi Li 0002, Zhuotao Liu, Yih-Chun Hu, Martin J. Reed, Meng Shen 0001 |
IWQoS | 1 |
| 2018 | SmartRetro: Blockchain-Based Incentives for Distributed IoT Retrospective DetectionabstractInternet of Things (IoT) has already been in the period of rapid development and widespread deployment, while it is still vulnerable to various malicious attacks. Security detection before system installation is not enough to ensure that IoT devices are always secure, because newly emerging vulnerabilities can still be exploited to launch attacks. To address this issue, retrospective detection is often required to trace the security status of IoT systems. Unfortunately, existing centralized detection mechanisms cannot easily provide a comprehensive security analysis. In particular, consumers cannot automatically receive security notification whenever a new vulnerability is uncovered. In this paper, we propose a novel blockchain-powered incentive platform, called SmartRetro, that can incentivize and attract more distributed detectors to participate in retrospective vulnerability detection and contribute their detection results. Leveraging smart contracts, consumers in SmartRetro receive automatic security feedback about their installed IoT systems. We perform the security and theoretical analysis to demonstrate that SmartRetro achieves our desirable security goals.We further implement SmartRetro prototype on Ethereum to evaluate its performance. Our experimental results show SmartRetro is technically feasible and economically beneficial. Bo Wu 0002, Qi Li 0002, Ke Xu 0002, Ruoyu Li 0003, Zhuotao Liu |
MASS | 1 |
| 2018 | Resolving the GPU responsiveness dilemma through program transformations
Bo Wu 0002, Xipeng Shen, Li Shen 0007, Zhiying Wang 0003 |
Frontiers Comput. Sci. | 2 |
| 2017 | Graphie: Large-Scale Asynchronous Graph Traversals on Just a GPUabstractMost GPU-based graph systems cannot handle large-scale graphs that do not fit in the GPU memory. The ever-increasing graph size demands a scale-up graph system, which can run on a single GPU with optimized memory access efficiency and well-controlled data transfer overhead. However, existing systems either incur redundant data transfers or fail to use shared memory. In this paper we present Graphie, a systemto efficiently traverse large-scale graphs on a single GPU. Graphie stores the vertex attribute data in the GPU memory and streams edge data asynchronously to the GPU for processing. Graphie's high performance relies on two renaming algorithms. The first algorithm renames the vertices so that the source vertices can be easily loaded to the shared memory to reduce global memory accesses. The second algorithm inserts virtual vertices into the vertex set to rename real vertices, which enables the use of a small boolean array to track active partitions. The boolean array also resides in shared memory and can be updated in constant time. The renaming algorithms do not introduce any extra overhead in the GPU memory or graph storage on disk. Graphie's runtime overlaps data transfer with kernel execution and reuses transferred data in the GPU memory. The evaluation of Graphie on 7 real-world graphs with up to 1.8 billion edgesdemonstrates substantial speedups over X-Stream, a state-of-theart edge-centric graph processing framework on the CPU, and GraphReduce, an out-of-memory graph processing systems on GPUs. Daniel Mawhirter, Bo Wu 0002, Matthew Buland |
PACT | 3 |
| 2017 | FLEP: Enabling Flexible and Efficient Preemption on GPUsabstractGPUs are widely adopted in HPC and cloud computing platforms to accelerate general-purpose workloads. However, modern GPUs do not support flexible preemption, leading to performance and priority inversion problems in multi-tasking environments. Bo Wu 0002, Xu Liu 0001, Xiaobo Zhou 0002, Changjun Jiang 0002 |
ASPLOS | 1 |
| 2017 | FinePar: irregularity-aware fine-grained workload partitioning on integrated architectures
Feng Zhang 0007, Bo Wu 0002, Jidong Zhai, Bingsheng He |
CGO | 2 |
| 2017 | Enabling scalability-sensitive speculative parallelization for FSM computationsabstractFinite state machines (FSMs) are the backbone of many applications, but are difficult to parallelize due to their inherent dependencies. Speculative FSM parallelization has shown promise on multicore machines with up to eight cores. However, as hardware parallelism grows (e.g., Xeon Phi has up to 288 logical cores), a fundamental question raises: How does the speculative FSM parallelization scale as the number of cores increases? Without answering this question, existing methods for speculative FSM parallelization simply choose to use all available cores, which might not only waste computing resources, but also result in suboptimal performance. Junqiao Qiu, Zhijia Zhao 0001, Bo Wu 0002, Abhinav Vishnu, Shuaiwen Song |
ICS | 3 |
| 2017 | Robust and lightweight fault localizationabstractThe current network is vulnerable to various attacks, e.g., source spoofing and flow hijacking attacks, which can be constructed by misconfigurations or compromising routers. Unfortunately, both users and network operators are unable to localize these faults. Existing fault localization mechanisms detect such attacks under an assumption that localization is performed upon reliable communication channels. In this paper, we will relax the assumption and propose a robust and lightweight dataplane fault localization (RFL) protocol that aims to achieve source authenticity and path compliance in unreliable communication channels. RFL uses symmetric keys to build secure detection channels and samples packets for localization on the channels such that it can detect and localize faults. In particular, the localization performed is not impacted by the reliability of the communication channels, e.g., the packets that used to localize faults are dropped. We prototype of RFL on Click routers and the experiment results with the prototype demonstrate that RFL achieves more than 99.5% localization accuracy, while only incurring around 10% throughput degradation. Bo Wu 0002, Ke Xu 0002, Qi Li 0002 |
IPCCC | 1 |
| 2017 | Cookie-based amplification repression protocolabstractIn this paper, we propose a Cookie-based Amplification Repression Protocol (CARP) to address the increasing threat of amplification attack. As a replacement of UDP protocol, CARP outperforms previous works in three aspects: i) CARP is a generic solution for all UDP-based amplification attacks regardless of the application protocols; ii) CARP incurs low-latency and introduces no additional latency in most use cases which is suitable for all UDP-based application scenario; iii) CARP supports incremental deployment and plug-and-play. Its interest-driven deployment model makes it much easier to be adopted. We implement a prototype of CARP and evaluate its performance on different metrics. Our results show that CARP is a lightweight and efficient solution for mitigating amplification attack. Kun Sun 0001, Bo Wu 0002, Qi Li 0002 |
IPCCC | 4 |
| 2017 | Co-Run Scheduling with Power Cap on Integrated CPU-GPU SystemsabstractThis paper presents the first systematic study on co-scheduling independent jobs on integrated CPU-GPU systems with power caps considered. It reveals the performance degradations caused by the co-run contentions at the levels of both memory and power. It then examines the problem of using job co-scheduling to alleviate the degradations in this less understood scenario. It offers several algorithms and a lightweight co-run performance and power predictive model for computing the performance bounds of the optimal co-schedules and finding appropriate schedules. Results show that the method can efficiently find co-schedules that significantly improve the system throughput (9-46% on average over the default schedules). Bo Wu 0002, Xipeng Shen, Li Shen 0007, Zhiying Wang 0003 |
IPDPS | 2 |
| 2017 | Understanding co-run performance on CPU-GPU integrated processors: observations, insights, directions
Bo Wu 0002, Xipeng Shen, Li Shen 0007, Zhiying Wang 0003 |
Frontiers Comput. Sci. | 2 |
| 2017 | Optimizing Data Placement on GPU Memory: A Portable ApproachabstractModern GPUs feature complex memory system designs. One GPU may contain many types of memory of different properties. The best way to place data in memory is sensitive to many factors (e.g., program inputs, architectures), making portable optimizations of GPU data placement a difficult challenge. PORPLE is a recently proposed method that overcomes the difficulties by enabling online optimizations of data placement through a three-way synergy: a specification language for memory system description, a compiler framework for data access analysis and code staging, and a runtime library for efficiently finding and materializing data placement on the fly. This article provides a comprehensive description of this method, and presents several extensions that significantly improve the scalability of PORPLE, which include a novel algorithm design for efficiently searching for the best data placements, the use of active profiling for reducing the online-profiling overhead, and a systematic examination of a path-based performance model. By automatically tailoring data placements for each execution of a GPU program, the enhanced PORPLE brings significant speedups (1.72X on average) to many GPU kernels across GPU architectures and program inputs. Guoyang Chen, Xipeng Shen, Bo Wu 0002, Dong Li 0001 |
IEEE Trans. Computers | 3 |
| 2016 | Examining and Reducing the Influence of Sampling Errors on Feedback-Driven OptimizationsabstractFeedback-driven optimization (FDO) is an important component in mainstream compilers. By allowing the compiler to reoptimize the program based on some profiles of the program's dynamic behaviors, it often enhances the quality of the generated code substantially. A barrier for using FDO is that it often requires many training runs to collect enough profiles to amortize the sensitivity of program optimizations to program input changes. Various sampling techniques have been explored to alleviate this time-consuming process. However, the lowered profile accuracy caused by sampling often hurts the benefits of FDO. This article gives the first systematic study in how sampling rates affect the accuracy of collected profiles and how the accuracy correlates with the usefulness of the profile for modern FDO. Studying basic block and edge profiles for FDO in two mature compilers reveals several counterintuitive observations, one of which is that profiling accuracy does not strongly correlate with the benefits of the FDO. A detailed analysis identifies three types of sampling-caused errors that critically impair the quality of the profiles for FDO. It then introduces a simple way to rectify profiles based on the findings. Experiments demonstrate that the simple rectification fixes most of those critical errors in sampled profiles and significantly enhances the effectiveness of FDO. Mingzhou Zhou, Bo Wu 0002, Xipeng Shen, Yaoqing Gao, Graham Yiu |
ACM Trans. Archit. Code Optim. | 2 |
| 2015 | Software Engagement with Sleeping CPUs
Bo Wu 0002, Xipeng Shen, Zhiying Wang 0003 |
HotOS | 3 |
| 2015 | Enabling and Exploiting Flexible Task Assignment on GPU through SM-Centric Program TransformationsabstractA GPU's computing power lies in its abundant memory bandwidth and massive parallelism. However, its hardware thread schedulers, despite being able to quickly distribute computation to processors, often fail to capitalize on program characteristics effectively, achieving only a fraction of the GPU's full potential. Moreover, current GPUs do not allow programmers or compilers to control this thread scheduling, forfeiting important optimization opportunities at the program level. This paper presents a transformation centered on Streaming Multiprocessors (SM); this software approach to circumventing the limitations of the hardware scheduler allows flexible program-level control of scheduling. By permitting precise control of job locality on SMs, the transformation overcomes inherent limitations in prior methods. Bo Wu 0002, Guoyang Chen, Dong Li 0001, Xipeng Shen, Jeffrey S. Vetter |
ICS | 1 |
| 2015 | Lifetime maximization in rechargeable wireless sensor networks with charging interferenceabstractRadio Frequency based Wireless Power Transfer (RF-WPT) technology is recognized as a promising way to charge low-power wireless devices. But the application of RF-WPT in wireless sensor networks also introduces charging interference to wireless communications. The network lifetime maximization by jointly considering wireless charging and data transmission under interference concerns, however, has seldom been examined. In this paper, we take initial steps to consider communication and charger scheduling together in wireless sensor networks. We propose a smart interference-aware scheduling to maximize the network lifetime and avoid potential data loss caused by charging interference. The evaluation result indicates that the proposed design can guarantee 99% optimality and significantly improve network lifetime. Ke Xu 0002, Dan Wang 0002, Bo Wu 0002 |
IPCCC | 5 |
| 2015 | ScaAnalyzer: a tool to identify memory scalability bottlenecks in parallel programsabstractIt is difficult to scale parallel programs in a system that employs a large number of cores. To identify scalability bottlenecks, existing tools principally pinpoint poor thread synchronization strategies or unnecessary data communication. Memory subsystem is one of the key contributors to poor parallel scaling in multicore machines. State-of-the-art tools, however, either lack sophisticated capabilities or are completely ignorant in pinpointing scalability bottlenecks arising from the memory subsystem. To address this issue, we develop a tool---ScaAnalyzer---to pinpoint scaling losses due to poor memory access behaviors of parallel programs. ScaAnalyzer collects, attributes, and analyzes memory-related metrics during program execution while incurring very low overhead. ScaAnalyzer provides high-level, detailed guidance to programmers for scalability optimization. We demonstrate the utility of ScaAnalyzer with case studies of three parallel programs. For each benchmark, ScaAnalyzer identifies scalability bottlenecks caused by poor memory access behaviors and provides optimization guidance that yields significant improvement in scalability. Xu Liu 0001, Bo Wu 0002 |
SC | 2 |
| 2014 | SM-centric transformation: circumventing hardware restrictions for flexible GPU schedulingabstractTo circumvent the limitation from the hardware scheduler on GPU, we create an SM-centric transformation technique. This technique enables complete control of the mapping between tasks and streaming multi-processors (SMs), and enables controlling the number of active thread blocks on each SM. Results show that our approach achieves better speedup than previous ones with kernel co-run cases. Bo Wu 0002, Guoyang Chen, Dong Li 0001, Xipeng Shen, Jeffrey S. Vetter |
PACT | 1 |
| 2014 | Challenging the "embarrassingly sequential": parallelizing finite state machine-based computations through principled speculationabstractFinite-State Machine (FSM) applications are important for many domains. But FSM computation is inherently sequential, making such applications notoriously difficult to parallelize. Most prior methods address the problem through speculations on simple heuristics, offering limited applicability and inconsistent speedups. Zhijia Zhao 0001, Bo Wu 0002, Xipeng Shen |
ASPLOS | 2 |
| 2014 | PORPLE: An Extensible Optimizer for Portable Data Placement on GPUabstractGPU is often equipped with complex memory systems, including globalmemory, texture memory, shared memory, constant memory, and variouslevels of cache. Where to place the data is important for theperformance of a GPU program. However, the decision is difficult for aprogrammer to make because of architecture complexity and thesensitivity of suitable data placements to input and architecturechanges.This paper presents PORPLE, a portable data placement engine thatenables a new way to solve the data placement problem. PORPLE consistsof a mini specification language, a source-to-source compiler, and a runtime data placer. The language allows an easy description of amemory system; the compiler transforms a GPU program into a formamenable to runtime profiling and data placement; the placer, based onthe memory description and data access patterns, identifies on the flyappropriate placement schemes for data and places themaccordingly. PORPLE is distinctive in being adaptive to program inputsand architecture changes, being transparent to programmers (in mostcases), and being extensible to new memory architectures. Ourexperiments on three types of GPU systems show that PORPLE is able toconsistently find optimal or near-optimal placement despite the largedifferences among GPU architectures and program inputs, yielding up to2.08X (1.59X on average) speedups on a set of regular and irregularGPU benchmarks. Guoyang Chen, Bo Wu 0002, Dong Li 0001, Xipeng Shen |
MICRO | 2 |
| 2014 | Call sequence prediction through probabilistic calling automataabstractPredicting a sequence of upcoming function calls is important for optimizing programs written in modern managed languages (e.g., Java, Javascript, C#.) Existing function call predictions are mainly built on statistical patterns, suitable for predicting a single call but not a sequence of calls. This paper presents a new way to enable call sequence prediction, which exploits program structures through Probabilistic Calling Automata (PCA), a new program representation that captures both the inherent ensuing relations among function calls, and the probabilistic nature of execution paths. It shows that PCA-based prediction outperforms existing predictions, yielding substantial speedup when being applied to guide Just-In-Time compilation. By enabling accurate, efficient call sequence prediction for the first time, PCA-based predictors open up many new opportunities for dynamic program optimizations. Zhijia Zhao 0001, Bo Wu 0002, Mingzhou Zhou, Yufei Ding 0001, Xipeng Shen, Youfeng Wu |
OOPSLA | 2 |
| 2013 | Exploring hybrid memory for GPU energy efficiency through software-hardware co-designabstractHybrid memory designs, such as DRAM plus Phase Change Memory (PCM), have shown some promise for alleviating power and density issues faced by traditional memory systems. But previous studies have concentrated on CPU systems with a modest level of parallelism. This work studies the problem in a massively parallel setting. Specifically, it investigates the special implications to hybrid memory imposed by the massive parallelism in GPU. It empirically shows that, contrary to promising results demonstrated for CPU, previous designs of PCM-based hybrid memory result in significant degradation to the energy efficiency of GPU. It reveals that the fundamental reason comes from a multi-facet mismatch between those designs and the massive parallelism in GPU. It presents a solution that centers around a close cooperation between compiler-directed data placement and hardware-assisted runtime adaptation. The co-design approach helps tap into the full potential of hybrid memory for GPU without requiring dramatic hardware changes over previous designs, yielding 6% and 49% energy saving on average compared to pure DRAM and pure PCM respectively, and keeping performance loss less than 2%. Bin Wang 0019, Bo Wu 0002, Dong Li 0001, Xipeng Shen, Weikuan Yu, Yizheng Jiao, Jeffrey S. Vetter |
PACT | 2 |
| 2013 | Profmig: A framework for flexible migration of program profiles across software versionsabstractOffline program profiling is costly, especially when software update is frequent. In this paper, we initiate a systematic exploration in cross-version program profile migration, which tries to effectively reuse the valid part of the behavior profiles of an old version of a software for a new version. We explore the effects imposed on profile reusability by the various factors in program behaviors, profile formats, and impact analysis, and introduce ProfMig, a framework for flexible migrations of various profiles. We demonstrate the effectiveness of the techniques on migrating loop trip-count profiles and dynamic call graphs. The migration saves significant (48-67% on average) profiling time with less than 10% accuracy compromised for most programs. Mingzhou Zhou, Bo Wu 0002, Yufei Ding 0001, Xipeng Shen |
CGO | 2 |
| 2013 | Simple Profile Rectifications Go a Long Way - Statistically Exploring and Alleviating the Effects of Sampling Errors for Program Optimizations
Bo Wu 0002, Mingzhou Zhou, Xipeng Shen, Yaoqing Gao, Raúl Silvera, Graham Yiu |
ECOOP | 1 |
| 2013 | Complexity analysis and algorithm design for reorganizing data to minimize non-coalesced memory accesses on GPUabstractThe performance of Graphic Processing Units (GPU) is sensitive to irregular memory references. Some recent work shows the promise of data reorganization for eliminating non-coalesced memory accesses that are caused by irregular references. However, all previous studies have employed simple, heuristic methods to determine the new data layouts to create. As a result, they either do not provide any performance guarantee or are effective to only some limited scenarios. This paper contributes a fundamental study to the problem. It systematically analyzes the inherent complexity of the problem in various settings, and for the first time, proves that the problem is NP-complete. It then points out the limitations of existing techniques and reveals that in practice, the essence for designing an appropriate data reorganization algorithm can be reduced to a tradeoff among space, time, and complexity. Based on that insight, it develops two new data reorganization algorithms to overcome the limitations of previous methods. Experiments show that an assembly composed of the new algorithms and a previous algorithm can circumvent the inherent complexity in finding optimal data layouts, making it feasible to minimize non-coalesced memory accesses for a variety of irregular applications and settings that are beyond the reach of existing techniques. Bo Wu 0002, Zhijia Zhao 0001, Eddy Z. Zhang, Yunlian Jiang, Xipeng Shen |
PPoPP | 1 |
| 2012 | Speculative parallelization needs rigor: probabilistic analysis for optimal speculation of finite-state machine applicationsabstractSoftware speculative parallelization has shown effectiveness in parallelizing certain applications. Prior techniques have mainly relied on simple exploitation of heuristics for speculation. In this work, we introduce probabilistic analysis into the design of speculation schemes. In particular, by tackling applications that are based on Finite State Machine (FSM) which have the most prevalent dependences among all programs, we show that the obstacles for effective speculation can be much better handled with rigor. We develop a probabilistic model to formulate the relations between speculative executions and the properties of the target computation and inputs. Based on the formulation, we propose two model-based speculation schemes that automatically customize themselves with the best configurations for a given FSM and its inputs. The new technique produces substantial speedup over the state of the art. Zhijia Zhao 0001, Bo Wu 0002, Xipeng Shen |
PACT | 2 |
| 2012 | One stone two birds: synchronization relaxation and redundancy removal in GPU-CPU translationabstractAs an approach to promoting whole-system synergy on a heterogeneous computing system, compilation of fine-grained SPMD-threaded code(e.g., GPU CUDA code) for multicore CPU has drawn some recent attentions. This paper concentrates on two important sources of inefficiency that limit existing translators. The first is overly strong synchronizations; the second is thread-level partially redundant computations. In this paper, we point out that both kinds of inefficiency essentially come from a single reason: the non-uniformity among threads. Based on that observation, we present a thread-level dependence analysis, which leads to a code generator with three novel features: an instance-level instruction scheduler for synchronization relaxation, a graph pattern recognition scheme for code shape optimization, and a fine-grained analysis for thread-level partial redundancy removal. Experiments show that the unified solution is effective in resolving both inefficiencies, yielding speedup as much as a factor of 14. Bo Wu 0002, Xipeng Shen |
ICS | 2 |
| 2012 | Exploiting inter-sequence correlations for program behavior predictionabstractPrediction of program dynamic behaviors is fundamental to program optimizations, resource management, and architecture reconfigurations. Most existing predictors are based on locality of program behaviors, subject to some inherent limitations. In this paper, we revisit the design philosophy and systematically explore a second source of clues: statistical correlations between the behavior sequences of different program entities. Concentrated on loops, it examines the correlations' existence, strength, and values in enhancing the design of program behavior predictors. It creates the first taxonomy of program behavior sequence patterns. It develops a new form of predictors, named sequence predictors, to effectively translate the correlations into large-scope, proactive predictions of program behavior sequences. It demonstrates the usefulness of the prediction in dynamic version selection and loop importance estimation, showing 19% average speedup on a number of real-world utility applications. By taking scope and timing of behavior prediction as the first-order design objectives, the new approach overcomes limitations of existing program behavior predictors, opening up many new opportunities for runtime optimizations at various layers of computing. Bo Wu 0002, Zhijia Zhao 0001, Xipeng Shen, Yunlian Jiang, Yaoqing Gao, Raúl Silvera |
OOPSLA | 1 |
| 2011 | Enhancing Data Locality for Dynamic Simulations through Asynchronous Data Transformations and Adaptive ControlabstractMany dynamic simulation programs contain complex, irregular memory reference patterns, and require runtime optimizations to enhance data locality. Current approaches periodically stop the execution of an application to reorder the computation or data based on the current program state to improve the data locality for the next period of execution. In this work, we examine the implications that modern heterogeneous Chip Multiprocessors (CMP) architecture imposes on the optimization paradigm. We develop three techniques to enhance the optimizations. The first is asynchronous data transformation, which moves data reordering off the critical path through dependence circumvention. The second is a novel data transformation algorithm, named TLayout, designed specially to take advantage of modern throughput-oriented processors. Together they provide two complementary ways to attack a benefit-overhead dilemma inherited in traditional techniques. Working with a dynamic adaptation scheme, the techniques produce significant performance improvement for a set of dynamic simulation benchmarks. Bo Wu 0002, Eddy Z. Zhang, Xipeng Shen |
PACT | 1 |