Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Minghong Fang

dblp:157/0863 · DBLP profile ↗
← Back
42ranked-venue papers
11as first author
35since 2021 · last 2026
0000-0002-1365-3911ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Security and privacy · 15 · 6 first-author · 13 since 2021Artificial intelligence and machine learning · 9 · 9 since 2021Applied, interdisciplinary, general and emerging computing · 9 · 4 first-author · 6 since 2021Computer networks · 7 · 1 first-author · 5 since 2021Databases, data management, data science and information retrieval · 7 · 3 first-author · 6 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 2 since 2021Systems, architecture and hardware · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Network and information security
16 papers
Security and privacy of machine learning · 83% Privacy and data protection · 12% Digital forensics and information hiding · 4%
Artificial intelligence
14 papers
Efficient and distributed learning · 82% Trustworthy machine learning · 14% Learning theory · 4%
Databases, data mining, and information retrieval
4 papers
Recommender systems · 79% Data integration and cleaning · 21%
Computer networks
1 paper
Cellular and mobile networks · 56% Wireless networking · 44%

Topics — the 30 heaviest of 40, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Efficient and distributed learning
federated learning
5.4102026
Practical Framework for Privacy-Preserving and Byzantine-Robust Federated Learning · IEEE Trans. Inf. Forensics Secur. 2026
Model Poisoning Attacks to Federated Learning via Multi-Round Consistency · CVPR 2025
FedREDefense: Defending against Model Poisoning Attacks for Federated Learning using Model Update Reconstruction Error · ICML 2024
Security and privacy of machine learning
poisoning attack
4.772025
Periodic Recovery From Poisoning Attacks in Machine Learning · IEEE Trans. Dependable Secur. Comput. 2025
Provably Robust Federated Reinforcement Learning · WWW 2025
Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learning · ICCV 2025
Security and privacy of machine learning › poisoning attack
model poisoning attack
2.132025
Model Poisoning Attacks to Federated Learning via Multi-Round Consistency · CVPR 2025
FedREDefense: Defending against Model Poisoning Attacks for Federated Learning using Model Update Reconstruction Error · ICML 2024
Local Model Poisoning Attacks to Byzantine-Robust Federated Learning · USENIX Security Symposium 2020
Security and privacy of machine learning
retrieval-augmented generation security
1.922026
Who Taught the Lie? Responsibility Attribution for Poisoned Knowledge in Retrieval-Augmented Generation · SP 2026
Traceback of Poisoning Attacks to Retrieval-Augmented Generation · WWW 2025
Machine learning › Efficient and distributed learning › federated learning
federated learning security
1.722025
Tracing Back the Malicious Clients in Poisoning Attacks to Federated Learning · NeurIPS 2025
Competitive Advantage Attacks to Decentralized Federated Learning · NeurIPS 2025
Machine learning › Trustworthy machine learning
robustness
1.632025
Competitive Advantage Attacks to Decentralized Federated Learning · NeurIPS 2025
FLTrust: Byzantine-robust Federated Learning via Trust Bootstrapping · NDSS 2021
Byzantine-Robust Decentralized Federated Learning · CCS 2024
Machine learning › Efficient and distributed learning › federated learning › robust federated learning
byzantine-robust federated learning
1.522026
Practical Framework for Privacy-Preserving and Byzantine-Robust Federated Learning · IEEE Trans. Inf. Forensics Secur. 2026
FLTrust: Byzantine-robust Federated Learning via Trust Bootstrapping · NDSS 2021
Privacy and data protection › privacy-preserving machine learning
federated learning privacy
1.322026
Practical Framework for Privacy-Preserving and Byzantine-Robust Federated Learning · IEEE Trans. Inf. Forensics Secur. 2026
Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learning · ICCV 2025
Security and privacy of machine learning › federated learning defense
byzantine-robust federated learning
1.222024
Byzantine-Robust Decentralized Federated Learning · CCS 2024
Local Model Poisoning Attacks to Byzantine-Robust Federated Learning · USENIX Security Symposium 2020
Security and privacy of machine learning › adversarial attack › backdoor attack
backdoor defense
1.012026
SecureSplit: Mitigating Backdoor Attacks in Split Learning · WWW 2026
Security and privacy of machine learning › retrieval-augmented generation security
knowledge poisoning
1.012026
Who Taught the Lie? Responsibility Attribution for Poisoned Knowledge in Retrieval-Augmented Generation · SP 2026
Machine learning › Trustworthy machine learning › robustness
byzantine robustness
0.912025
Provably Robust Federated Reinforcement Learning · WWW 2025
Machine learning › Efficient and distributed learning › federated learning › federated sequential learning
federated reinforcement learning
0.912025
Provably Robust Federated Reinforcement Learning · WWW 2025
Machine learning › Efficient and distributed learning › federated learning
robust federated learning
0.912025
Model Poisoning Attacks to Federated Learning via Multi-Round Consistency · CVPR 2025
Cellular and mobile networks › mobility management › handover
seamless handover
0.912025
A Power Line Backbone-Assisted Wireless Transit Network · ICNP 2025
Privacy and data protection › privacy-enhancing technologies
data deletion
0.912025
Periodic Recovery From Poisoning Attacks in Machine Learning · IEEE Trans. Dependable Secur. Comput. 2025
Security and privacy of machine learning › federated learning security
federated learning attack
0.912025
Model Poisoning Attacks to Federated Learning via Multi-Round Consistency · CVPR 2025
Security and privacy of machine learning
machine unlearning
0.912025
Periodic Recovery From Poisoning Attacks in Machine Learning · IEEE Trans. Dependable Secur. Comput. 2025
Digital forensics and information hiding › attack investigation
malicious user tracing
0.912025
Tracing Back the Malicious Clients in Poisoning Attacks to Federated Learning · NeurIPS 2025
Security and privacy of machine learning
membership inference
0.912025
Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learning · ICCV 2025
Distributed systems
fault tolerance
0.912025
Do We Really Need to Design New Byzantine-robust Aggregation Rules? · NDSS 2025
Machine learning › Efficient and distributed learning
distributed training
0.822026
Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learning · ICLR 2021
SecureSplit: Mitigating Backdoor Attacks in Split Learning · WWW 2026
Machine learning › Efficient and distributed learning › federated learning
decentralized federated learning
0.812024
Byzantine-Robust Decentralized Federated Learning · CCS 2024
Machine learning › Learning theory
PAC learning
0.812024
Understanding Server-Assisted Federated Learning in the Presence of Incomplete Client Participation · ICML 2024
Machine learning › Efficient and distributed learning › federated learning
partial client participation
0.812024
Understanding Server-Assisted Federated Learning in the Presence of Incomplete Client Participation · ICML 2024
Machine learning › Efficient and distributed learning › federated learning › model aggregation
robust aggregation
0.812024
FedREDefense: Defending against Model Poisoning Attacks for Federated Learning using Model Update Reconstruction Error · ICML 2024
Recommender systems
federated recommendation
0.812024
Poisoning Federated Recommender Systems with Fake Users · WWW 2024
Security and privacy of machine learning
federated learning defense
0.812024
FedREDefense: Defending against Model Poisoning Attacks for Federated Learning using Model Update Reconstruction Error · ICML 2024
Security and privacy of machine learning
large language model safety
0.812024
GradSafe: Detecting Jailbreak Prompts for LLMs via Safety-Critical Gradient Analysis · ACL (1) 2024
Machine learning › Efficient and distributed learning › federated learning › data heterogeneity
non-IID federated learning
0.512021
Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learning · ICLR 2021

Methods — techniques the papers use, named apart from their topics

byzantine-robust aggregation · 5.5optimization · 2.7majority-based voting · 2.0dimensionality transformation · 2.0dimensionality reduction · 2.0adaptive tuning · 2.0adaptive filtering · 2.0convergence analysis · 1.5unsupervised clustering · 1.0semantic relevance scoring · 1.0retrieval ranking analysis · 1.0multi-round consistency · 0.9model poisoning · 0.9link quality characterization · 0.9hessian diagonal estimation · 0.9gradient estimation · 0.9certified recovery · 0.9matrix factorization · 0.4
YearPublicationVenuePosition
2026 SecureAFL: Secure Asynchronous Federated Learning
Anjun Gao, Zhenglin Wan, Yueyang Quan, Zhuqing Liu, Minghong Fang
AsiaCCS6
2026 ClieND: Client-Side Neuron-Level Detection against Poisoning Attacks on Cross-Silo Federated Learning
abstract
Poisoning attacks have been shown to pose significant threats to federated learning (FL), including both untargeted and targeted attacks. To mitigate such threats, the majority of existing defenses are implemented on the server side during the aggregation process. However, as data remains inherently local in FL, these defenses either rely on unreliable statistical or structural properties of local updates, or make strong assumptions that rely on dataset information. As a result, the unique advantage of clients having access to trusted local data and training dynamics has been largely overlooked. In this work, we propose ClieND1, a novel client-side detection framework that shifts the detection of poisoning attacks from the server to the client. Specifically, ClieND enables each client to maintain the neuron importance scores of the aggregated global model in each round by leveraging its local dataset. Through tracking the inter-round changes in these scores, each client detects abnormal behavior by identifying significant discrepancy spikes, which serve as indicators of potential poisoning attacks. To evaluate the effectiveness of ClieND, we compare it against three state-of-the-art baselines under both targeted and untargeted poisoning attacks, and also assess its ability to detect attacks at an early stage. Experimental results show that ClieND achieves a false positive rate (FPR) as low as 0.01 and a true positive rate (TPR) of up to 0.99, which significantly outperforms server-side defenses, demonstrating its high detection accuracy. Additionally, the existence of poisoning attacks, even those launched by adaptive settings, can be detected in an early stage within 5 communication rounds.
Mengyao Ma, Shuofeng Liu, Viet Vo, Minghong Fang, Surya Nepal, Guangdong Bai
AsiaCCS4
2026 Network Digital Untwinning: Towards Backward Optimization of Digital Twins
Dianwei Chen, Anjun Gao, Manhua Wang, Mingzhe Chen, Minghong Fang
ICDCS6
2026 Practical Poisoning Attacks against Retrieval-Augmented Generation
abstract
Large language models (LLMs) have demonstrated impressive natural language processing abilities but face challenges such as hallucination and outdated knowledge. Retrieval-Augmented Generation (RAG) has emerged as a state-of-the-art approach to mitigate these issues. While RAG enhances LLM outputs, it remains vulnerable to poisoning attacks. Recent studies show that injecting poisoned texts into the knowledge database can compromise RAG systems, but most existing attacks assume that the attacker can insert a sufficient number of poisoned texts per query to outnumber correct-answer texts in retrieval, an assumption that is often unrealistic. To address this limitation, we propose CorruptRAG, a practical poisoning attack against RAG systems in which the attacker injects only a single poisoned text, enhancing both feasibility and stealth. Extensive experiments conducted on multiple large-scale datasets demonstrate that CorruptRAG achieves higher attack success rates than existing baselines.
Baolei Zhang, Zhuqing Liu, Lihai Nie, Tong Li 0011, Zheli Liu, Minghong Fang
SACMAT7
2026 Who Taught the Lie? Responsibility Attribution for Poisoned Knowledge in Retrieval-Augmented Generation
abstract
Retrieval-Augmented Generation (RAG) integrates external knowledge into large language models to improve response quality. However, recent work has shown that RAG systems are highly vulnerable to poisoning attacks, where malicious texts are inserted into the knowledge database to influence model outputs. While several defenses have been proposed, they are often circumvented by more adaptive or sophisticated attacks. This paper presents RAGOrigin, a black-box responsibility attribution framework designed to identify which texts in the knowledge database are responsible for misleading or incorrect generations. Our method constructs a focused attribution scope tailored to each misgeneration event and assigns a responsibility score to each candidate text by evaluating its retrieval ranking, semantic relevance, and influence on the generated response. The system then isolates poisoned texts using an unsupervised clustering method. We evaluate RAGOrigin across seven datasets and fifteen poisoning attacks, including newly developed adaptive poisoning strategies and multi-attacker scenarios. Our approach outperforms existing baselines in identifying poisoned content and remains robust under dynamic and noisy conditions. These results suggest that RAGOrigin provides a practical and effective solution for tracing the origins of corrupted knowledge in RAG systems. Our code is available at: https://github.com/zhangbl6618/RAG-Responsibility-Attribution
Baolei Zhang, Haoran Xin 0002, Zhuqing Liu, Biao Yi, Tong Li 0011, Lihai Nie, Zheli Liu, Minghong Fang
SP9
2026 When the Server Steps In: Calibrated Updates for Fair Federated Learning
Tianrun Yu, Kaixiang Zhao, Anjun Gao, Yueyang Quan, Zhuqing Liu, Minghong Fang
WiOpt7
2026 SecureSplit: Mitigating Backdoor Attacks in Split Learning
abstract
Split Learning (SL) offers a framework for collaborative model training that respects data privacy by allowing participants to share the same dataset while maintaining distinct feature sets. However, SL is susceptible to backdoor attacks, in which malicious clients subtly alter their embeddings to insert hidden triggers that compromise the final trained model. To address this vulnerability, we introduce SecureSplit, a defense mechanism tailored to SL. SecureSplit applies a dimensionality transformation strategy to accentuate subtle differences between benign and poisoned embeddings, facilitating their separation. With this enhanced distinction, we develop an adaptive filtering approach that uses a majority-based voting scheme to remove contaminated embeddings while preserving clean ones. Rigorous experiments across four datasets (CIFAR-10, MNIST, CINIC-10, and ImageNette), five backdoor attack scenarios, and seven alternative defenses confirm the effectiveness of SecureSplit under various challenging conditions.
Zhihao Dou, Dongfei Cui, Weida Wang, Anjun Gao, Yueyang Quan, Mengyao Ma, Viet Vo, Guangdong Bai, Zhuqing Liu, Minghong Fang
WWW10
2026 Practical Framework for Privacy-Preserving and Byzantine-Robust Federated Learning
abstract
Federated Learning (FL) allows multiple clients to collaboratively train a model without sharing their private data. However, FL is vulnerable toByzantine attacks, where adversaries manipulate client models to compromise the federated model, andprivacy inference attacks, where adversaries exploit client models to infer private data. Existing defenses against both backdoor and privacy inference attacks introduce significant computational and communication overhead, creating a gap between theory and practice. To address this, we propose ABBR, a practical framework for Byzantine-robust and privacy-preserving FL. We are the first to utilize dimensionality reduction to speed up the private computation of complex filtering rules in privacy-preserving FL. Additionally, we analyze the accuracy loss of vector-wise filtering in low-dimensional space and introduce an adaptive tuning strategy to minimize the impact of malicious models that bypass filtering on the global model. We implement ABBR with state-of-the-art Byzantine-robust aggregation rules and evaluate it on public datasets, showing that it runs significantly faster, has minimal communication overhead, and maintains nearly the same Byzantine-resilience as the baselines.
Baolei Zhang, Minghong Fang, Zhuqing Liu, Biao Yi, Peizhao Zhou, Tong Li 0011, Zheli Liu
IEEE Trans. Inf. Forensics Secur.2
2025 Toward Malicious Clients Detection in Federated Learning
Zhihao Dou, Wei Sun 0013, Zhuqing Liu, Minghong Fang
AsiaCCS5
2025 Secure Retrieval-Augmented Generation Against Poisoning Attacks
Zirui Cheng, Jikai Sun, Anjun Gao, Yueyang Quan, Zhuqing Liu, Xiaohua Hu 0001, Minghong Fang
IEEE Big Data7
2025 Model Poisoning Attacks to Federated Learning via Multi-Round Consistency
abstract
Model poisoning attacks are critical security threats to Federated Learning (FL). Existing model poisoning attacks suffer from two key limitations: 1) they achieve suboptimal effectiveness when defenses are deployed, and/or 2) they require knowledge of the model updates or local training data on genuine clients. In this work, we make a key observation that their suboptimal effectiveness arises from only leveraging model-update consistency among malicious clients within individual training rounds, making the attack effect self-cancel across training rounds. In light of this observation, we propose PoisonedFL, which enforces multi-round consistency among the malicious clients’ model updates while not requiring any knowledge about the genuine clients. Our empirical evaluation on five benchmark datasets shows that PoisonedFL breaks eight state-of-the-art defenses and outperforms seven existing model poisoning attacks. Our study shows that FL systems are considerably less robust than previously thought, underlining the urgency for the development of new defense mechanisms. Our source code is available at https://github.com/xyq7/PoisonedFL/.
Yueqi Xie, Minghong Fang, Neil Zhenqiang Gong
CVPR2
2025 Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learning
abstract
Federated learning (FL) allows multiple clients to collaboratively train a global machine learning model with coordination from a central server, without needing to share their raw data. This approach is particularly appealing in the era of privacy regulations like the GDPR, leading many prominent companies to adopt it. However, FL's distributed nature makes it susceptible to poisoning attacks, where malicious clients, controlled by an attacker, send harmful data to compromise the model. Most existing poisoning attacks in FL aim to degrade the model's integrity, such as reducing its accuracy, with limited attention to privacy concerns from these attacks. In this study, we introduce FedPoisonMIA, a novel poisoning membership inference attack targeting FL. FedPoisonMIA involves malicious clients crafting local model updates to infer membership information. Additionally, we propose a robust defense mechanism to mitigate the impact of FedPoisonMIA attacks. Extensive experiments across various datasets demonstrate the attack's effectiveness, while our defense approach reduces its impact to a degree.
Wenjin Mo, Minghong Fang, Mingwei Fang
ICCV3
2025 A Power Line Backbone-Assisted Wireless Transit Network
abstract
Power line communication (PLC) is emerging as the preferred connectivity solution to enlarge WiFi’s communication range for mobile clients. However, we have to consider the mobility in power-line assisted WiFi for a seamless mobile experience and wide connectivity. To this end, in this paper, we exploit the power line backbone to achieve seamless mobility and wide connectivity for mobile clients in a power line-assisted wireless transit network. To do so, we introduce TurboGrid that characterizes the power-line backbone and allows the network infrastructure to make performance-impacting decisions on roaming between PLC adapters. We first characterize the power line channel over time and space in the powerline infrastructure. Then, we show that the existing WiFi handover approaches cannot be directly applied when integrating power lines to assist WiFi communication. Therefore, we propose to integrate the link quality on the power line backbone with link quality over the air for seamless mobile client switching. The systematic evaluation and implementation of commodity WiFi AP and PLC adapters show the efficacy of our TurboGrid during the mobile client’s mobility.
Wei Sun 0013, Minghong Fang
ICNP2
2025 Enhancing Privacy in Decentralized Min-Max Optimization: A Differentially Private Approach
abstract
Decentralized min-max optimization allows multi-agent systems to collaboratively solve global min-max optimization problems by facilitating the exchange of model updates among neighboring agents, eliminating the need for a central server. However, sharing model updates in such systems carry a risk of exposing sensitive data to inference attacks, raising significant privacy concerns. To mitigate these privacy risks, differential privacy (DP) has become a widely adopted technique for safeguarding individual data. Despite its advantages, implementing DP in decentralized min-max optimization poses challenges, as the added noise can hinder convergence, particularly in non-convex scenarios with complex agent interactions in min-max optimization problems. In this work, we propose an algorithm called DPMixSGD (Differential Private Minmax Hybrid Stochastic Gradient Descent), a novel privacy-preserving algorithm specifically designed for non-convex decentralized min-max optimization. Our method builds on the state-of-the-art STORM-based algorithm, one of the fastest decentralized min-max solutions. We rigorously prove that the noise added to local gradients does not significantly compromise convergence performance, and we provide theoretical bounds to ensure privacy guarantees. To validate our theoretical findings, we conduct extensive experiments across various tasks and models, demonstrating the effectiveness of our approach.
Yueyang Quan, Shengjie Zhai, Minghong Fang, Zhuqing Liu
MobiHoc4
2025 On Transferring, Merging, and Splitting Task-Oriented Network Digital Twins
abstract
The integration of digital twinning technologies is driving next-generation networks toward new capabilities, allowing operators to thoroughly understand network conditions, efficiently analyze valuable radio data, and innovate applications through user-friendly, immersive interfaces. Building on this foundation, network digital twins (NDTs) accurately depict the operational processes and attributes of network infrastructures, facilitating predictive management through real-time analysis and measurement. However, constructing precise NDTs poses challenges, such as integrating diverse data sources, mapping necessary attributes from physical networks, and maintaining scalability for various downstream tasks. Unlike previous works that focused on the creation and mapping of NDTs from scratch, we explore intra- and inter-operations among NDTs within a Unified Twin Transformation (UTT) framework, which uncovers a new computing paradigm for efficient transfer, merging, and splitting of NDTs to create task-oriented twins. By leveraging joint multi-modal and distributed mapping mechanisms, UTT optimizes resource utilization and reduces the cost of creating NDTs, while ensuring twin model consistency. A theoretical analysis of the distributed mapping problem is conducted to establish convergence bounds for this multi-modal gated aggregation process. Evaluations on real-world twin-assisted applications, such as trajectory reconstruction, human localization, and sensory data generation, demonstrate the feasibility and effectiveness of interoperability among NDTs for corresponding task development.
Minghong Fang, Mingzhe Chen, Yuchen Liu 0001
MSWiM2
2025 Do We Really Need to Design New Byzantine-robust Aggregation Rules?
Minghong Fang, Seyedsina Nabavirazavi, Zhuqing Liu, Wei Sun 0013, S. Sitharama Iyengar, Haibo Yang 0001
NDSS1
2025 Competitive Advantage Attacks to Decentralized Federated Learning
abstract
Decentralized federated learning (DFL) enables clients (e.g., hospitals and banks) to jointly train machine learning models without a central orchestration server. In each global training round, each client trains a local model on its own training data and then they exchange local models for aggregation. In this work, we propose SelfishAttack, a new family of attacks to DFL. In SelfishAttack, a set of selfish clients aim to achieve competitive advantages over the remaining non-selfish ones, i.e., the final learnt local models of the selfish clients are more accurate than those of the non-selfish ones. Towards this goal, the selfish clients send carefully crafted local models to each remaining non-selfish one in each global training round. We formulate finding such local models as an optimization problem and propose methods to solve it when DFL uses different aggregation rules. Theoretically, we show that our methods find the optimal solutions to the optimization problem. Empirically, we show that SelfishAttack successfully increases the accuracy gap (i.e., competitive advantage) between the final learnt local models of selfish clients and those of non-selfish ones. Moreover, SelfishAttack achieves larger accuracy gaps than poisoning attacks when extended to increase competitive advantages.
Yuqi Jia 0001, Minghong Fang, Neil Zhenqiang Gong
NeurIPS2
2025 Tracing Back the Malicious Clients in Poisoning Attacks to Federated Learning
abstract
Poisoning attacks compromise the training phase of federated learning (FL) such that the learned global model misclassifies attacker-chosen inputs called target inputs. Existing defenses mainly focus on protecting the training phase of FL such that the learnt global model is poison free. However, these defenses often achieve limited effectiveness when the clients' local training data is highly non-iid or the number of malicious clients is large, as confirmed in our experiments. In this work, we propose FLForensics, the first poison-forensics method for FL. FLForensics complements existing training-phase defenses. In particular, when training-phase defenses fail and a poisoned global model is deployed, FLForensics aims to trace back the malicious clients that performed the poisoning attack after a misclassified target input is identified. We theoretically show that FLForensics can accurately distinguish between benign and malicious clients under a formal definition of poisoning attack. Moreover, we empirically show the effectiveness of FLForensics at tracing back both existing and adaptive poisoning attacks on five benchmark datasets.
Yuqi Jia 0001, Minghong Fang, Hongbin Liu 0005, Jinghuai Zhang, Neil Zhenqiang Gong
NeurIPS2
2025 Fairness-Constrained Optimization Attack in Federated Learning
abstract
Federated learning (FL) is a privacy-preserving machine learning technique that facilitates collaboration among participants across demographics. FL enables model sharing, while restricting the movement of data. Since FL provides participants with independence over their training data, it becomes susceptible to poisoning attacks. Such collaboration also propagates bias among the participants, even unintentionally, due to different data distribution or historical bias present in the data. This paper proposes an intentional fairness attack, where a client maliciously sends a biased model, by increasing the fairness loss while training, even considering homogeneous data distribution. The fairness loss is calculated by solving an optimization problem for fairness metrics such as demographic parity and equalized odds. The attack is insidious and hard to detect, as it maintains global accuracy even after increasing the bias. We evaluate our attack against the state-of-the-art Byzantine-robust and fairness-aware aggregation schemes over different datasets, in various settings. The empirical results demonstrate the attack efficacy by increasing the bias up to 90%, even in the presence of a single malicious client in the FL system.
Harsh Kasyap, Minghong Fang, Zhuqing Liu, Carsten Maple, Somanath Tripathy
TrustCom2
2025 Provably Robust Federated Reinforcement Learning
abstract
Federated reinforcement learning (FRL) allows agents to jointly learn a global decision-making policy under the guidance of a central server. While FRL has advantages, its decentralized design makes it prone to poisoning attacks. To mitigate this, Byzantine-robust aggregation techniques tailored for FRL have been introduced. Yet, in our work, we reveal that these current Byzantine-robust techniques are not immune to our newly introduced Normalized attack. Distinct from previous attacks that targeted enlarging the distance of policy updates before and after an attack, our Normalized attack emphasizes on maximizing the angle of deviation between these updates. To counter these threats, we develop an ensemble FRL approach that is provably secure against both known and our newly proposed attacks. Our ensemble method involves training multiple global policies, where each is learnt by a group of agents using any foundational aggregation rule. These well-trained global policies then individually predict the action for a specific test state. The ultimate action is chosen based on a majority vote for discrete action systems or the geometric median for continuous ones. Our experimental results across different settings show that the Normalized attack can greatly disrupt non-ensemble Byzantine-robust methods, and our ensemble approach offers substantial resistance against poisoning attacks.
Minghong Fang, Neil Zhenqiang Gong
WWW1
2025 Traceback of Poisoning Attacks to Retrieval-Augmented Generation
abstract
Large language models (LLMs) integrated with retrieval-augmented generation (RAG) systems improve accuracy by leveraging external knowledge sources. However, recent research has revealed RAG's susceptibility to poisoning attacks, where the attacker injects poisoned texts into the knowledge database, leading to attacker-desired responses. Existing defenses, which predominantly focus on inference-time mitigation, have proven insufficient against sophisticated attacks. In this paper, we introduce RAGForensics, the first traceback system for RAG, designed to identify poisoned texts within the knowledge database that are responsible for the attacks. RAGForensics operates iteratively, first retrieving a subset of texts from the database and then utilizing a specially crafted prompt to guide an LLM in detecting potential poisoning texts. Empirical evaluations across multiple datasets demonstrate the effectiveness of RAGForensics against state-of-the-art poisoning attacks. This work pioneers the traceback of poisoned texts in RAG systems, providing a practical and promising defense mechanism to enhance their security.
Baolei Zhang, Haoran Xin 0002, Minghong Fang, Zhuqing Liu, Biao Yi, Tong Li 0011, Zheli Liu
WWW3
2025 Periodic Recovery From Poisoning Attacks in Machine Learning
abstract
Recovery from poisoning attacks aims to eliminate the influence of a given set of deleted poisoned training data on a model. In practice, model recovery often happensperiodicallysince data deletion occurs repeatedly after a model has been trained. Existing efficient model recovery methods are designed forsingle-shotmodel recovery. When applied to periodic model recovery, they treat the instances of recovery independently, leading to a large total overhead over time. In this work, we propose PeriRecover, an efficient periodic model recovery method. Our key idea is to extract some common information during the original model training, which can be used to accelerate all instances of model recovery. In particular, we propose to compute and store the diagonals of the Hessian matrix of the loss function during the original model training. Given such information, each instance of model recovery can efficiently estimate the gradients to update the model instead of exactly computing them. Theoretically, we show that the model recovered by PeriRecover is close to the one recovered by training-from-scratch under some assumptions, achievingcertified recovery. Empirically, we apply PeriRecover to supervised learning and recommender systems, and we consider targeted attacks and untargeted attacks. Our results show that PeriRecover is much more efficient and/or accurate than existing model recovery methods.
Yuepeng Hu, Minghong Fang, Yuqi Jia 0001, Hongbin Liu 0005, Neil Zhenqiang Gong
IEEE Trans. Dependable Secur. Comput.2
2024 GradSafe: Detecting Jailbreak Prompts for LLMs via Safety-Critical Gradient Analysis
abstract
Large Language Models (LLMs) face threats from jailbreak prompts.Existing methods for detecting jailbreak prompts are primarily online moderation APIs or finetuned LLMs.These strategies, however, often require extensive and resource-intensive data collection and training processes.In this study, we propose GradSafe, which effectively detects jailbreak prompts by scrutinizing the gradients of safety-critical parameters in LLMs.Our method is grounded in a pivotal observation: the gradients of an LLM's loss for jailbreak prompts paired with compliance response exhibit similar patterns on certain safety-critical parameters.In contrast, safe prompts lead to different gradient patterns.Building on this observation, GradSafe analyzes the gradients from prompts (paired with compliance responses) to accurately detect jailbreak prompts.We show that GradSafe, applied to Llama-2 without further training, outperforms Llama Guard-despite its extensive finetuning with a large dataset-in detecting jailbreak prompts.This superior performance is consistent across both zero-shot and adaptation scenarios, as evidenced by our evaluations on ToxicChat and XSTest.The source code is available at https://github.com/xyq7/GradSafe.
Yueqi Xie, Minghong Fang, Renjie Pi, Neil Zhenqiang Gong
ACL (1)2
2024 Byzantine-Robust Decentralized Federated Learning
abstract
Federated learning (FL) enables multiple clients to collaboratively train machine learning models without revealing their private training data. In conventional FL, the system follows the server-assisted architecture (server-assisted FL), where the training process is coordinated by a central server. However, the server-assisted FL framework suffers from poor scalability due to a communication bottleneck at the server, and trust dependency issues. To address challenges, decentralized federated learning (DFL) architecture has been proposed to allow clients to train models collaboratively in a serverless and peer-to-peer manner. However, due to its fully decentralized nature, DFL is highly vulnerable to poisoning attacks, where malicious clients could manipulate the system by sending carefully-crafted local models to their neighboring clients. To date, only a limited number of Byzantine-robust DFL methods have been proposed, most of which are either communication-inefficient or remain vulnerable to advanced poisoning attacks. In this paper, we propose a new algorithm called BALANCE (Byzantine-robust averaging through local similarity in decentralization) to defend against poisoning attacks in DFL. In BALANCE, each client leverages its own local model as a similarity reference to determine if the received model is malicious or benign. We establish the theoretical convergence guarantee for BALANCE under poisoning attacks in both strongly convex and non-convex settings. Furthermore, the convergence rate of BALANCE under poisoning attacks matches those of the state-of-the-art counterparts in Byzantine-free settings. Extensive experiments also demonstrate that BALANCE outperforms existing DFL methods and effectively defends against poisoning attacks.
Minghong Fang, Hairi, Prashant Khanduri, Jia Liu 0002, Songtao Lu, Yuchen Liu 0001, Neil Zhenqiang Gong
CCS1
2024 Understanding Server-Assisted Federated Learning in the Presence of Incomplete Client Participation
abstract
Existing works in federated learning (FL) often assume either full client or uniformly distributed client participation. However, in reality, some clients may never participate in FL training (aka incomplete client participation) due to various system heterogeneity factors. A popular solution is the server-assisted federated learning (SA-FL) framework, where the server uses an auxiliary dataset. Despite empirical evidence of SA-FL’s effectiveness in addressing incomplete client participation, theoretical understanding of SA-FL is lacking. Furthermore, the effects of incomplete client participation in conventional FL are poorly understood. This motivates us to rigorously investigate SA-FL. Toward this end, we first show that conventional FL is not PAC-learnable under incomplete client participation in the worst case. Then, we show that the PAC-learnability of FL with incomplete client participation can indeed be revived by SA-FL, which theoretically justifies the use of SA-FL for the first time. Lastly, to provide practical guidance for SA-FL training under incomplete client participation, we propose the SAFARI (server-assisted federated averaging) algorithm that enjoys the same linear convergence speedup guarantees as classic FL with ideal client participation assumptions, offering the first SA-FL algorithm with convergence guarantee. Extensive experiments on different datasets show SAFARI significantly improves the performance under incomplete client participation.
Haibo Yang 0001, Peiwen Qiu, Prashant Khanduri, Minghong Fang, Jia Liu 0002
ICML4
2024 FedREDefense: Defending against Model Poisoning Attacks for Federated Learning using Model Update Reconstruction Error
abstract
Federated Learning (FL) faces threats from model poisoning attacks. Existing defenses, typically relying on cross-client/global information to mitigate these attacks, fall short when faced with non-IID data distributions and/or a large number of malicious clients. To address these challenges, we present FedREDefense. Unlike existing methods, it doesn't hinge on similar distributions across clients or a predominant presence of benign clients. Instead, it assesses the likelihood that a client's model update is a product of genuine training, solely based on the characteristics of the model update itself. Our key finding is that model updates stemming from genuine training can be approximately reconstructed with some distilled local knowledge, while those from deliberate handcrafted model poisoning attacks cannot. Drawing on this distinction, FedREDefense identifies and filters out malicious clients based on the discrepancies in their model update Reconstruction Errors. Empirical tests on three benchmark datasets confirm that FedREDefense successfully filters model poisoning attacks in FL—even in scenarios with high non-IID degrees and large numbers of malicious clients.
Yueqi Xie, Minghong Fang, Neil Zhenqiang Gong
ICML2
2024 On the Hardness of Decentralized Multi-Agent Policy Evaluation Under Byzantine Attacks
Hairi, Minghong Fang, Alvaro Velasquez, Jia Liu 0002
WiOpt2
2024 Poisoning Federated Recommender Systems with Fake Users
abstract
Federated recommendation is a prominent use case within federated learning, yet it remains susceptible to various attacks, from user to server-side vulnerabilities. Poisoning attacks are particularly notable among user-side attacks, as participants upload malicious model updates to deceive the global model, often intending to promote or demote specific targeted items. This study investigates strategies for executing promotion attacks in federated recommender systems.
Ming Yin 0009, Yichang Xu, Minghong Fang, Neil Zhenqiang Gong
WWW3
2024 Securing Distributed Network Digital Twin Systems Against Model Poisoning Attacks
abstract
In the era of 5G and beyond, the increasing complexity of wireless networks necessitates innovative frameworks for efficient management and deployment. Digital twins (DTs), embodying real-time monitoring, predictive configurations, and enhanced decision-making capabilities, stand out as a promising solution in this context. Within a time-series data-driven framework that effectively maps wireless networks into digital counterparts, encapsulated by integrated vertical and horizontal twinning phases, this study investigates the security challenges in distributed network DT (NDT) systems, which potentially undermine the reliability of subsequent network applications, such as wireless traffic forecasting. Specifically, we consider a minimal-knowledge scenario for all attackers, in that they do not have access to network data and other specialized knowledge, yet can interact with previous iterations of server-level models. In this context, we spotlight a novel fake traffic injection attack designed to compromise a distributed NDT system for wireless traffic prediction. In response, we then propose a defense mechanism, termed global-local inconsistency detection (GLID), to counteract various model poisoning threats. GLID strategically removes abnormal model parameters that deviate beyond a particular percentile range, thereby fortifying the security of network twinning process. Through extensive experiments on real-world wireless traffic data sets, our experimental evaluations show that both our attack and defense strategies significantly outperform existing baselines, highlighting the importance of security measures in the design and implementation of DTs for 5G and beyond network systems.
Minghong Fang, Mingzhe Chen, Gaolei Li, Xi Lin 0003, Yuchen Liu 0001
IEEE Internet Things J.2
2022 AFLGuard: Byzantine-robust Asynchronous Federated Learning
abstract
Federated learning (FL) is an emerging machine learning paradigm, in which clients jointly learn a model with the help of a cloud server. A fundamental challenge of FL is that the clients are often heterogeneous, e.g., they have different computing powers, and thus the clients may send model updates to the server with substantially different delays. Asynchronous FL aims to address this challenge by enabling the server to update the model once any client’s model update reaches it without waiting for other clients’ model updates. However, like synchronous FL, asynchronous FL is also vulnerable to poisoning attacks, in which malicious clients manipulate the model via poisoning their local data and/or model updates sent to the server. Byzantine-robust FL aims to defend against poisoning attacks. In particular, Byzantine-robust FL can learn an accurate model even if some clients are malicious and have Byzantine behaviors. However, most existing studies on Byzantine-robust FL focused on synchronous FL, leaving asynchronous FL largely unexplored. In this work, we bridge this gap by proposing AFLGuard, a Byzantine-robust asynchronous FL method. We show that, both theoretically and empirically, AFLGuard is robust against various existing and adaptive poisoning attacks (both untargeted and targeted). Moreover, AFLGuard outperforms existing Byzantine-robust asynchronous FL methods.
Minghong Fang, Jia Liu 0002, Neil Zhenqiang Gong, Elizabeth S. Bentley
ACSAC1
2022 NET-FLEET: achieving linear convergence speedup for fully decentralized federated learning with heterogeneous data
abstract
Federated learning (FL) has received a surge of interest in recent years thanks to its benefits in data privacy protection, efficient communication, and parallel data processing. Also, with appropriate algorithmic designs, one could achieve the desirable linear speedup for convergence effect in FL. However, most existing works on FL are limited to systems with i.i.d. data and centralized parameter servers and results on decentralized FL with heterogeneous datasets remains limited. Moreover, whether or not the linear speedup for convergence is achievable under fully decentralized FL with data heterogeneity remains an open question. In this paper, we address these challenges by proposing a new algorithm, called NET-FLEET, for fully decentralized FL systems with data heterogeneity. The key idea of our algorithm is to enhance the local update scheme in FL (originally intended for communication efficiency) by incorporating a recursive gradient correction technique to handle heterogeneous datasets. We show that, under appropriate parameter settings, the proposed NET-FLEET algorithm achieves a linear speedup for convergence. We further conduct extensive numerical experiments to evaluate the performance of the proposed NET-FLEET algorithm and verify our theoretical findings.
Xin Zhang 0054, Minghong Fang, Zhuqing Liu, Haibo Yang 0001, Jia Liu 0002, Zhengyuan Zhu
MobiHoc2
2022 FairRoad: Achieving Fairness for Recommender Systems with Optimized Antidote Data
abstract
Today, recommender systems have played an increasingly important role in shaping our experiences of digital environments and social interactions. However, as recommender systems become ubiquitous in our society, recent years have also witnessed significant fairness concerns for recommender systems. Specifically, studies have shown that recommender systems may inherit or even amplify biases from historical data, and as a result, provide unfair recommendations. To address fairness risks in recommender systems, most of the previous approaches to date are focused on modifying either the existing training data samples or the deployed recommender algorithms, but unfortunately with limited degrees of success. In this paper, we propose a new approach called fair recommendation with optimized antidote data (FairRoad), which aims to improve the fairness performances of recommender systems through the construction of a small and carefully crafted antidote dataset. Toward this end, we formulate our antidote data generation task as a mathematical optimization problem, which minimizes the unfairness of the targeted recommender systems while not disrupting the deployed recommendation algorithms. Extensive experiments show that our proposed antidote data generation algorithm significantly improve the fairness of recommender systems with a small amounts of antidote data.
Minghong Fang, Jia Liu 0002, Michinari Momma
SACMAT1
2021 Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learning
Haibo Yang 0001, Minghong Fang, Jia Liu 0002
ICLR2
2021 FLTrust: Byzantine-robust Federated Learning via Trust Bootstrapping
Minghong Fang, Jia Liu 0002, Neil Zhenqiang Gong
NDSS2
2021 Data Poisoning Attacks and Defenses to Crowdsourcing Systems
abstract
A key challenge of big data analytics is how to collect a large volume of (labeled) data. Crowdsourcing aims to address this challenge via aggregating and estimating high-quality data (e.g., sentiment label for text) from pervasive clients/users. Existing studies on crowdsourcing focus on designing new methods to improve the aggregated data quality from unreliable/noisy clients. However, the security aspects of such crowdsourcing systems remain under-explored to date. We aim to bridge this gap in this work. Specifically, we show that crowdsourcing is vulnerable to data poisoning attacks, in which malicious clients provide carefully crafted data to corrupt the aggregated data. We formulate our proposed data poisoning attacks as an optimization problem that maximizes the error of the aggregated data. Our evaluation results on one synthetic and two real-world benchmark datasets demonstrate that the proposed attacks can substantially increase the estimation errors of the aggregated data. We also propose two defenses to reduce the impact of malicious clients. Our empirical results show that the proposed defenses can substantially reduce the estimation errors of the data poisoning attacks.
Minghong Fang, Minghao Sun, Qi Li 0012, Neil Zhenqiang Gong, Jin Tian 0001, Jia Liu 0002
WWW1
2020 Toward Low-Cost and Stable Blockchain Networks
abstract
Envisioned to be the future of secured distributed systems, blockchain networks have received increasing attention from both the industry and academia in recent years. However, blockchain mining processes demand high hardware costs and consume a vast amount of energy (studies have shown that the amount of energy consumed in Bitcoin mining is almost the same as the electricity used in Ireland). To address the high mining cost problem of blockchain networks, in this paper, we propose a blockchain mining resources allocation algorithm to reduce the mining cost in PoW-based (proof-of-work-based) blockchain networks. We first propose an analytical queueing model for general blockchain networks. In our queueing model, transactions arrive randomly to the queue and are served in a batch manner with unknown service rate probability distribution and agnostic to any priority mechanism. Then, we leverage the Lyapunov optimization techniques to propose a dynamic mining resources allocation algorithm (DMRA), which is parameterized by a tuning parameter $K \gt 0$. We show that our algorithm achieves an $[O(1/ K),O(K)]$ cost-optimality-gap-vs-delay tradeoff. Our simulation results also demonstrate the effectiveness of DMRA in reducing mining costs.
Minghong Fang, Jia Liu 0002
ICC1
2020 Private and communication-efficient edge learning: a sparse differential gaussian-masking distributed SGD approach
abstract
With the rise of machine learning (ML) and the proliferation of smart mobile devices, recent years have witnessed a surge of interest in performing ML in wireless edge networks. In this paper, we consider the problem of jointly improving data privacy and communication efficiency of distributed edge learning, both of which are critical performance metrics in wireless edge network computing. Toward this end, we propose a new distributed stochastic gradient method with sparse differential Gaussian-masked stochastic gradients (SDM-DSGD) for non-convex distributed edge learning. Our main contributions are three-fold: i) We theoretically establish the privacy and communication efficiency performance guarantee for our SDM-DSGD method, which outperforms all existing works; ii) We propose a generalized differential-coded DSGD update, which enables a much lower transmit probability for gradient sparsification, and provides an [EQUATION] convergence rate; and iii) We reveal theoretical insights and offer practical design guidelines for the interactions between privacy preservation and communication efficiency - two conflicting performance goals. We conduct extensive experiments with a variety of learning models on MNIST and CIFAR-10 datasets to verify our theoretical findings.
Xin Zhang 0054, Minghong Fang, Jia Liu 0002, Zhengyuan Zhu
MobiHoc2
2020 Local Model Poisoning Attacks to Byzantine-Robust Federated Learning
Minghong Fang, Jinyuan Jia 0001, Neil Zhenqiang Gong
USENIX Security Symposium1
2020 Influence Function based Data Poisoning Attacks to Top-N Recommender Systems
abstract
Recommender system is an essential component of web services to engage users. Popular recommender systems model user preferences and item properties using a large amount of crowdsourced user-item interaction data, e.g., rating scores; then top-N items that match the best with a user’s preference are recommended to the user. In this work, we show that an attacker can launch a data poisoning attack to a recommender system to make recommendations as the attacker desires via injecting fake users with carefully crafted user-item interaction data. Specifically, an attacker can trick a recommender system to recommend a target item to as many normal users as possible. We focus on matrix factorization based recommender systems because they have been widely deployed in industry. Given the number of fake users the attacker can inject, we formulate the crafting of rating scores for the fake users as an optimization problem. However, this optimization problem is challenging to solve as it is a non-convex integer programming problem. To address the challenge, we develop several techniques to approximately solve the optimization problem. For instance, we leverage influence function to select a subset of normal users who are influential to the recommendations and solve our formulated optimization problem based on these influential users. Our results show that our attacks are effective and outperform existing methods.
Minghong Fang, Neil Zhenqiang Gong, Jia Liu 0002
WWW1
2018 Poisoning Attacks to Graph-Based Recommender Systems
abstract
Recommender system is an important component of many web services to help users locate items that match their interests. Several studies showed that recommender systems are vulnerable to poisoning attacks, in which an attacker injects fake data to a recommender system such that the system makes recommendations as the attacker desires. However, these poisoning attacks are either agnostic to recommendation algorithms or optimized to recommender systems (e.g., association-rule-based or matrix-factorization-based recommender systems) that are not graph-based. Like association-rule-based and matrix-factorization-based recommender systems, graph-based recommender system is also deployed in practice, e.g., eBay, Huawei App Store (a big app store in China). However, how to design optimized poisoning attacks for graph-based recommender systems is still an open problem.
Minghong Fang, Guolei Yang, Neil Zhenqiang Gong, Jia Liu 0002
ACSAC1
2014 Prioritizing disease-causing genes based on network diffusion and rank concordance
abstract
Disease-causing genes prioritization is very important for understanding mechanisms of diseases and biomedical applications, such as drug design. Previous studies have shown that promising candidate genes are mostly ranked according to their relatedness to known disease genes or closely related disease processes. Therefore, a dangling gene (isolated gene) with no edges in the network can not be effectively prioritized. These approaches tend to prioritize those genes that are highly connected in the PPI network and perform poorly when they are applied to loosely connected disease genes. Motivated by this observation, we propose a new disease-causing genes prioritization method that based on network diffusion and rank concordance (NDRC). The method is evaluated by leave-one-out cross validation on 1931 diseases in which at least one gene is known to be involved, and it is able to rank the true causal gene first in 849 of all 2542 cases, and as the experimental results suggest that NDRC significantly outperforms other existing methods such as RWR, VAVIEN, DADA and PRINCE on identifying loosely connected disease genes and which successfully put dangling genes as potential candidate disease genes. Furthermore, we apply NDRC method to study two representative diseases, Meckel syndrome 1 and Peroxisome biogenesis disorder 1A (Zellweger). Our study has also found that the complex disease-causing genes are divided into several modules that are closely associated with different disease phenotype.
Minghong Fang, Xiaohua Hu 0001, Tingting He 0003, Junmin Zhao, Xianjun Shen
BIBM1
2014 A novel disease gene prediction method based on PPI network
abstract
To identify the underlying disease gene of human genetic disorders is a challenging and meaningful task in bioinformatics research. Recently, several methods we re developed based on PPI network, motivated by the observation that the disease genes of the same or similar diseases tend to lie close to each other in the PPI network. However, most of these methods based on the direct neighbors or shortest distance between disease genes, which ignore the global information of the PPI network. We develop a novel method for predicting disease gene based on function flow with PPI network. First, we map the known disease genes and candidate disease genes in linkage interval to PPI network. Then, simulate the process of function flow model which propagates information from the known disease genes to other genes (proteins) over the PPI network, and each protein gets a function score. Finally, candidate disease genes are ranked according to function score, the genes (proteins) with high score are considered as disease genes. The experimental results show our method is effective, and it can identify disease genes more accurately.
Junmin Zhao, Tingting He 0003, Xiaohua Hu 0001, Xianjun Shen, Minghong Fang
BIBM6