Yige Li

dblp:01/2511 · DBLP profile ↗
← Back
17ranked-venue papers
6as first author
17since 2021 · last 2026
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 12 · 4 first-author · 12 since 2021Security and privacy · 3 · 1 first-author · 3 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 2 since 2021Computer networks · 1 · 1 first-author · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021
YearPublicationVenuePosition
2026 Q-MLLM: Vector Quantization for Robust Multimodal Large Language Model Security
Yige Li, Jun Sun 0001
NDSS3
2026 Defense-to-attack: Bypassing weak defenses enables stronger jailbreaks in Vision-Language Models
Yunhan Zhao, Yige Li, Xingjun Ma
Pattern Recognit.3
2026 Shortcuts Everywhere and Nowhere: Exploring Multi-Trigger Backdoor Attacks
abstract
Backdoor attacks have become a significant threat to the pre-training and deployment of deep neural networks (DNNs). Although numerous methods for detecting and mitigating backdoor attacks have been proposed, most rely on identifying and eliminating the “shortcut” created by the backdoor, which links a specific source class to a target class. However, these approaches can be easily circumvented by designing multiple backdoor triggers that create shortcuts everywhere and therefore nowhere specific. In this study, we explore the concept of Multi-Trigger Backdoor Attacks (MTBAs), where multiple adversaries leverage different types of triggers to poison the same dataset. By proposing and investigating three types of multi-trigger attacks includingparallel,sequential, andhybridattacks, we demonstrate that 1) multiple triggers can coexist, overwrite, or cross-activate one another, and 2) MTBAs easily break the prevalent shortcut assumption underlying most existing backdoor detection/removal methods, rendering them ineffective. Given the security risk posed by MTBAs, we have created a multi-trigger backdoor poisoning dataset to facilitate future research on detecting and mitigating these attacks, and we also discuss potential defense strategies against MTBAs. Our code is available athttps://github.com/bboylyg/Multi-Trigger-Backdoor-Attacks.
Yige Li, Jiabo He, Hanxun Huang, Jun Sun 0001, Xingjun Ma, Yu-Gang Jiang 0001
IEEE Trans. Dependable Secur. Comput.1
2026 Generalized Fiducial Inference for Accelerated Life Tests With Failure-Free Life Based on Three-Parameter Weibull Distribution
abstract
Assessing the lifetime of products or materials effectively is essential for formulating maintenance strategies and warranty policies. With advancements in engineering technology, high-reliability, long-lifetime products are becoming increasingly common. To quickly obtain lifetime data for such products, constant-stress accelerated life tests (CSALT) have been widely employed. The failure-free life (FFL) characterizes the early stage during which these products experience no failures, and the three-parameter Weibull distribution (TPWD) models FFL through its threshold parameter. However, the effect of acceleration on the threshold parameter has not been adequately investigated, particularly in terms of modeling and estimation. To solve the above problem, firstly, we introduce a modeling approach based on the linear cumulative exposure model and fatigue theory, which accounts for the acceleration of the threshold parameter in CSALT. Applied to TPWD, the resulting model is referred to as CSALT-TPWD. Then, we examine the non-regular problem in the maximum likelihood estimation of CSALT-TPWD. Next, generalized fiducial inference is employed to provide both point and interval estimates. Furthermore, to enhance the sampling efficiency of the posterior distribution, a Hadamard-based$\ell ^{2}$norm prior is proposed. Theoretical analysis confirms that this prior accelerates computation compared to other commonly used norms, while preserving the value of the traditional$\ell ^{2}$norm prior. Finally, numerical simulations and real case analysis demonstrate that the proposed method captures the characteristics of FFL effectively.
Zhuqing Miao, Tianzi Tian, Yige Li, Jun Yang 0018
IEEE Trans. Reliab.3
2025 Backdoor Token Unlearning: Exposing and Defending Backdoors in Pretrained Language Models
abstract
Supervised fine-tuning has become the predominant method for adapting large pretrained models to downstream tasks. However, recent studies have revealed that these models are vulnerable to backdoor attacks, where even a small number of malicious samples can successfully embed backdoor triggers into the model. While most existing defense methods focus on post-training backdoor defense, efficiently defending against backdoor attacks during training phase remains largely unexplored. To address this gap, we propose a novel defense method called Backdoor Token Unlearning (BTU), which proactively detects and neutralizes trigger tokens during the training stage. Our work is based on two key findings: 1) backdoor learning causes distinctive differences between backdoor token parameters and clean token parameters in word embedding layers, and 2) the success of backdoor attacks heavily depends on backdoor token parameters. The BTU defense leverages these properties to identify aberrant embedding parameters and subsequently removes backdoor behaviors using a fine-grained unlearning technique. Extensive evaluations across three datasets and four types of backdoor attacks demonstrate that BTU effectively defends against these threats while preserving the model’s performance on primary tasks.
Peihai Jiang, Xixiang Lyu, Yige Li
AAAI3
2025 Anyattack: Towards Large-scale Self-supervised Adversarial Attacks on Vision-language Models
abstract
Due to their multimodal capabilities, Vision-Language Models (VLMs) have found numerous impactful applications in real-world scenarios. However, recent studies have revealed that VLMs are vulnerable to image-based adversarial attacks. Traditional targeted adversarial attacks require specific targets and labels, limiting their real-world impact. We present AnyAttack, a self-supervised framework that transcends the limitations of conventional attacks through a novel foundation model approach. By pretraining on the massive LAION-400M dataset without label supervision, AnyAttack achieves unprecedented flexibility - enabling any image to be transformed into an attack vector targeting any desired output across different VLMs. This approach fundamentally changes the threat landscape, making adversarial capabilities accessible at an unprecedented scale. Our extensive validation across five open-source VLMs (CLIP, BLIP, BLIP2, InstructBLIP, and MiniGPT-4) demonstrates AnyAttack’s effectiveness across diverse multimodal tasks. Most concerning, Any-Attack seamlessly transfers to commercial systems including Google Gemini, Claude Sonnet, Microsoft Copilot and OpenAI GPT, revealing a systemic vulnerability requiring immediate attention.
Jiaming Zhang 0006, Junhong Ye, Xingjun Ma, Yige Li, Yunfan Yang, Jitao Sang 0001, Dit-Yan Yeung
CVPR4
2025 Detecting Backdoor Samples in Contrastive Language Image Pretraining
abstract
Contrastive language-image pretraining (CLIP) has been found to be vulnerable to poisoning backdoor attacks where the adversary can achieve an almost perfect attack success rate on CLIP models by poisoning only 0.01\% of the training dataset. This raises security concerns on the current practice of pretraining large-scale models on unscrutinized web data using CLIP. In this work, we analyze the representations of backdoor-poisoned samples learned by CLIP models and find that they exhibit unique characteristics in their local subspace, i.e., their local neighborhoods are far more sparse than that of clean samples. Based on this finding, we conduct a systematic study on detecting CLIP backdoor attacks and show that these attacks can be easily and efficiently detected by traditional density ratio-based local outlier detectors, whereas existing backdoor sample detection methods fail. Our experiments also reveal that an unintentional backdoor already exists in the original CC3M dataset and has been trained into a popular open-source model released by OpenCLIP. Based on our detector, one can clean up a million-scale web dataset (e.g., CC3M) efficiently within 15 minutes using 4 Nvidia A100 GPUs.
Hanxun Huang, Sarah M. Erfani, Yige Li, Xingjun Ma, James Bailey 0001
ICLR3
2025 BlueSuffix: Reinforced Blue Teaming for Vision-Language Models Against Jailbreak Attacks
abstract
In this paper, we focus on black-box defense for VLMs against jailbreak attacks. Existing black-box defense methods are either unimodal or bimodal. Unimodal methods enhance either the vision or language module of the VLM, while bimodal methods robustify the model through text-image representation realignment. However, these methods suffer from two limitations: 1) they fail to fully exploit the cross-modal information, or 2) they degrade the model performance on benign inputs. To address these limitations, we propose a novel blue-team method BlueSuffix that defends target VLMs against jailbreak attacks without compromising its performance under black-box setting. BlueSuffix includes three key components: 1) a visual purifier against jailbreak images, 2) a textual purifier against jailbreak texts, and 3) a blue-team suffix generator using reinforcement fine-tuning for enhancing cross-modal robustness. We empirically show on four VLMs (LLaVA, MiniGPT-4, InstructionBLIP, and Gemini) and four safety benchmarks (Harmful Instruction, AdvBench, MM-SafetyBench, and RedTeam-2K) that BlueSuffix outperforms the baseline defenses by a significant margin. Our BlueSuffix opens up a promising direction for defending VLMs against jailbreak attacks. Code is available at https://github.com/Vinsonzyh/BlueSuffix.
Yunhan Zhao, Yige Li, Xingjun Ma, Yu-Gang Jiang 0001
ICLR4
2025 X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIP
abstract
As Contrastive Language-Image Pre-training (CLIP) models are increasingly adopted for diverse downstream tasks and integrated into large vision-language models (VLMs), their susceptibility to adversarial perturbations has emerged as a critical concern. In this work, we introduce X-Transfer, a novel attack method that exposes a universal adversarial vulnerability in CLIP. X-Transfer generates a Universal Adversarial Perturbation (UAP) capable of deceiving various CLIP encoders and downstream VLMs across different samples, tasks, and domains. We refer to this property as super transferability—a single perturbation achieving cross-data, cross-domain, cross-model, and cross-task adversarial transferability simultaneously. This is achieved through surrogate scaling, a key innovation of our approach. Unlike existing methods that rely on fixed surrogate models, which are computationally intensive to scale, X-Transfer employs an efficient surrogate scaling strategy that dynamically selects a small subset of suitable surrogates from a large search space. Extensive evaluations demonstrate that X-Transfer significantly outperforms previous state-of-the-art UAP methods, establishing a new benchmark for adversarial transferability across CLIP models.
Hanxun Huang, Sarah M. Erfani, Yige Li, Xingjun Ma, James Bailey 0001
ICML3
2025 CROW: Eliminating Backdoors from Large Language Models via Internal Consistency Regularization
abstract
Large Language Models (LLMs) are vulnerable to backdoor attacks that manipulate outputs via hidden triggers. Existing defense methods—designed for vision/text classification tasks—fail for text generation. We propose Internal Consistency Regularization (CROW), a defense leveraging the observation that backdoored models exhibit unstable layer-wise hidden representations when triggered, while clean models show smooth transitions. CROW enforces consistency across layers via adversarial perturbations and regularization during finetuning, neutralizing backdoors without requiring clean reference models or trigger knowledge—only a small clean dataset. Experiments across Llama-2 (7B, 13B), CodeLlama (7B, 13B), and Mistral-7B demonstrate CROW’s effectiveness: it achieves significant reductions in attack success rates across diverse backdoor strategies (sentiment steering, targeted refusal, code injection) while preserving generative performance. CROW’s architecture-agnostic design enables practical deployment.
Nay Myat Min, Long H. Pham, Yige Li, Jun Sun 0001
ICML3
2025 Memory Injection Attacks on LLM Agents via Query-Only Interaction
abstract
Agents powered by large language models (LLMs) have demonstrated strong capabilities in a wide range of complex, real-world applications. However, LLM agents with a compromised memory bank may easily produce harmful outputs when the past records retrieved for demonstration are malicious. In this paper, we propose a novel Memory INJection Attack, MINJA, without assuming that the attacker can directly modify the memory bank of the agent. The attacker injects malicious records into the memory bank by only **interacting with the agent via queries and output observations**. These malicious records are designed to elicit a sequence of malicious reasoning steps corresponding to a different target query during the agent's execution of the victim user's query. Specifically, we introduce a sequence of *bridging steps* to link victim queries to the malicious reasoning steps. During the memory injection, we propose an *indication prompt* that guides the agent to autonomously generate similar bridging steps, with a *progressive shortening strategy* that gradually removes the indication prompt, such that the malicious record will be easily retrieved when processing later victim queries. Our extensive experiments across diverse agents demonstrate the effectiveness of MINJA in compromising agent memory. With minimal requirements for execution, MINJA enables any user to influence agent memory, highlighting the risk.
Shen Dong, Shaochen Xu, Yige Li, Jiliang Tang, Tianming Liu 0001, Hui Liu 0031, Zhen Xiang
NeurIPS4
2025 BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Models
abstract
Generative large language models (LLMs) have achieved state-of-the-art results on a wide range of tasks, yet they remain susceptible to backdoor attacks: carefully crafted triggers in the input can manipulate the model to produce adversary-specified outputs. While prior research has predominantly focused on backdoor risks in vision and classification settings, the vulnerability of LLMs in open-ended text generation remains underexplored. To fill this gap, we introduce \textit{BackdoorLLM}\footnote{Our BackdoorLLM benchmark was awarded First Prize in the \href{https://www.mlsafety.org/safebench/winners}{SafetyBench competition} organized by the \href{https://safe.ai/}{Center for AI Safety}.}, the first comprehensive benchmark for systematically evaluating backdoor threats in text-generation LLMs. BackdoorLLM provides: (i) a unified repository of benchmarks with a standardized training and evaluation pipeline; (ii) a diverse suite of attack modalities, including data poisoning, weight poisoning, hidden-state manipulation, and chain-of-thought hijacking; (iii) over 200 experiments spanning 8 distinct attack strategies, 7 real-world scenarios, and 6 model architectures; (iv) key insights into the factors that govern backdoor effectiveness and failure modes in LLMs; and (v) a defense toolkit encompassing 7 representative mitigation techniques. Our code and datasets are available at \url{https://github.com/bboylyg/BackdoorLLM}. We will continuously incorporate emerging attack and defense methodologies to support the research in advancing the safety and reliability of LLMs.
Yige Li, Hanxun Huang, Yunhan Zhao, Xingjun Ma, Jun Sun 0001
NeurIPS1
2025 MF-CLIP: Leveraging CLIP as Surrogate Models for No-Box Adversarial Attacks
Jiaming Zhang 0006, Lingyu Qiu, Qi Yi, Yige Li, Jitao Sang 0001, Changsheng Xu, Dit-Yan Yeung
IEEE Trans. Inf. Forensics Secur.4
2023 Reconstructive Neuron Pruning for Backdoor Defense
abstract
Deep neural networks (DNNs) have been found to be vulnerable to backdoor attacks, raising security concerns about their deployment in mission-critical applications. While existing defense methods have demonstrated promising results, it is still not clear how to effectively remove backdoor-associated neurons in backdoored DNNs. In this paper, we propose a novel defense called *Reconstructive Neuron Pruning* (RNP) to expose and prune backdoor neurons via an unlearning and then recovering process. Specifically, RNP first unlearns the neurons by maximizing the model's error on a small subset of clean samples and then recovers the neurons by minimizing the model's error on the same data. In RNP, unlearning is operated at the neuron level while recovering is operated at the filter level, forming an asymmetric reconstructive learning procedure. We show that such an asymmetric process on only a few clean samples can effectively expose and prune the backdoor neurons implanted by a wide range of attacks, achieving a new state-of-the-art defense performance. Moreover, the unlearned model at the intermediate step of our RNP can be directly used to improve other backdoor defense tasks including backdoor removal, trigger recovery, backdoor label detection, and backdoor sample detection. Code is available at https://github.com/bboylyg/RNP.
Yige Li, Xixiang Lyu, Xingjun Ma, Nodens Koren, Lingjuan Lyu, Bo Li 0026, Yu-Gang Jiang 0001
ICML1
2023 Lightweight Video Frame Interpolation Based on Bidirectional Attention Module
abstract
Video frame interpolation can enhance the frame rate and improve video quality by synthesizing non-existing intermediate frames between two consecutive frames. Recently, remarkable advances have been made due to the employment of convolutional neural networks. However, most existing methods suffer from motion blur and artifacts when handling the case of large motion and occlusion. To solve the problem, we propose a lightweight but effective deep neural network which is trained end-to-end. Specifically, the bidirectional attention module is first devised to enhance motion-related features representation in both channel and spatial dimensions. Then the synthesis network estimates kernel weights, visibility map and offset vectors to finally generate the interpolation results. Moreover, to compress the model, we introduce the Ghost module to the synthesis network which is verified to be highly effective. Experiment results demonstrate that our proposed architecture performs favorably against state-of-the-art frame interpolation methods on various public video datasets.
Yige Li
ISCC1
2021 Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networks
Yige Li, Xixiang Lyu, Nodens Koren, Lingjuan Lyu, Bo Li 0026, Xingjun Ma
ICLR1
2021 Anti-Backdoor Learning: Training Clean Models on Poisoned Data
abstract
Backdoor attack has emerged as a major security threat to deep neural networks (DNNs). While existing defense methods have demonstrated promising results on detecting or erasing backdoors, it is still not clear whether robust training methods can be devised to prevent the backdoor triggers being injected into the trained model in the first place. In this paper, we introduce the concept of \emph{anti-backdoor learning}, aiming to train \emph{clean} models given backdoor-poisoned data. We frame the overall learning process as a dual-task of learning the \emph{clean} and the \emph{backdoor} portions of data. From this view, we identify two inherent characteristics of backdoor attacks as their weaknesses: 1) the models learn backdoored data much faster than learning with clean data, and the stronger the attack the faster the model converges on backdoored data; 2) the backdoor task is tied to a specific class (the backdoor target class). Based on these two weaknesses, we propose a general learning scheme, Anti-Backdoor Learning (ABL), to automatically prevent backdoor attacks during training. ABL introduces a two-stage \emph{gradient ascent} mechanism for standard training to 1) help isolate backdoor examples at an early training stage, and 2) break the correlation between backdoor examples and the target class at a later training stage. Through extensive experiments on multiple benchmark datasets against 10 state-of-the-art attacks, we empirically show that ABL-trained models on backdoor-poisoned data achieve the same performance as they were trained on purely clean data. Code is available at \url{https://github.com/bboylyg/ABL}.
Yige Li, Xixiang Lyu, Nodens Koren, Lingjuan Lyu, Bo Li 0026, Xingjun Ma
NeurIPS1