Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.

Yifeng Gao 0002

dblp:84/10043-2 · DBLP profile ↗
← Back
5ranked-venue papers
1as first author
5since 2021 · last 2025
0000-0001-5034-1928ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Graphics, computer vision, multimedia, augmented reality and games · 4 · 1 first-author · 4 since 2021Artificial intelligence and machine learning · 2 · 2 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Network and information security
3 papers
Security and privacy of machine learning · 60% Privacy and data protection · 21% Systems and software security · 18%
Artificial intelligence
3 papers
Vision and language · 46% Trustworthy machine learning · 23% Generative modeling · 23%

Topics — the 10 heaviest of 10, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Trustworthy machine learning › AI safety
safety alignment
0.912025
SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Models · CVPR 2025
Machine learning › Generative modeling
video generation
0.912025
BrokenVideos: A Benchmark Dataset for Fine-Grained Artifact Localization in AI-Generated Videos · ACM Multimedia 2025
Computer vision › Vision and language
video-language model
0.912025
SafeVid: Toward Safety Aligned Video Large Multimodal Models · NeurIPS 2025
Computer vision › Vision and language
vision-language model
0.912025
SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Models · CVPR 2025
Privacy and data protection › privacy-preserving machine learning
data protection against unauthorized training
0.912025
T2UE: Generating Unlearnable Examples from Text Descriptions · ACM Multimedia 2025
Security and privacy of machine learning › large language model alignment
safety alignment
0.912025
SafeVid: Toward Safety Aligned Video Large Multimodal Models · NeurIPS 2025
Security and privacy of machine learning › poisoning attack
unlearnable examples
0.912025
T2UE: Generating Unlearnable Examples from Text Descriptions · ACM Multimedia 2025
Systems and software security › software protection
model locking
0.812024
ModelLock: Locking Your Model With a Spell · ACM Multimedia 2024
Security and privacy of machine learning
model protection
0.812024
ModelLock: Locking Your Model With a Spell · ACM Multimedia 2024
Natural language and speech › Language models and text generation › alignment
preference alignment
0.312025
SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Models · CVPR 2025

Methods — techniques the papers use, named apart from their topics

textual video descriptions · 1.7direct preference optimization · 1.7LLM-based safety reasoning · 1.7text-to-image model · 0.9reinforcement learning from human feedback · 0.9preference alignment · 0.9multimodal large language model · 0.9error minimization · 0.9watermarking · 0.8cryptographic locking · 0.8
YearPublicationVenuePosition
2025 SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Models
abstract
The emergence of Vision Language Models (VLMs) has brought unprecedented advances in understanding multi-modal information. The combination of textual and visual semantics in VLMs is highly complex and diverse, making the safety alignment of these models challenging. Furthermore, due to the limited study on the safety alignment of VLMs, there is a lack of large-scale, high-quality datasets. To address these limitations, we propose a Safety Preference Alignment dataset for Vision Language Models named SPA-VL. In terms of breadth, SPA-VL covers 6 harmfulness domains, 13 categories, and 53 subcategories, and contains 100,788 samples of the quadruple (question, image, chosen response, rejected response). In terms of depth, the responses are collected from 12 open-source (e.g., QwenVL) and closed-source (e.g., Gemini) VLMs to ensure diversity. The construction of preference data is fully automated, and the experimental results indicate that models trained with alignment techniques on the SPA-VL dataset exhibit substantial improvements in harmlessness and helpfulness while maintaining core capabilities. SPA-VL, as a large-scale, high-quality, and diverse dataset, represents a significant milestone in ensuring that VLMs achieve both harmlessness and helpfulness.
Yongting Zhang, Lu Chen 0001, Guodong Zheng, Yifeng Gao 0002, Jinlan Fu, Zhenfei Yin, Senjie Jin, Yu Qiao 0001, Xuanjing Huang 0001, Feng Zhao 0004, Tao Gui
CVPR4
2025 BrokenVideos: A Benchmark Dataset for Fine-Grained Artifact Localization in AI-Generated Videos
abstract
The field of video generation has witnessed remarkable advances in recent years, driven by innovations in deep generative models. Nevertheless, the fidelity of AI-generated videos remains far from perfect, with synthesized content frequently exhibiting visual artifacts, such as temporally inconsistent motion, physically implausible trajectories, unnatural object deformations, and local blurring, that undermine realism and user trust. Precise detection and spatial localization of these artifacts are of critical importance: not only are they essential for automatic quality control pipelines that improves user experience, but they also provide actionable diagnostic signals for researchers and practitioners to guide model development and evaluation. Despite its significance, the research community currently lacks a comprehensive benchmark tailored for artifact localization in AI-generated videos. Existing datasets either focus solely on detection at the video or frame level, or lack fine-grained spatial annotations necessary for developing and benchmarking localization methods. To fill this gap, we present BrokenVideos, a benchmark dataset comprising ~3,254 AI-generated videos with carefully-annotated, pixel-level masks indicating regions of visual corruption. Each annotation is the result of careful human inspection, ensuring high-quality ground truth for artifact localization tasks. We demonstrate that training existing video artifact detection models and multi-modal large language models (MLLMs) on BrokenVideos substantially enhances their ability to localize corrupted regions within generated content. Through extensive experiments and cross-model evaluations, we show that BrokenVideos provides a critical foundation for both benchmarking and advancing artifact localization research. We hope our dataset can catalyze further innovation in both video generation and its quality assurance. The dataset is available at: https://broken-video-detection-datetsets.github.io/Broken-Video-Detection-Datasets.github.io/.
Weixuan Peng, Bojia Zi, Yifeng Gao 0002, Xianbiao Qi, Xingjun Ma, Yu-Gang Jiang 0001
ACM Multimedia4
2025 T2UE: Generating Unlearnable Examples from Text Descriptions
abstract
Large-scale pre-training frameworks like CLIP have revolutionized multimodal learning, but their reliance on web-scraped datasets, frequently containing private user data, raises serious concerns about misuse. Unlearnable Examples (UEs) have emerged as a promising countermeasure against unauthorized model training, employing carefully crafted unlearnable noise to disrupt the learning of meaningful representations from protected data. Current approaches typically generate UEs by jointly optimizing unlearnable noise for both images and their associated text descriptions (or labels). However, this optimization process is often computationally prohibitive for on-device execution, forcing reliance on external third-party services. This creates a fundamental privacy paradox: users must initially expose their data to these very services to achieve protection, thereby compromising privacy in the process. Such a contradiction has severely hindered the development of practical, scalable data protection solutions. To resolve this paradox, we introduce Text-to-Unlearnable Example (T2UE), a novel framework that enables users to generate UEs using only text descriptions. T2UE circumvents the need for original image data by employing a text-to-image (T2I) model to map text descriptions into the image (noise) space, combined with an error-minimization framework to produce effective unlearnable noise. Extensive experiments show that T2UE-protected data substantially degrades performance in downstream tasks (e.g., cross-modal retrieval) for state-of-the-art models. Notably, the protective effect generalizes across diverse architectures and even to supervised learning settings. Our work demonstrates the feasibility of ''zero-contact data protection'', where personal data can be safeguarded based solely on their textual descriptions, eliminating the need for direct data exposure.
Xingjun Ma, Hanxun Huang, Tianwei Song, Ye Sun 0004, Yifeng Gao 0002, Yu-Gang Jiang 0001
ACM Multimedia5
2025 SafeVid: Toward Safety Aligned Video Large Multimodal Models
abstract
As Video Large Multimodal Models (VLMMs) rapidly advance, their inherent complexity introduces significant safety challenges, particularly the issue of mismatched generalization where static safety alignments fail to transfer to dynamic video contexts. We introduce SafeVid, a framework designed to instill video-specific safety principles in VLMMs. SafeVid uniquely transfers robust textual safety alignment capabilities to the video domain by employing detailed textual video descriptions as an interpretive bridge, facilitating LLM-based rule-driven safety reasoning. This is achieved through a closed-loop system comprising: 1) generation of SafeVid-350K, a novel 350,000-pair video-specific safety preference dataset; 2) targeted alignment of VLMMs using Direct Preference Optimization (DPO); and 3) comprehensive evaluation via our new SafeVidBench benchmark. Alignment with SafeVid-350K significantly enhances VLMM safety, with models like LLaVA-NeXT-Video demonstrating substantial improvements (e.g., up to 42.39%) on SafeVidBench. SafeVid provides critical resources and a structured approach, demonstrating that leveraging textual descriptions as a conduit for safety reasoning markedly improves the safety alignment of VLMMs in complex multimodal scenarios.
Yixu Wang, Yifeng Gao 0002, Xin Wang 0119, Yan Teng 0002, Xingjun Ma, Yingchun Wang 0004, Yu-Gang Jiang 0001
NeurIPS3
2024 ModelLock: Locking Your Model With a Spell
Yifeng Gao 0002, Xingjun Ma, Zuxuan Wu, Yu-Gang Jiang 0001
ACM Multimedia1