Shilin Lu

dblp:131/6865 · DBLP profile ↗
← Back
7ranked-venue papers
5as first author
6since 2021 · last 2025
0000-0003-2848-0619ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 3 first-author · 4 since 2021Graphics, computer vision, multimedia, augmented reality and games · 4 · 3 first-author · 4 since 2021Systems, architecture and hardware · 1 · 1 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
5 papers
Generative modeling · 98% Trustworthy machine learning · 2%
Network and information security
1 paper
Digital forensics and information hiding · 100%
Computer graphics and multimedia
2 papers
Visual content generation and editing · 84% Image and video coding · 16%

Topics — the 12 heaviest of 12, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling
diffusion model
4.052025
Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Concepts · ACM Multimedia 2025
EraseAnything: Enabling Concept Erasure in Rectified Flow Transformers · ICML 2025
Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances · ICLR 2025
Machine learning › Generative modeling
concept erasure
2.532025
Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Concepts · ACM Multimedia 2025
EraseAnything: Enabling Concept Erasure in Rectified Flow Transformers · ICML 2025
MACE: Mass Concept Erasure in Diffusion Models · CVPR 2024
Machine learning › Generative modeling › diffusion model
text-to-image generation
2.532025
Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Concepts · ACM Multimedia 2025
EraseAnything: Enabling Concept Erasure in Rectified Flow Transformers · ICML 2025
MACE: Mass Concept Erasure in Diffusion Models · CVPR 2024
Machine learning › Generative modeling › diffusion model
controllable generation
0.912025
Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Concepts · ACM Multimedia 2025
Machine learning › Generative modeling › diffusion model
image editing
0.912025
Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances · ICLR 2025
Digital forensics and information hiding › watermarking
robust watermarking
0.912025
Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances · ICLR 2025
Digital forensics and information hiding
watermarking
0.912025
Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances · ICLR 2025
Visual content generation and editing › image editing
image compositing
0.712023
TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition · ICCV 2023
Visual content generation and editing
image editing
0.712023
TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition · ICCV 2023
Image and video coding
image quality assessment
0.312025
Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances · ICLR 2025
Machine learning › Trustworthy machine learning
generative model safety
0.212024
MACE: Mass Concept Erasure in Diffusion Models · CVPR 2024
Machine learning › Generative modeling › generative adversarial network
cross-domain image generation
0.212023
TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition · ICCV 2023

Methods — techniques the papers use, named apart from their topics

diffusion model adaptation · 2.6surrogate attacks · 1.7weight saliency map · 0.9surrogate attack · 0.9fine-tuning · 0.9contrastive learning · 0.9classifier-free guidance · 0.9bi-level optimization · 0.9attention map regularization · 0.9LoRA · 0.9cross-attention refinement · 0.8image inversion · 0.7exceptional prompt · 0.7diffusion model · 0.7
YearPublicationVenuePosition
2025 Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances
abstract
Current image watermarking methods are vulnerable to advanced image editing techniques enabled by large-scale text-to-image models. These models can distort embedded watermarks during editing, posing significant challenges to copyright protection. In this work, we introduce W-Bench, the first comprehensive benchmark designed to evaluate the robustness of watermarking methods against a wide range of image editing techniques, including image regeneration, global editing, local editing, and image-to-video generation. Through extensive evaluations of eleven representative watermarking methods against prevalent editing techniques, we demonstrate that most methods fail to detect watermarks after such edits. To address this limitation, we propose VINE, a watermarking method that significantly enhances robustness against various image editing techniques while maintaining high image quality. Our approach involves two key innovations: (1) we analyze the frequency characteristics of image editing and identify that blurring distortions exhibit similar frequency properties, which allows us to use them as surrogate attacks during training to bolster watermark robustness; (2) we leverage a large-scale pretrained diffusion model SDXL-Turbo, adapting it for the watermarking task to achieve more imperceptible and robust watermark embedding. Experimental results show that our method achieves outstanding watermarking performance under various image editing techniques, outperforming existing methods in both image quality and robustness. Code is available at https://github.com/Shilin-LU/VINE
Shilin Lu, Jiayou Lu, Adams Wai-Kin Kong
ICLR1
2025 EraseAnything: Enabling Concept Erasure in Rectified Flow Transformers
abstract
Removing unwanted concepts from large-scale text-to-image (T2I) diffusion models while maintaining their overall generative quality remains an open challenge. This difficulty is especially pronounced in emerging paradigms, such as Stable Diffusion (SD) v3 and Flux, which incorporate flow matching and transformer-based architectures. These advancements limit the transferability of existing concept-erasure techniques that were originally designed for the previous T2I paradigm (e.g., SD v1.4). In this work, we introduce EraseAnything, the first method specifically developed to address concept erasure within the latest flow-based T2I framework. We formulate concept erasure as a bi-level optimization problem, employing LoRA-based parameter tuning and an attention map regularizer to selectively suppress undesirable activations. Furthermore, we propose a self-contrastive learning strategy to ensure that removing unwanted concepts does not inadvertently harm performance on unrelated ones. Experimental results demonstrate that EraseAnything successfully fills the research gap left by earlier methods in this new T2I paradigm, achieving state-of-the-art performance across a wide range of concept erasure tasks.
Daiheng Gao, Shilin Lu, Wenbo Zhou 0004, Jiaming Chu, Jie Zhang 0073, Mengxi Jia, Bang Zhang, Zhaoxin Fan, Weiming Zhang 0001
ICML2
2025 Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Concepts
abstract
Ensuring the ethical deployment of text-to-image models requires effective techniques to prevent the generation of harmful or inappropriate content. While concept erasure methods offer a promising solution, existing finetuning-based approaches suffer from notable limitations. Anchor-free methods risk disrupting sampling trajectories, leading to visual artifacts, while anchor-based methods rely on the heuristic selection of anchor concepts. To overcome these shortcomings, we introduce a finetuning framework, dubbed ANT, which Automatically guides deNoising Trajectories to avoid unwanted concepts. ANT is built on a key insight: reversing the condition direction of classifier-free guidance during mid-to-late denoising stages enables precise content modification without sacrificing early-stage structural integrity. This inspires a trajectory-aware objective that preserves the integrity of the early-stage score function field-which steers samples toward the natural image manifold-without relying on heuristic anchor concept selection. For single-concept erasure, we propose an augmentation-enhanced weight saliency map to precisely identify the critical parameters that most significantly contribute to the unwanted concept, enabling more thorough and efficient erasure. For multi-concept erasure, our objective function offers a versatile plug-and-play solution that significantly boosts performance. Extensive experiments demonstrate that ANT achieves state-of-the-art results in both single and multi-concept erasure, delivering high-quality, safe outputs without compromising the generative fidelity. Code is available at https://github.com/lileyang1210/ANT
Leyang Li, Shilin Lu, Yan Ren 0002, Adams Wai-Kin Kong
ACM Multimedia2
2024 MACE: Mass Concept Erasure in Diffusion Models
abstract
The rapid expansion of large-scale text-to-image diffusion models has raised growing concerns regarding their potential misuse in creating harmful or misleading content. In this paper, we introduce MACE, a finetuning framework for the task of MAss Concept Erasure. This task aims to prevent models from generating images that embody unwanted concepts when prompted. Existing concept erasure methods are typically restricted to handling fewer than five concepts simultaneously and struggle to find a balance between erasing concept synonyms (generality) and maintaining unrelated concepts (specificity). In contrast, MACE differs by successfully scaling the erasure scope up to 100 concepts and by achieving an effective balance between generality and specificity. This is achieved by leveraging closed-form cross-attention refinement along with LoRA finetuning, collectively eliminating the information of undesirable concepts. Furthermore, MACE integrates multiple LoRAs without mutual interference. We conduct extensive evaluations of MACE against prior methods across four different tasks: object erasure, celebrity erasure, explicit content erasure, and artistic style erasure. Our results reveal that MACE surpasses prior methods in all evaluated tasks. Code is available at https://github.com/Shilin-LU/MACE.
Shilin Lu, Zilan Wang, Leyang Li, Yanzhu Liu, Adams Wai-Kin Kong
CVPR1
2023 TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition
abstract
Text-driven diffusion models have exhibited impressive generative capabilities, enabling various image editing tasks. In this paper, we propose TF-ICON, a novel Training-Free Image COmpositioN framework that harnesses the power of text-driven diffusion models for cross-domain image-guided composition. This task aims to seamlessly integrate user-provided objects into a specific visual context. Current diffusion-based methods often involve costly instance-based optimization or finetuning of pre-trained models on customized datasets, which can potentially undermine their rich prior. In contrast, TF-ICON can leverage off-the-shelf diffusion models to perform cross-domain image-guided composition without requiring additional training, finetuning, or optimization. Moreover, we introduce the exceptional prompt, which contains no information, to facilitate text-driven diffusion models in accurately inverting real images into latent representations, forming the basis for compositing. Our experiments show that equipping Stable Diffusion with the exceptional prompt outperforms state-of-the-art inversion methods on various datasets (CelebA-HQ, COCO, and ImageNet), and that TF-ICON surpasses prior baselines in versatile visual domains. Code is available at https://github.com/Shilin-LU/TF-ICON
Shilin Lu, Yanzhu Liu, Adams Wai-Kin Kong
ICCV1
2022 Copy-move image forgery detection based on evolving circular domains coverage
abstract
Abstract The aim of this paper is to improve the accuracy of copy-move forgery detection (CMFD) in image forensics by proposing a novel scheme and the main contribution is evolving circular domains coverage (ECDC) algorithm. The proposed scheme integrates both block-based and keypoint-based forgery detection methods. Firstly, the speed-up robust feature (SURF) in log-polar space and the scale invariant feature transform (SIFT) are extracted from an entire image. Secondly, generalized 2 nearest neighbor (g2NN) is employed to get massive matched pairs. Then, random sample consensus (RANSAC) algorithm is employed to filter out mismatched pairs, thus allowing rough localization of counterfeit areas. To present these forgery areas more accurately, we propose the efficient and accurate ECDC algorithm to present them. This algorithm can find satisfactory threshold areas by extracting block features from jointly evolving circular domains, which are centered on matched pairs. Finally, morphological operation is applied to refine the detected forgery areas. Experimental results indicate that the proposed CMFD scheme can achieve better detection performance under various attacks compared with other state-of-the-art CMFD schemes.
Shilin Lu, Xinghong Hu, Chengyou Wang, Shulu Han, Yuejia Han
Multim. Tools Appl.1
2015 Reporting an experience on design and implementation of e-Health systems on Azure cloud
abstract
Summary Electronic Health (e‐Health) technology has brought the world with significant transformation from traditional paper‐based medical practice to Information and Communication Technologies (ICT)‐based systems for automatic management (storage, processing, and archiving) of information. Traditionally, e‐Health systems have been designed to operate within stovepipes on dedicated networks, physical computers, and locally managed software platforms that make it susceptible to many serious limitations including: (1) lack of on‐demand scalability during critical situations, (2) high administrative overheads and costs, and (3) inefficient resource utilization and energy consumption due to lack of automation. In this paper, we present an approach to migrate the ICT systems in the e‐Health sector from traditional in‐house Client/Server (C/S) architecture to the virtualized cloud computing environment. To this end, we developed two cloud‐based e‐Health applications (Medical Practice Management System and Telemedicine Practice System) for demonstrating how cloud services can be leveraged for developing and deploying such applications. The Windows Azure cloud computing platform is selected as an example public cloud platform for our study. We conducted several performance evaluation experiments to understand the QoS tradeoffs of our applications under variable workload on Azure. Copyright © 2014 John Wiley & Sons, Ltd.
Shilin Lu, Rajiv Ranjan 0001, Peter E. Strazdins
Concurr. Comput. Pract. Exp.1