Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Zhipei Xu

dblp:359/4633 · DBLP profile ↗
← Back
6ranked-venue papers
1as first author
6since 2021 · last 2025
0009-0003-0881-9299ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 1 first-author · 4 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 3 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Network and information security
5 papers
Digital forensics and information hiding · 96% Privacy and data protection · 4%
Computer graphics and multimedia
2 papers
Rendering · 100%
Artificial intelligence
1 paper
Vision and language · 100%

Topics — the 7 heaviest of 9, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Rendering › gaussian splatting
3d gaussian splatting
1.622025
SecureGS: Boosting the Security and Fidelity of 3D Gaussian Splatting Steganography · ICLR 2025
GS-Hider: Hiding Messages into 3D Gaussian Splatting · NeurIPS 2024
Digital forensics and information hiding
steganography
1.622025
SecureGS: Boosting the Security and Fidelity of 3D Gaussian Splatting Steganography · ICLR 2025
GS-Hider: Hiding Messages into 3D Gaussian Splatting · NeurIPS 2024
Digital forensics and information hiding
watermarking
1.622025
OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarking · CVPR 2025
V2A-Mark: Versatile Deep Visual-Audio Watermarking for Manipulation Localization and Copyright Protection · ACM Multimedia 2024
Digital forensics and information hiding › forgery detection
image forgery detection and localization
0.912025
FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models · ICLR 2025
Digital forensics and information hiding › forgery detection
tamper localization
0.912025
OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarking · CVPR 2025
Computer vision › Vision and language › vision-language model
multimodal large language model
0.312025
FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models · ICLR 2025
Digital forensics and information hiding › digital forensics › multimedia forensics › image forensics
image manipulation localization
0.212024
V2A-Mark: Versatile Deep Visual-Audio Watermarking for Manipulation Localization and Copyright Protection · ACM Multimedia 2024

Methods — techniques the papers use, named apart from their topics

neural decoding · 1.7multimodal large language model · 1.7domain tag-guided detection · 1.7density region-aware growing and pruning · 1.7anchor point design · 1.7message decoder · 1.5proactive embedding · 0.9degradation-aware tamper extraction · 0.9blind extraction · 0.9AIGC-editing simulation · 0.9scene decoder · 0.8
YearPublicationVenuePosition
2025 OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarking
abstract
With the rapid growth of generative AI and its widespread application in image editing, new risks have emerged regarding the authenticity and integrity of digital content. Existing versatile watermarking approaches suffer from tradeoffs between tamper localization precision and visual quality. Constrained by the limited flexibility of previous framework, their localized watermark must remain fixed across all images. Under AIGC-editing, their copyright extraction accuracy is also unsatisfactory. To address these challenges, we propose OmniGuard, a novel augmented versatile watermarking approach that integrates proactive embedding with passive, blind extraction for robust copyright protection and tamper localization. OmniGuard employs a hybrid forensic framework that enables flexible localization watermark selection and introduces a degradation-aware tamper extraction network for precise localization under challenging conditions. Additionally, a lightweight AIGC-editing simulation layer is designed to enhance robustness across global and local editing. Extensive experiments show that OmniGuard achieves superior fidelity, robustness, and flexibility. Compared to the recent state-of-the-art approach EditGuard, our method outperforms it by 4.25dB in PSNR of the container image, 20.7% in F1-Score under noisy conditions, and 14.8% in average bit accuracy.
Xuanyu Zhang 0003, Zecheng Tang, Zhipei Xu, Runyi Li, Youmin Xu, Bin Chen 0006, Jian Zhang 0018
CVPR3
2025 MM-IML: Multi-Modal Image Forgery Detection and Localization
abstract
The proliferation of image editing tools like Photoshop has heightened risks of malicious image tampering, leading to societal, economic, and legal issues. Image Forgery Detection and Localization (IFDL) aims to identify tampered images and locate altered regions using mask representations. Current methods, including CNNs, ViTs, and Multimodal Large Language Models (MLLMs), face limitations such as poor generalization to unseen data, insufficient training datasets, and loss of critical details during embedding. Additionally, specialist models lack multimodal interaction and semantic-level understanding, limiting robustness. To address these challenges, we propose MM-IML, a general-specialized multimodal framework that combines the generalization capability of MLLMs with the precision of specialist models. By introducing a cross-modal tampering feature fusion module and leveraging swin transformer blocks, MM-IML enhances tampering detection and localization across modalities. Extensive experiments validate its superior performance and robustness, significantly surpassing existing methods on benchmark IFDL datasets.
Xiangyu Yu, Zhipei Xu
ICIP3
2025 FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models
abstract
The rapid development of generative AI is a double-edged sword, which not only facilitates content creation but also makes image manipulation easier and more difficult to detect. Although current image forgery detection and localization (IFDL) methods are generally effective, they tend to face two challenges: \textbf{1)} black-box nature with unknown detection principle, \textbf{2)} limited generalization across diverse tampering methods (e.g., Photoshop, DeepFake, AIGC-Editing). To address these issues, we propose the explainable IFDL task and design FakeShield, a multi-modal framework capable of evaluating image authenticity, generating tampered region masks, and providing a judgment basis based on pixel-level and image-level tampering clues. Additionally, we leverage GPT-4o to enhance existing IFDL datasets, creating the Multi-Modal Tamper Description dataSet (MMTD-Set) for training FakeShield's tampering analysis capabilities. Meanwhile, we incorporate a Domain Tag-guided Explainable Forgery Detection Module (DTE-FDM) and a Multi-modal Forgery Localization Module (MFLM) to address various types of tamper detection interpretation and achieve forgery localization guided by detailed textual descriptions. Extensive experiments demonstrate that FakeShield effectively detects and localizes various tampering techniques, offering an explainable and superior solution compared to previous IFDL methods. The code is available at https://github.com/zhipeixu/FakeShield.
Zhipei Xu, Xuanyu Zhang 0003, Runyi Li, Zecheng Tang, Jian Zhang 0018
ICLR1
2025 SecureGS: Boosting the Security and Fidelity of 3D Gaussian Splatting Steganography
abstract
3D Gaussian Splatting (3DGS) has emerged as a premier method for 3D representation due to its real-time rendering and high-quality outputs, underscoring the critical need to protect the privacy of 3D assets. Traditional NeRF steganography methods fail to address the explicit nature of 3DGS since its point cloud files are publicly accessible. Existing GS steganography solutions mitigate some issues but still struggle with reduced rendering fidelity, increased computational demands, and security flaws, especially in the security of the geometric structure of the visualized point cloud. To address these demands, we propose a \textbf{SecureGS}, a secure and efficient 3DGS steganography framework inspired by Scaffold-GS's anchor point design and neural decoding. SecureGS uses a hybrid decoupled Gaussian encryption mechanism to embed offsets, scales, rotations, and RGB attributes of the hidden 3D Gaussian points in anchor point features, retrievable only by authorized users through privacy-preserving neural networks. To further enhance security, we propose a density region-aware anchor growing and pruning strategy that adaptively locates optimal hiding regions without exposing hidden information. Extensive experiments show that SecureGS significantly surpasses existing GS steganography methods in rendering fidelity, speed, and security.
Xuanyu Zhang 0003, Jiarui Meng, Zhipei Xu, Shuzhou Yang, Yanmin Wu, Ronggang Wang, Jian Zhang 0018
ICLR3
2024 V2A-Mark: Versatile Deep Visual-Audio Watermarking for Manipulation Localization and Copyright Protection
abstract
AI-generated video has revolutionized short video production, filmmaking, and personalized media, making video local editing an essential tool. However, this progress also blurs the line between reality and fiction, posing challenges in multimedia forensics. To solve this urgent issue, V2A-Mark is proposed to address the limitations of current video tampering forensics, such as poor generalizability, singular function, and single modality focus. Combining the fragility of video-into-video steganography with deep robust watermarking, our method can embed invisible visual-audio localization watermarks and copyright watermarks into the original video frames and audio, enabling precise manipulation localization and copyright protection. We also design a temporal alignment and fusion module and degradation prompt learning to enhance the localization accuracy and decoding robustness. Meanwhile, we introduce a sample-level audio localization method and a cross-modal copyright extraction mechanism to couple the information of audio and video frames. The effectiveness of V2A-Mark has been verified on a visual-audio tampering dataset, emphasizing its superiority in localization precision and copyright accuracy, crucial for the sustainable development of video editing in the AIGC video era.
Xuanyu Zhang 0003, Youmin Xu, Runyi Li, Jiwen Yu, Zhipei Xu, Jian Zhang 0018
ACM Multimedia6
2024 GS-Hider: Hiding Messages into 3D Gaussian Splatting
abstract
3D Gaussian Splatting (3DGS) has already become the emerging research focus in the fields of 3D scene reconstruction and novel view synthesis. Given that training a 3DGS requires a significant amount of time and computational cost, it is crucial to protect the copyright, integrity, and privacy of such 3D assets. Steganography, as a crucial technique for encrypted transmission and copyright protection, has been extensively studied. However, it still lacks profound exploration targeted at 3DGS. Unlike its predecessor NeRF, 3DGS possesses two distinct features: 1) explicit 3D representation; and 2) real-time rendering speeds. These characteristics result in the 3DGS point cloud files being public and transparent, with each Gaussian point having a clear physical significance. Therefore, ensuring the security and fidelity of the original 3D scene while embedding information into the 3DGS point cloud files is an extremely challenging task. To solve the above-mentioned issue, we first propose a steganography framework for 3DGS, dubbed GS-Hider, which can embed 3D scenes and images into original GS point clouds in an invisible manner and accurately extract the hidden messages. Specifically, we design a coupled secured feature attribute to replace the original 3DGS's spherical harmonics coefficients and then use a scene decoder and a message decoder to disentangle the original RGB scene and the hidden message. Extensive experiments demonstrated that the proposed GS-Hider can effectively conceal multimodal messages without compromising rendering quality and possesses exceptional security, robustness, capacity, and flexibility. Our project is available at: https://xuanyuzhang21.github.io/project/gshider.
Xuanyu Zhang 0003, Jiarui Meng, Runyi Li, Zhipei Xu, Yongbing Zhang 0002, Jian Zhang 0018
NeurIPS4