As artificial intelligence advances rapidly, particularly with the advent of GANs and diffusion models, the accuracy of Image Inpainting Localization (IIL) has become increasingly challenging. Current IIL methods face two main challenges: a tendency towards overconfidence, leading to incorrect predictions; and difficulty in detecting subtle tampering boundaries in inpainted images. In response, we propose a new paradigm that treats IIL as a conditional mask generation task utilizing diffusion models. Our method, InpDiffusion, utilizes the denoising process enhanced by the integration of image semantic conditions to progressively refine predictions. During denoising, we employ edge conditions and introduce a novel edge supervision strategy to enhance the model's perception of edge details in inpainted objects. Balancing the diffusion model's stochastic sampling with edge supervision of tampered image regions mitigates the risk of incorrect predictions from overconfidence and prevents the loss of subtle boundaries that can result from overly stochastic processes. Furthermore, we propose an innovative Dual-stream Multi-scale Feature Extractor (DMFE) for extracting multi-scale features, enhancing feature representation by considering both semantic and edge conditions of the inpainted images. Extensive experiments across challenging datasets demonstrate that the InpDiffusion significantly outperforms existing state-of-the-art methods in IIL tasks, while also showcasing excellent generalization capabilities and robustness.

Generative Image Tampering (GIT), due to its high diversity and realism, poses a significant challenge to traditional image tampering localization techniques. Consequently, this paper introduces a denoising diffusion probabilistic model-based DcDsDiff, which comprises a Dual-View Conditional Network (DVCN) and a Dual-Stream Denoising Network (DSDN). DVCN provides clues about the tampered areas. It extracts tampering features in the high-frequency view and integrates them with spatial domain features using attention mechanisms. DSDN jointly generates mask image and detail image, enhancing the generalization capability of the model against new tampering forms through iterative denoising. A multi-stream interaction mechanism enables the two generative tasks to promote each other, prompting the model to generate localization results that are rich in detail and complete. Experiments show that DcDsDiff outperforms mainstream methods in accurate localization, generalization, extensibility, and robustness. Code page: https://github.com/QixianHao/DcDsDiff-and-GIT10K.

To counter the security threats posed by the realism of image inpainting generated through diffusion models and GANs, in this paper, we propose a texture enhancement and progressive refinement network (TEPR-Net) for image inpainting localization (IIL). The IIL task is divided into two phases: coarse and fine locating. In the coarse locating phase, we utilize an anomaly texture encoder to capture tampering traces in textures, employ a texture–context feature interaction strategy to effectively integrate texture features with contextual features, and utilize a pixel-level contrastive learning strategy to enhance feature clustering and model generalization. In the fine locating phase, we first enhance the receptive field features in the frequency domain by transforming the features and separately enhancing the low- and high-frequency components. Then, we utilize the coarse localization result to augment the model's sensitivity to tampered regions. Additionally, we introduce a progressive edge distribution guidance and reconstruction strategy that progressively refines the edges of the tampered regions at each level, ultimately generating refined localization results. To support the research and evaluation of the IIL task, we create the Inpaint32K dataset, which is characterized by its large scale, diversity, comprehensiveness, high quality, and authenticity. Finally, extensive experiments demonstrate that TEPR-Net has significant advantages in terms of localization performance, generalizability, extensibility, and robustness.

Tampered images can easily be used for illegal activities, such as spreading rumors, economic fraud, fabricating false news, and illegally obtaining experience benefits, etc. With the improvement and development of artificial intelligence (AI), image manipulation technology has also been further improved, more and more retouching software in daily life adopts AI technology. So far, there is no AI-based tampered dataset. To address this challenge, we propose a dataset-IPM15K. It utilizes the most advanced image processing technology and contains a total of 150,00 doctored vital images. This dataset also could serve as a catalyst for progressing many vision tasks, e.g., localization, segmentation, and alpha-matting, etc. Additionally, we propose an effective multi-feature fusion identification network (MFI-Net) to identify these challenging images. Our model consists of four modules: the detail extraction module (DEM), which utilizes different sizes of convolutions and perceptual fields to extract more valuable information of tampered locations; the multi-branch attention fusion module (MAFM), which fully exploits contextual information of different levels to capture subtle traces of tampering; the feature decoder component (FDC), which combines fused features to identify tampered regions; and the detail enhancement block (DEB), which continues to supplement the detailed information of the detected regions. Extensive experiments on three public datasets and the proposed dataset show that MFI-Net outperforms various state-of-the-art (SOTA) manipulation detection baselines.

Digital watermarking technology and watermark attack methods are mutually reinforcing and complementary. Currently, traditional watermark attack methods are relatively mature, but these traditional attack methods will inevitably damage the visual quality of original images (OIs). Therefore, this paper proposes a covert attack method called residual dense based imperceptible watermark attack network (RD-IWAN). First, this paper designs a watermark attack residual dense network (WARDN) based on the residual dense network (RDN), which can effectively remove the watermark information in the middle and low frequency features of the watermarked image (WMI). Second, to improve the attack ability of the network, this paper innovatively proposes a progressive preprocessing method based on the information enhancement preprocessing method. Concurrently, to ensure the imperceptibility of this watermark attack method, a comprehensive loss function that combines the perceptual loss and mean square error loss (MSE) of OI and attacked watermarked image (AWMI) is designed in this study. Finally, attack experiments are designed and performed on watermarks with different embedding strengths and sizes. Experimental results show that, compared to traditional attack methods, the watermark attack method proposed in this paper exhibits stronger attack ability and higher imperceptibility.

Exponential moments (EMs) are important radial orthogonal moments, which have good image description ability and have less information redundancy compared with other orthogonal moments. Therefore, it has been used in various fields of image processing in recent years. However, EMs can only take integer order, which limits their reconstruction and antinoising attack performances. The promotion of fractional-order exponential moments (FrEMs) effectively alleviates the numerical instability problem of EMs; however, the numerical integration errors generated by the traditional calculation methods of FrEMs still affect the accuracy of FrEMs. Therefore, the Gaussian numerical integration (GNI) is used in this paper to propose an accurate calculation method of FrEMs, which effectively alleviates the numerical integration error. Extensive experiments are carried out in this paper to prove that the GNI method can significantly improve the performance of FrEMs in many aspects.