Monitoring real-time air quality is essential for safeguarding public health and fostering social progress. However, the widespread deployment of air quality monitoring stations is constrained by their significant costs. To address this limitation, we introduce AirRadar, a deep neural network designed to accurately infer real-time air quality in locations lacking monitoring stations by utilizing data from existing ones. By leveraging learnable mask tokens, AirRadar reconstructs air quality features in unmonitored regions. Specifically, it operates in two stages: first capturing spatial correlations and then adjusting for distribution shifts. We validate AirRadar’s efficacy using a year-long dataset from 1,085 monitoring stations across China, demonstrating its superiority over multiple baselines, even with varying degrees of unobserved data.

One-shot 3D talking portrait generation aims to reconstruct a 3D avatar from an unseen image, and then animate it with a reference video or audio to generate a talking portrait video. The existing methods fail to simultaneously achieve the goals of accurate 3D avatar reconstruction and stable talking face animation. Besides, while the existing works mainly focus on synthesizing the head part, it is also vital to generate natural torso and background segments to obtain a realistic talking portrait video. To address these limitations, we present Real3D-Potrait, a framework that (1) improves the one-shot 3D reconstruction power with a large image-to-plane model that distills 3D prior knowledge from a 3D face generative model; (2) facilitates accurate motion-conditioned animation with an efficient motion adapter; (3) synthesizes realistic video with natural torso movement and switchable background using a head-torso-background super-resolution model; and (4) supports one-shot audio-driven talking face generation with a generalizable audio-to-motion model. Extensive experiments show that Real3D-Portrait generalizes well to unseen identities and generates more realistic talking portrait videos compared to previous methods. Video samples are available at https://real3dportrait.github.io.

Talking head generation aims to generate faces that maintain the identity information of the source image and imitate the motion of the driving image. Most pioneering methods rely primarily on 2D representations and thus will inevitably suffer from face distortion when large head rotations are encountered. Recent works instead employ explicit 3D structural representations or implicit neural rendering to improve performance under large pose changes. Nevertheless, the fidelity of identity and expression is not so desirable, especially for novel-view synthesis. In this paper, we propose HiDe-NeRF, which achieves high-fidelity and free-view talking-head synthesis. Drawing on the recently proposed Deformable Neural Radiance Fields, HiDe-NeRF represents the 3D dynamic scene into a canonical appearance field and an implicit deformation field, where the former comprises the canonical source face and the latter models the driving pose and expression. In particular, we improve fidelity from two aspects: (i) to enhance identity expressiveness, we design a generalized appearance module that leverages multi-scale volume features to preserve face shape and details; (ii) to improve expression preciseness, we propose a lightweight deformation module that explicitly decouples the pose and expression to enable precise expression modeling. Extensive experiments demonstrate that our proposed approach can generate better results than previous works. Project page: https://www.waytron.net/hidenerf/

Recently, the abuse of image generation techniques based on artificial intelligence has posed a great threat to the integrity of digital images. However, existing detection methods are hard to provide generalized detection capability of fake images generated by unseen models. To address this issue, we propose a generalized fake image detection framework based on gated hierarchical multi-task learning, which is supervised by well-designed forensics sub-tasks. Firstly, a global artifact learning task is constructed as binary classification with region masking augmentation. Besides, a block-wise spatial correlation learning task is designed by solving jigsaw puzzle cooperated with color jitter operations, which aims to explore common artifacts of various generators. Finally, a hierarchical multi-task learning paradigm is developed with multi-gate structures, which can adjust the importance of different forensics clues and jointly enhance detection performance. Extensive experiments have been conducted to evaluate the superiority of the proposed method on the open-set scenario with unseen generators

Recently, researchers have been dedicated to discovering Generative Adversarial Network (GAN) artifacts and using them to identify generated images. However, current approaches exhibit restricted performance when testing against unseen GAN models, which is also known as the cross-domain scenario. To overcome this limitation, we propose a novel GAN-generated image detection framework by estimating artifact similarity, which is inspired by relation network. The proposed method consists of two stages, including representation learning and representation comparison. For representation learning, ResNet-50 equipped with Instance Normalization in the Shallow layers (ResNet-INS) is constructed as the embedding network to extract generalized features. For representation comparison, Category and Domain-Aware loss function (CDA loss) is designed by leveraging both category and domain information efficiently, which can enlarge inter-class discrepancy of different categories (GAN-generated or pristine images) and improve intra-class compactness from different domains (source attributions) in the same category. Extensive experiments are conducted which consider various cross-domain scenarios to verify the generalization of the proposed method. Besides, our method exhibits satisfying robustness against common post-processings, even when data augmentation is not considered during the training stage.