Current parameterized image representations embed visual information along the semantic boundaries and struggle to express the internal detailed texture structures of image components, leading to a lack of content consistency after image editing and driving. To address these challenges, this work proposes a novel parameterized representation based on hierarchical image proxy geometry, utilizing multi-layer hierarchically interrelated proxy geometric control points to embed multi-scale long-range structures and fine-grained texture details. The proposed representation enables smoother and more continuous interpolation during image rendering and ensures high-quality consistency within image components during image editing. Additionally, under the layer-wise representation strategy based on semantic-aware image layer decomposition, we enable decoupled image shape/texture editing of the targets of interest within the image. Extensive experimental results on image vectorization and editing tasks demonstrate that our proposed method achieves high rendering accuracy of general images, including natural images, with a significantly higher image parameter compression ratio, facilitating user-friendly editing of image semantic components.

Yuan Liu, Zhongyin Zhao, Le Tian, Haicheng Wang, Xubing Ye, Yangxiu You, Zilin Yu, Chuhan Wu, Zhou Xiao, Yang Yu, Jie Zhou. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.

Scalable Vector Graphics (SVG) is a code structure used to represent visual information, and with the powerful capabilities of large language models, it holds significant research potential. Current text-to-SVG generation methods lack generalization capabilities and struggle with accurately adhering to input generation instructions. In this paper, we propose a novel approach for generating SVG using large language models, named SVGThinker, which incorporates a reasoning process to align the generation of SVG code with the visualization process, while supporting all SVG primitives. Through sequential rendering of SVG primitives, we first use a multimodal model to annotate the SVG, followed by sequential updates corresponding to the incremental additions of primitives. We then employ a supervised training framework based on Chain-of-Thought reasoning, which enhances the model's robustness and reduces the risk of errors or hallucinations. Through comparisons with state-of-the-art baseline models, our experiments show that our model generates more stable, high-quality, and editable SVG code. In contrast to image-based methods, our approach preserves the structural advantages of SVG and supports precise, hierarchical editing. We believe our work opens new directions for SVG generation, with potential applications in design, content creation, and automated SVG-based graphic generation.

Intelligent generation of vector graphics has very promising applications in the fields of advertising and logo design, artistic painting, animation production, etc. However, current mainstream vector image generation methods lack the encoding of image appearance information that is associated with the original vector representation and therefore lose valid supervision signal from the strong correlation between the discrete vector parameter (drawing in-struction) sequence and the target shape/structure of the corresponding pixel image. On the one hand, the gener-ation process based on pure vector domain completely ignores the similarity measurement between shape parameter (and their combination) and the paired pixel image appearance pattern; on the other hand, two-stage methods (i.e., generation-and-vectorization) based on pixel diffusion followed by differentiable image-to-vector translation suf-fer from wrong error-correction signal caused by approxi-mate gradients. To address the above issues, we propose a novel generation framework based on dual-domain (vector-pixel) diffusion with cross-modality impulse signals from each other. First, in each diffusion step, the current representation extracted from the other domain is used as a condition variable to constrain the subsequent sampling operation, yielding shape-aware new parameterizations; second, independent supervision signals from both domains avoid the gradient error accumulation problem caused by cross-domain representation conversion. Extensive experimental results on popular benchmarks including font and icon datasets demonstrate the great advantages of our proposed framework in terms of generated shape quality.

Anomaly detection in surveillance videos is challenging but important for ensuring public security. Different from pixel-based anomaly detection methods, pose-based methods utilize highly-structured skeleton data, which decreases the computational burden and also avoids the negative impact of background noise. However, pose-based methods lack an alternative dynamic representation akin to the explicit motion features, such as optical flow, employed by pixel-based methods. In this paper, a novel Motion Embedder (ME), a label-efficient scheme without extra annotation efforts, is proposed to provide a pose motion representation for the structured posed data from a probability perspective. Furthermore, a novel task-specific Spatial-Temporal Transformer (STT) is deployed for self-supervised pose sequence reconstruction. These two modules are then integrated into a unified framework for pose regularity learning, which is referred to as Motion Prior Regularity Learner (MoPRL). MoPRL achieves competitive results on multiple challenging datasets while minimizing computational costs. Extensive experiments validate the versatility of the proposed modules and provide insights for future research.

While orthokeratology (OK) has shown effective to slow the progression of myopia, it remains unknown how spatially distributed structural stress/tension applying to different regions affects the change of corneal geometry, and consecutive the outcome of myopia control, at fine-grained detail. Acknowledging that the underlying working mechanism of OK lens is essentially mechanics induced refractive parameter reshaping, in this study, we develop a novel mechanics rule guided deep image-to-image learning framework, which densely predicts patient's corneal topography change according to treatment parameters (lens geometry, wearing time, physiological parameters, etc.), and consecutively predicts the influence on eye axial length change after OK treatment. Encapsulated in a U-shaped multi-resolution map-to-map architecture, the proposed model features two major components. First, geometric and wearing parameters of OK lens are spatially encoded with convolutions to form a multi-channel input volume/tensor for latent encodings of external stress/tension applied to different regions of cornea. Second, these external latent force maps are progressively down-sampled and injected into this multi-scale architecture for predicting the change of corneal topography map. At each feature learning layer, we formally derive a mathematic framework that simulates the physical process of corneal deformation induced by lens-to-cornea interaction and corneal internal tension, which is reformulated into parameter learnable cross-attention/self-attention modules in the context of transformer architecture. A total of 1854 eyes of myopia patients are included in the study and the results show that the proposed model precisely predicts corneal topography change with a high PSNR as 28.45dB, as well as a significant accuracy gain for axial elongation prediction (i.e., 0.0276 in MSE). It is also demonstrated that our method provides interpretable associations between various OK treatment parameters and the final control effect. Our project code package is available at https://github.com/Rongdingyi/PhyIntNet.