Jiacheng Wei

dblp:150/4290 · DBLP profile ↗
← Back
20ranked-venue papers
5as first author
17since 2021 · last 2026
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 14 · 2 first-author · 12 since 2021Graphics, computer vision, multimedia, augmented reality and games · 8 · 3 first-author · 7 since 2021Databases, data management, data science and information retrieval · 2 · 1 first-author · 2 since 2021Systems, architecture and hardware · 1 · 1 first-author · 1 since 2021Computer networks · 1 · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1
YearPublicationVenuePosition
2026 Adaptive Piecewise Distillation for Efficient LiDAR Data Generation
abstract
LiDAR data generation has emerged as a promising solution to the high cost and limited scalability of real-world LiDAR sensing. Recent diffusion and rectified flow models have demonstrated strong capabilities in synthesizing realistic 3D point clouds; however, their iterative sampling procedures result in significant inference overhead. To address this, we focus on efficient few-step LiDAR generation for both unconditional and multi-modal conditional settings. Specifically, we propose an adaptive piecewise distillation strategy tailored for rectified flow-based LiDAR generation models, where the teacher model’s flow trajectory is adaptively segmented into consecutive intervals, and the student is trained only at the start of each interval to directly predict the velocity toward its endpoint. By sequentially sampling at the start timestep of each interval, our method enables fast few-step generation. Moreover, instead of uniform partitioning, we introduce an adaptive timestep selection strategy that chooses interval boundaries with minimal initial error, thereby reducing the complexity of distillation. Experimental results show that our method achieves comparable or superior performance to state-of-the-art methods in both unconditional and multi-modal conditional LiDAR generation, using only four sampling steps.
Ruibo Li, Ze Yang 0002, Jiacheng Wei, Chunyan Miao, Guosheng Lin
AAAI4
2026 A simulation-to-reality transfer learning method based on Kolmogorov-Arnold network enhanced model for bearing fault diagnosis
Qibin Wang, Dinglong Zheng, Chenyi Lin, Jiacheng Wei, Jiaqi Ye
Adv. Eng. Informatics4
2025 CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images
abstract
Creating CAD digital twins from the physical world is crucial for manufacturing, design, and simulation. However, current methods typically rely on costly 3D scanning with labor-intensive post-processing. To provide a user-friendly design process, we explore the problem of reverse engineering from unconstrained real-world CAD images that can be easily captured by users of all experiences. However, the scarcity of real-world CAD data poses challenges in directly training such models. To tackle these challenges, we propose CADCrafter, an image-to-parametric CAD model generation framework that trains solely on synthetic textureless CAD data while testing on real-world images. To bridge the significant representation disparity between images and parametric CAD models, we introduce a geometry encoder to accurately capture diverse geometric features. Moreover, the texture-invariant properties of the geometric features can also facilitate the generalization to real-world scenarios. Since compiling CAD parameter sequences into explicit CAD models is a non-differentiable process, the network training inherently lacks explicit geometric supervision. To impose geometric validity constraints, we employ direct preference optimization (DPO) to fine-tune our model with the automatic code checker feedback on CAD sequence quality. Furthermore, we collected a real-world dataset, comprised of multi-view images and corresponding CAD command sequence pairs, to evaluate our method. Experimental results demonstrate that our approach can robustly handle real unconstrained CAD images, and even generalize to unseen general objects.
Jiacheng Wei, Tianrun Chen, Chi Zhang 0007, Shangzhan Zhang, Bingchen Yang, Chuan-Sheng Foo, Guosheng Lin, Qixing Huang, Fayao Liu
CVPR2
2025 Puppeteer: Rig and Animate Your 3D Models
abstract
Modern interactive applications increasingly demand dynamic 3D content, yet the transformation of static 3D models into animated assets constitutes a significant bottleneck in content creation pipelines. While recent advances in generative AI have revolutionized static 3D model creation, rigging and animation continue to depend heavily on expert intervention. We present \textbf{Puppeteer}, a comprehensive framework that addresses both automatic rigging and animation for diverse 3D objects. Our system first predicts plausible skeletal structures via an auto-regressive transformer that introduces a joint-based tokenization strategy for compact representation and a hierarchical ordering methodology with stochastic perturbation that enhances bidirectional learning capabilities. It then infers skinning weights via an attention-based architecture incorporating topology-aware joint attention that explicitly encodes inter-joint relationships based on skeletal graph distances. Finally, we complement these rigging advances with a differentiable optimization-based animation pipeline that generates stable, high-fidelity animations while being computationally more efficient than existing approaches. Extensive evaluations across multiple benchmarks demonstrate that our method significantly outperforms state-of-the-art techniques in both skeletal prediction accuracy and skinning quality. The system robustly processes diverse 3D content, ranging from professionally designed game assets to AI-generated shapes, producing temporally coherent animations that eliminate the jittering issues common in existing methods.
Chaoyue Song, Xiu Li 0001, Fan Yang 0103, Zhongcong Xu, Jiacheng Wei, Fayao Liu, Jiashi Feng, Guosheng Lin
NeurIPS5
2025 Domain knowledge guided pseudo-label generation framework for semi-supervised domain generalization fault diagnosis
Jiacheng Wei, Qibin Wang, Hongbo Ma
Adv. Eng. Informatics1
2025 MoDA: Modeling Deformable 3D Objects from Casual Videos
Chaoyue Song, Jiacheng Wei, Chuan-Sheng Foo, Fayao Liu, Guosheng Lin
Int. J. Comput. Vis.2
2025 Heterogeneous Federated Learning: Client-Side Collaborative Update Interdomain Generalization Method for Intelligent Fault Diagnosis
abstract
The federated fault diagnosis approach has achieved remarkable results in recent years, which enables multiple clients with similar mechanical devices to collaboratively construct global intelligent diagnostic models while protecting data privacy. However, in practice, the statistical heterogeneity of data collected from different clients, as well as the model heterogeneity due to local model personalization, pose great challenges to federated learning (FL). Meanwhile, using a central server as an information management center to build global models increases additional model parameters and the risk of data privacy leakage. To address these issues, this article proposes a heterogeneous FL framework based on peer-to-peer communication (P2PCHF) for rotating machinery fault diagnosis. To achieve heterogeneous client communication without relying on a central server, the sharing unlabeled dataset is utilized in the collaborative updating phase to achieve peer-to-peer communication between clients and to align instance dimensions and clustering dimensions between heterogeneous clients by constructing intercorrelation matrices to achieve feature-level and semantic-level knowledge exchange for better interdomain generalization capabilities. Joint knowledge distillation based on class labels and class relations is introduced in the local update phase to mitigate forgetting effect in the local update phase of private models and effectively balance multidomain category knowledge. It is verified in three cases that the proposed P2PCHF can effectively address model heterogeneity and data statistics heterogeneity among clients, and enable locally-privatized models to gain interdomain generalization capability. The code framework is available athttps://github.com/JC952/P2PCHF.
Hongbo Ma, Jiacheng Wei, Qibin Wang, Xianguang Kong, Jingli Du
IEEE Internet Things J.2
2025 From domain-invariant channel adaptation to prototype consistency learning: A novel framework for single domain generalization fault diagnosis
Qibin Wang, Chenyi Lin, Jiacheng Wei, Jialu Han
Knowl. Based Syst.4
2024 REACTO: Reconstructing Articulated Objects from a Single Video
abstract
In this paper, we address the challenge of reconstructing general articulated 3D objects from a single video. Existing works employing dynamic neural radiance fields have advanced the modeling of articulated objects like humans and animals from videos, but face challenges with piece-wise rigid general articulated objects due to limitations in their deformation models. To tackle this, we propose Quasi-Rigid Blend Skinning, a novel deformation model that enhances the rigidity of each part while maintaining flexible deformation of the joints. Our primary insight combines three distinct approaches: 1) an enhanced bone rigging system for improved component modeling, 2) the use of quasi-sparse skinning weights to boost part rigidity and reconstruction fidelity, and 3) the application of geodesic point assignment for precise motion and seamless deformation. Our method outperforms previous works in producing higher-fidelity 3D reconstructions of general articulated objects, as demonstrated on both real and synthetic datasets. Project page: https://chaoyuesong.github.io/REACTO.
Chaoyue Song, Jiacheng Wei, Chuan-Sheng Foo, Guosheng Lin, Fayao Liu
CVPR2
2024 QDL: Quantitative Dynamic Latency Model in Permissioned Blockchain System
abstract
Latency, as a critical attribute influencing scalability and consistency in blockchain systems, has attracted significant research attention. This paper addresses the issue of latency evaluation by presenting a novel framework. We thoroughly analyze the factors affecting latency in blockchain system, including concurrency, consistency, and contention. To accurately model the correlation between latency and the quantity of nodes in permissioned blockchain setup, we introduce the Latency Regression Loss (LRL) function. By utilizing Newton’s interpolation and least squares methods, we determine the hyperparameters. Subsequently, we devise the framework for the Quantitative Dynamic Latency (QDL) evaluation model, which accounts for both the growth rate and magnitude of latency. Utilizing the parameters derived from the LRL function facilitated the calculation of latency growth rate, allowing for a comprehensive evaluation of latency. Finally, we validated the accuracy of the LRL function through extensive experiments and simulated the adaptability of the QDL model in latency assessment.
Jiacheng Wei, Qingmei Wang
ISPA1
2024 Learning Temporal Variations for 4D Point Cloud Segmentation
Hanyu Shi 0002, Jiacheng Wei, Hao Wang 0094, Fayao Liu, Guosheng Lin
Int. J. Comput. Vis.2
2024 Dense Supervision Propagation for Weakly Supervised Semantic Segmentation on 3D Point Clouds
abstract
Semantic segmentation on 3D point clouds is an important task for 3D scene understanding. While dense labeling on 3D data is expensive and time-consuming, only a few works address weakly supervised semantic point cloud segmentation methods to relieve the labeling cost by learning from simpler and cheaper labels. Meanwhile, there are still huge performance gaps between existing weakly supervised methods and state-of-the-art fully supervised methods. In this paper, we propose Dense Supervision Propagation (DSP) to train a semantic point cloud segmentation network with only a small portion of points being labeled. We argue that we can better utilize the limited supervision information as we densely propagate the supervision signal from the labeled points to other points within and across the input samples. Specifically, we propose a cross-sample feature reallocating module to transfer similar features and therefore re-route the gradients across two samples with common classes and an intra-sample feature redistribution module to propagate supervision signals on unlabeled points across and within point cloud samples. We conduct extensive experiments on public datasets S3DIS and ScanNet. Our weakly supervised method with only 10% and 1% of labels can produce competitive results with the fully supervised counterpart.
Jiacheng Wei, Guosheng Lin, Kim-Hui Yap, Fayao Liu, Tzu-Yi Hung
IEEE Trans. Circuits Syst. Video Technol.1
2023 TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervision
abstract
In this paper, we investigate an open research task of generating controllable 3D textured shapes from the given textual descriptions. Previous works either require ground truth caption labeling or extensive optimization time. To resolve these issues, we present a novel framework, TAPS3D, to train a text-guided 3D shape generator with pseudo captions. Specifically, based on rendered 2D images, we retrieve relevant words from the CLIP vocabulary and construct pseudo captions using templates. Our constructed captions provide high-level semantic supervision for generated 3D shapes. Further, in order to produce fine-grained textures and increase geometry diversity, we propose to adopt low-level image regularization to enable fake-rendered images to align with the real ones. During the inference phase, our proposed model can generate 3D textured shapes from the given text without any additional optimization. We conduct extensive experiments to analyze each of our proposed components and show the efficacy of our framework in generating high-fidelity 3D textured and text-relevant shapes. Code is available at https://github.com/plusmultiply/TAPS3D
Jiacheng Wei, Hao Wang 0094, Jiashi Feng, Guosheng Lin, Kim-Hui Yap
CVPR1
2023 Collaborative Propagation on Multiple Instance Graphs for 3D Instance Segmentation with Single-point Supervision
abstract
Instance segmentation on 3D point clouds has been attracting increasing attention due to its wide applications, especially in scene understanding areas. However, most existing methods operate on fully annotated data while manually preparing ground-truth labels at point-level is very cumbersome and labor-intensive. To address this issue, we propose a novel weakly supervised method RWSeg that only requires labeling one object with one point. With these sparse weak labels, we introduce a unified framework with two branches to propagate semantic and instance information respectively to unknown regions using self-attention and a cross-graph random walk method. Specifically, we propose a Cross-graph Competing Random Walks (CRW) algorithm that encourages competition among different instance graphs to resolve ambiguities in closely placed objects, improving instance assignment accuracy. RWSeg generates high-quality instance-level pseudo labels. Experimental results on ScanNet-v2 and S3DIS datasets show that our approach achieves comparable performance with fully-supervised methods and outperforms previous weakly-supervised methods by a substantial margin.
Ruibo Li, Jiacheng Wei, Fayao Liu, Guosheng Lin
ICCV3
2023 Unsupervised 3D Pose Transfer With Cross Consistency and Dual Reconstruction
abstract
The goal of 3D pose transfer is to transfer the pose from the source mesh to the target mesh while preserving the identity information (e.g., face, body shape) of the target mesh. Deep learning-based methods improved the efficiency and performance of 3D pose transfer. However, most of them are trained under the supervision of the ground truth, whose availability is limited in real-world scenarios. In this work, we present X-DualNet, a simple yet effective approach that enables unsupervised 3D pose transfer. In X-DualNet, we introduce a generator G which contains correspondence learning and pose transfer modules to achieve 3D pose transfer. We learn the shape correspondence by solving an optimal transport problem without any key point annotations and generate high-quality meshes with our elastic instance normalization (ElaIN) in the pose transfer module. With G as the basic component, we propose a cross consistency learning scheme and a dual reconstruction objective to learn the pose transfer without supervision. Besides that, we also adopt an as-rigid-as-possible deformer in the training process to fine-tune the body shape of the generated results. Extensive experiments on human and animal data demonstrate that our framework can successfully achieve comparable performance as the state-of-the-art supervised approaches.
Chaoyue Song, Jiacheng Wei, Ruibo Li, Fayao Liu, Guosheng Lin
IEEE Trans. Pattern Anal. Mach. Intell.2
2022 Weakly Supervised Segmentation on Outdoor 4D point clouds with Temporal Matching and Spatial Graph Propagation
abstract
Existing point cloud segmentation methods require a large amount of annotated data, especially for the outdoor point cloud scene. Due to the complexity of the outdoor 3D scenes, manual annotations on the outdoor point cloud scene are time-consuming and expensive. In this paper, we study how to achieve scene understanding with limited annotated data. Treating 100 consecutive frames as a sequence, we divide the whole dataset into a series of sequences and annotate only 0.1% points in the first frame of each sequence to reduce the annotation requirements. This leads to a total annotation budget of 0.001%. We propose a novel temporal-spatial framework for effective weakly supervised learning to generate high-quality pseudo labels from these limited annotated data. Specifically, the frame-work contains two modules: an matching module in temporal dimension to propagate pseudo labels across different frames, and a graph propagation module in spatial dimension to propagate the information of pseudo labels to the entire point clouds in each frame. With only 0.001% annotations for training, experimental results on both SemanticKITTI and SemanticPOSS shows our weakly supervised two-stage framework is comparable to some existing fully supervised methods. We also evaluate our framework with 0.005% initial annotations on SemanticKITTI, and achieve a result close to fully supervised backbone model.
Hanyu Shi 0002, Jiacheng Wei, Ruibo Li, Fayao Liu, Guosheng Lin
CVPR2
2021 3D Pose Transfer with Correspondence Learning and Mesh Refinement
abstract
3D pose transfer is one of the most challenging 3D generation tasks. It aims to transfer the pose of a source mesh to a target mesh and keep the identity (e.g., body shape) of the target mesh. Some previous works require key point annotations to build reliable correspondence between the source and target meshes, while other methods do not consider any shape correspondence between sources and targets, which leads to limited generation quality. In this work, we propose a correspondence-refinement network to achieve the 3D pose transfer for both human and animal meshes. The correspondence between source and target meshes is first established by solving an optimal transport problem. Then, we warp the source mesh according to the dense correspondence and obtain a coarse warped mesh. The warped mesh will be better refined with our proposed Elastic Instance Normalization, which is a conditional normalization layer and can help to generate high-quality meshes. Extensive experimental results show that the proposed architecture can effectively transfer the poses from source to target meshes and produce better results with satisfied visual performance than state-of-the-art methods.
Chaoyue Song, Jiacheng Wei, Ruibo Li, Fayao Liu, Guosheng Lin
NeurIPS2
2020 Multi-Path Region Mining for Weakly Supervised 3D Semantic Segmentation on Point Clouds
abstract
Point clouds provide intrinsic geometric information and surface context for scene understanding. Existing methods for point cloud segmentation require a large amount of fully labeled data. Using advanced depth sensors, collection of large scale 3D dataset is no longer a cumbersome process. However, manually producing point-level label on the large scale dataset is time and labor-intensive. In this paper, we propose a weakly supervised approach to predict point-level results using weak labels on 3D point clouds. We introduce our multi-path region mining module to generate pseudo point-level labels from a classification network trained with weak labels. It mines the localization cues for each class from various aspects of the network feature using different attention modules. Then, we use the point-level pseudo label to train a point cloud segmentation network in a fully supervised manner. To the best of our knowledge, this is the first method that uses cloud-level weak labels on raw 3D space to train a point cloud semantic segmentation network. In our setting, the 3D weak labels only indicate the classes that appeared in our input sample. We discuss both scene- and subcloud-level weakly labels on raw 3D point cloud data and perform in-depth experiments on them. On ScanNet dataset, our result trained with subcloud-level labels is compatible with some fully supervised methods.
Jiacheng Wei, Guosheng Lin, Kim-Hui Yap, Tzu-Yi Hung, Lihua Xie 0001
CVPR1
2020 Further Exploring Convolutional Neural Networks' Potential for Land-Use Scene Classification
abstract
Recently, with the success of deep convolutional neural networks (CNNs), many end-to-end learning algorithms have yielded excellent results. However, in the field of land use and land cover (LULC), very deep CNNs cannot be driven with even tens of thousands of images. In contrast to transferring methods that only employ a model pretrained with an irrelevant data set (e.g., ImageNet) and directly inherit parameters without refining, we explore an approach for effectively driving a deep CNN with a small data capacity. We propose a novel concept called the best activation model (BAM) in the end-to-end process for LULC image classification. BAM theoretically represents the best activation status for end-to-end networks with a small data set, taking both the data-capacity limitation and target-scene specificity into full consideration. The proposed method overcomes the problem of under-fitting and has optimal scene specificity for LULC scenes. Our approach greatly improves the time efficiency and yields excellent performance compared with state-of-the-art methods, obtaining averages of 99.0%, 98.8%, and 96.1% on the UC Merced Land-Use, WHU-RS19 data sets, and the Google data set of SIRI_WHU, respectively.
Boyang Li 0007, Weihua Su, Ruihao Li 0001, Jiacheng Wei
IEEE Geosci. Remote. Sens. Lett.8
2018 Chaos Theory in Urban Traffic Flow: Is Crowd Sensed Data Driving the Macro-traffic Behavior to Oscillation or Equilibrium
abstract
Stability theory tells us that a dynamic system will eventually converge to its stable state, in which the system's overall energy is at its minimum. On the other hand, chaos theory states that small perturbations of the system are able to drive itself from previously-stable state to another state. This phenomenon has been observed in many fields like cosmetol- ogy, physics, biology and chemistry. Our research question is whether chaos theory also applies to the transportation domain. Specifically, when we are given imperfect or delayed crowd- sensed data, will we observe the cyclic/oscillatory transition between different traffic states? This paper aims at investigating this chaotic phenomenon (oscillatory traffic behavior in this paper) on urban transportation with imperfect or delayed crowd-sensed information and delivering recommendations for crowdsensing-based traffic applications to avoid the undesirable oscillations.
Huanghuang Liang, Lu Yang 0002, Jiacheng Wei, Hong Cheng 0002
Intelligent Vehicles Symposium3