EDBT 2026 Demo / reviewers in the wild / expert
Junyu Luo 0002
dblp:198/0850-2
· DBLP profile ↗
29ranked-venue papers
10as first author
27since 2021 · last 2026
0009-0001-6894-1144ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 22 · 7 first-author · 21 since 2021Graphics, computer vision, multimedia, augmented reality and games · 10 · 3 first-author · 9 since 2021Databases, data management, data science and information retrieval · 7 · 3 first-author · 7 since 2021Systems, architecture and hardware · 1Applied, interdisciplinary, general and emerging computing · 1 · 1 first-author · 1 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | CogniTrust: Cognitive Memory-Driven Verifiable Supervision for Robust HashingabstractIn this paper, we study the problem of robust multi-label hashing, where label noise hinders the learning of a reliable semantic structure from data. Many existing methods rely on heuristic sample selection or consistency-based training, but lack a unified mechanism to validate and refine supervision across structural and semantic levels. Inspired by cognitive theories of human memory, we propose a novel framework called CogniTrust that unifies verifiable supervision with a triadic memory model: a) In episodic memory, feature activations are decomposed into spatial patterns that support the assessment of structural evidence and the estimation of label reliability; b) Semantic memory keeps track of class-level prototypes from structurally attentive regions to estimate the semantic plausibility of labels; c) Reconstructive memory simulates memory recall through interpolation between images using a diffusion-based mixup process, which enriches the training signals for semantically uncertain regions. These components work together, allowing supervision to be refined through the joint consideration of spatial structure and semantic information. Extensive experiments on noisy hashing benchmarks demonstrate that CogniTrust consistently outperforms a range of state-of-the-art baselines. Our results show that cognitive memory mechanisms offer a principled basis for more reliable label denoising and robust hashing. Yiyang Gu, Bohan Wu, Yifang Qin, Jiaru Tang, Rongcheng Tu, Zhiping Xiao 0001, Taian Guo, Junyu Luo 0002, Wei Ju 0001, Xiao Luo 0001, Dacheng Tao, Ming Zhang 0004 |
AAAI | 8 |
| 2026 | BAMAS: Structuring Budget-Aware Multi-Agent SystemsabstractLarge language model (LLM)-based multi-agent systems have emerged as a powerful paradigm for enabling autonomous agents to solve complex tasks. As these systems scale in complexity, cost becomes an important consideration for practical deployment. However, existing work rarely addresses how to structure multi-agent systems under explicit budget constraints. In this paper, we propose BAMAS, a novel approach for building multi-agent systems with budget awareness. BAMAS first selects an optimal set of LLMs by formulating and solving an Integer Linear Programming problem that balances performance and cost. It then determines how these LLMs should collaborate by leveraging a reinforcement learning-based method to select the interaction topology. Finally, the system is instantiated and executed based on the selected agents and their collaboration topology. We evaluate BAMAS on three representative tasks and compare it with state-of-the-art agent construction methods. Results show that BAMAS achieves comparable performance while reducing cost by up to 86%. Junyu Luo 0002, Xuanzhe Liu, Yiling Lou, Zhenpeng Chen 0001 |
AAAI | 2 |
| 2026 | SciCustom: A Framework for Custom Evaluation of Scientific Capabilities in Large Language ModelsabstractYiyang Gu, Junwei Yang, Junyu Luo, Ye Yuan, Bin Feng, Yingce Xia, Shufang Xie, Kaili Liu, Bohan Wu, Qi Shi, Haoran Li, Beier Xiao, Zhiping Xiao, Xiao Luo, Weizhi Zhang, Philip S. Yu, Zequn Liu, Ming Zhang. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026. Yiyang Gu, Junyu Luo 0002, Ye Yuan 0016, Yingce Xia, Shufang Xie 0003, Kaili Liu, Bohan Wu, Haoran Li 0003, Beier Xiao, Zhiping Xiao 0001, Xiao Luo 0001, Weizhi Zhang 0001, Philip S. Yu, Zequn Liu, Ming Zhang 0004 |
ACL (1) | 3 |
| 2026 | A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and SolutionsabstractZhiyin Yu, Yuchen Mou, Juncheng Yan, Junyu Luo, Chunchun Chen, Xing Wei, Yunhui Liu, Hongru Sun, Yuxing Zhang, Jun Xu, Yatao Bian, Ming Zhang, Wei Ye, Tieke He, Jie Yang, Guanjie Zheng, Zhonghai Wu, Bo Zhang, Lei Bai, Xiao Luo. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026. Zhiyin Yu, Yuchen Mou, Juncheng Yan, Junyu Luo 0002, Chunchun Chen, Yunhui Liu 0002, Hongru Sun, Yatao Bian, Ming Zhang 0004, Tieke He, Jie Yang 0009, Guanjie Zheng, Zhonghai Wu, Bo Zhang 0069, Lei Bai 0020, Xiao Luo 0001 |
ACL (1) | 4 |
| 2026 | DisCo: Diffusion-guided Unbiased Discriminative Learning for Unsupervised Graph Domain AdaptationabstractThis paper investigates the task of unsupervised graph domain adaptation, which facilitates the transfer of knowledge from labeled source graphs to unlabeled target graphs. Recent approaches usually utilize graph contrastive learning and pseudo-labeling to learn from unlabeled target data, which could introduce potential biased representations and supervision of target graphs resulting from serious shifts across two domains. Towards this end, we propose a novel framework named Diffusion-guided Unbiased Discriminative Learning (DisCo) for unsupervised graph domain adaptation. The core of our DisCo is to leverage both feature disentanglement and cross-domain diffusion signals to remove the potential biases for target graphs. In particular, we first utilize adversarial feature disentanglement to extract causal features that are orthogonal to domain biases. More importantly, we retrieve the labels of cross-domain source graphs to generate the conditions, which would be utilized to optimize a diffusion model for label denoising. The consistency between pseudo-labels and denoised labels is measured to reduce the potential biases during domain alignment. Extensive experiments on several real-world benchmarks demonstrate that our proposed DisCo consistently outperforms competing state-of-the-art baselines. Tao Ren 0002, Changhu Wang, Yifan Wang 0014, Wei Ju 0001, Huaizhi Tang, Junyu Luo 0002, Zimo Wang, Ziyue Qiao, Xian-Sheng Hua 0001, Xiao Luo 0001 |
KDD (1) | 7 |
| 2026 | Space-based Parameter Evolving with Lightweight Optimization for Graph Adaptation to Evolving Shifts
Junyu Luo 0002, Zixuan Ouyang, Xiao Luo 0001, Hourun Li, Zhiping Xiao 0001, Yifan Wang 0014, Ming Zhang 0004 |
WWW | 1 |
| 2026 | SPOT: Spectral Optimal Transport for Graph Domain GeneralizationabstractGraph neural networks (GNNs) have essentially taken over as the de facto model for learning graph-structured data. However, the majority of existing methods perform transductive learning in a known graph, which is unable to tackle abundant in-the-wild unseen graphs with potential domain shifts. Even worse, these graphs, accompanied by domain shifts on structural topology and node attributes, bring in vulnerable data bias and thus a huge drop in performance. To tackle this, we propose a novel GNN method named spectral optimal transport (SPOT) for effective domain generalization on graphs. Our method is motivated by the fact that the high-frequency graph spectrum is more likely to indicate domain differences. In particular, we formulate the structural augmentation as an optimal transport problem to retain low-frequency key knowledge and solve the problem using Sinkhorn-Knopp algorithm. In addition, we incorporate an adaptive perturbation strategy to deep features, where the direction of the additive noise is determined by the homophily degrees to maintain semantic properties. Accordingly, we meticulously construct a collection of real-world benchmark datasets to assess the domain generalization capability of our model on graphs, and extensive experiments confirm the effectiveness of our proposed SPOT. Yusheng Zhao, Xiao Luo 0001, Junyu Luo 0002, Wei Ju 0001, Zhonghui Gu, Zhiping Xiao 0001, Xian-Sheng Hua 0001, Ming Zhang 0004 |
ACM Trans. Knowl. Discov. Data | 3 |
| 2026 | Robust Cross Supervision With Target Mining for Source-Free Graph Domain AdaptationabstractGraph domain adaptation has emerged as a critical challenge in real-world applications, where labeled graph data is often scarce and expensive to obtain. While existing methods have shown promise, they typically require access to source domain data, which may be restricted due to privacy concerns or data regulations. To address these limitations, we investigate the challenging yet practical problem of source-free graph domain adaptation. We propose a new approach namedRobust CrossSupervision with Target Mining (ROSE) for this problem. ROSE achieves robustness by considering the complementary topology of graphs. The model consists of a message-passing branch for local semantic learning and a graph-kernel branch for global structural capture. Both branches are incorporated into a unified cross-supervision framework. To improve the robustness of the optimization process, we explore the context of the target domain, and divide the target data into discriminant set and anchor set. Then we incorporate the two tasks into a meta-learning optimization framework. Extensive experiments on benchmark datasets have demonstrated that our ROSE, compared with a wide range of baselines, always yields superior performance. The source code is available athttps://github.com/luo-junyu/ROSE. Junyu Luo 0002, Haoyu Tao, Xiao Luo 0001, Yusheng Zhao, Zhiping Xiao 0001, Dailan He, Wei Ju 0001, Chong Chen 0002, Xian-Sheng Hua 0001, Ming Zhang 0004 |
IEEE Trans. Knowl. Data Eng. | 1 |
| 2025 | Attention Bootstrapping for Multi-Modal Test-Time AdaptationabstractTest-time adaptation aims to adapt a well-trained model to potential distribution shifts at test time using only unlabeled test data, without access to the original training data. While previous efforts mainly focus on a single modality, test-time distribution shift in the multi-modal setting is more complex and calls for new solutions. This paper tackles the problem of multi-modal test-time adaptation by proposing a novel method named Attention Bootstrapping with Principal Entropy Minimization (ABPEM). We observe that test-time distribution shift causes misalignment across modalities, leading to a large gap between intra-modality discrepancies (measured by self-attention) and inter-modality discrepancies (measured by cross-attention). We name this the attention gap. This attention gap widens with more severe distribution shifts, hindering effective modality fusion. To mitigate this attention gap and encourage better modality fusion, we propose attention bootstrapping that promotes cross-attention with the guidance of self-attention. Moreover, to reduce the gradient noise in the commonly-used entropy minimization, we adopt principal entropy minimization, a refinement of entropy minimization that reduces gradient noise by focusing on the principal parts of entropy, excluding less reliable gradient information. Extensive experiments on the benchmarks validate the effectiveness of the proposed ABPEM in comparison with competing baselines. Yusheng Zhao, Junyu Luo 0002, Xiao Luo 0001, Jinsheng Huang, Jingyang Yuan, Zhiping Xiao 0001, Ming Zhang 0004 |
AAAI | 2 |
| 2025 | TRACI: A Data-centric Approach for Multi-Domain Generalization on GraphsabstractGraph neural networks (GNNs) have gained superior performance in graph-based prediction tasks with a variety of applications such as social analysis and drug discovery. Despite the remarkable progress, their performance often degrades on test graphs with distribution shifts. Existing domain adaptation methods rely on unlabeled test graphs during optimization, limiting their applicability to graphs in the wild. Towards this end, this paper studies the problem of multi-domain generalization on graphs, which utilizes multiple source graphs to learn a GNN with high performance on unseen target graphs. We propose a new approach named Topological Adversarial Learning with Prototypical Mixup (TRACI) to solve the problem. The fundamental principle behind our TRACI is to produce virtual adversarial and mixed graph samples from a data-centric view. In particular, TRACI enhances GNN generalization by employing a gradient-ascent strategy that considers both label prediction entropy and graph topology to craft challenging adversarial samples. Additionally, it generates domain-agnostic node representations by characterizing class-graph pair prototypes through latent distributions and applying multi-sample prototypical Mixup for distribution alignment across graphs. We further provide theoretical analysis showing that TRACI reduces the model's excess risk. Extensive experiments on various benchmark datasets demonstrate that TRACI outperforms state-of-the-art baselines, validating its effectiveness. Yusheng Zhao, Changhu Wang, Xiao Luo 0001, Junyu Luo 0002, Wei Ju 0001, Zhiping Xiao 0001, Ming Zhang 0004 |
AAAI | 4 |
| 2025 | FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning EvaluationabstractJunyu Luo, Zhizhuo Kou, Liming Yang, Xiao Luo, Jinsheng Huang, Zhiping Xiao, Jingshu Peng, Chengzhong Liu, Jiaming Ji, Xuanzhe Liu, Sirui Han, Ming Zhang, Yike Guo. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025. Junyu Luo 0002, Zhizhuo Kou, Xiao Luo 0001, Jinsheng Huang, Zhiping Xiao 0001, Jingshu Peng, Chengzhong Liu, Jiaming Ji, Xuanzhe Liu, Sirui Han, Ming Zhang 0004, Yike Guo |
ACL (1) | 1 |
| 2025 | A Survey on Efficient Large Language Model Training: From Data-centric PerspectivesabstractJunyu Luo, Bohan Wu, Xiao Luo, Zhiping Xiao, Yiqiao Jin, Rong-Cheng Tu, Nan Yin, Yifan Wang, Jingyang Yuan, Wei Ju, Ming Zhang. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025. Junyu Luo 0002, Bohan Wu, Xiao Luo 0001, Zhiping Xiao 0001, Yiqiao Jin, Rongcheng Tu, Yifan Wang 0014, Jingyang Yuan, Wei Ju 0001, Ming Zhang 0004 |
ACL (1) | 1 |
| 2025 | Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse AttentionabstractJingyang Yuan, Huazuo Gao, Damai Dai, Junyu Luo, Liang Zhao, Zhengyan Zhang, Zhenda Xie, Yuxing Wei, Lean Wang, Zhiping Xiao, Yuqing Wang, Chong Ruan, Ming Zhang, Wenfeng Liang, Wangding Zeng. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025. Jingyang Yuan, Huazuo Gao, Damai Dai, Junyu Luo 0002, Liang Zhao 0026, Zhengyan Zhang, Zhenda Xie, Lean Wang, Zhiping Xiao 0001, Chong Ruan, Ming Zhang 0004, Wenfeng Liang, Wangding Zeng |
ACL (1) | 4 |
| 2025 | Sparse Causal Discovery with Generative Intervention for Unsupervised Graph Domain AdaptationabstractUnsupervised Graph Domain Adaptation (UGDA) leverages labeled source domain graphs to achieve effective performance in unlabeled target domains despite distribution shifts. However, existing methods often yield suboptimal results due to the entanglement of causal-spurious features and the failure of global alignment strategies. We propose SLOGAN (Sparse Causal Discovery with Generative Intervention), a novel approach that achieves stable graph representation transfer through sparse causal modeling and dynamic intervention mechanisms. Specifically, SLOGAN first constructs a sparse causal graph structure, leveraging mutual information bottleneck constraints to disentangle sparse, stable causal features while compressing domain-dependent spurious correlations through variational inference. To address residual spurious correlations, we innovatively design a generative intervention mechanism that breaks local spurious couplings through cross-domain feature recombination while maintaining causal feature semantic consistency via covariance constraints. Furthermore, to mitigate error accumulation in target domain pseudo-labels, we introduce a category-adaptive dynamic calibration strategy, ensuring stable discriminative learning. Extensive experiments on multiple real-world datasets demonstrate that SLOGAN significantly outperforms existing baselines. Junyu Luo 0002, Yuhao Tang, Yiwei Fu, Xiao Luo 0001, Zhizhuo Kou, Zhiping Xiao 0001, Wei Ju 0001, Wentao Zhang 0001, Ming Zhang 0004 |
ICML | 1 |
| 2025 | Test-time Adaptation on Graphs via Adaptive Subgraph-based Selection and Regularized PrototypesabstractTest-time adaptation aims to adapt a well-trained model using test data only, without accessing training data. It is a crucial topic in machine learning, enabling a wide range of applications in the real world, especially when it comes to data privacy. While existing works on test-time adaptation primarily focus on Euclidean data, research on non-Euclidean graph data remains scarce. Prevalent graph neural network methods could encounter serious performance degradation in the face of test-time domain shifts. In this work, we propose a novel method named Adaptive Subgraph-based Selection and Regularized Prototype Supervision (ASSESS) for reliable test-time adaptation on graphs. Specifically, to achieve flexible selection of reliable test graphs, ASSESS adopts an adaptive selection strategy based on fine-grained individual-level subgraph mutual information. Moreover, to utilize the information from both training and test graphs, ASSESS constructs semantic prototypes from the well-trained model as prior knowledge from the unknown training graphs and optimizes the posterior given the unlabeled test graphs. We also provide a theoretical analysis of the proposed algorithm. Extensive experiments verify the effectiveness of ASSESS against various baselines. Yusheng Zhao, Xiao Luo 0001, Junyu Luo 0002, Wei Ju 0001, Zhiping Xiao 0001, Ming Zhang 0004 |
ICML | 4 |
| 2025 | Future Matters for Present: Towards Effective Physical Simulation over MeshesabstractThis paper investigates the problem of learning mesh-based physical simulations, which is a crucial task with applications in fluid mechanics and aerodynamics. Recent works typically utilize graph neural networks (GNNs) to produce next-time states on irregular meshes by modeling interacting dynamics, and then adopt iterative rollouts for the whole trajectories. However, these methods cannot achieve satisfactory performance in long-term predictions due to the failure of capturing long-term dependency and potential error accumulations. To tackle this, we introduce a new future-to-present learning perspective, and further develop a simple yet effective approach named Foresight And Interpolation (FAIR) for long-term mesh-based simulations. The main idea of our FAIR is to first learn a graph ODE model for coarse long-term predictions and then refine short-term predictions via interpolation. Specifically, FAIR employs a continuous graph ODE model that incorporates past states into the evolution of interacting node representations, which is capable of learning coarse long-term trajectories under a multi-task learning framework. Then, we leverage a channel aggregation strategy to summarize the trajectories for refined short-term predictions, which can be illustrated using an interpolation process. Through pyramid-like alternative propagation between the foresight step and refinement step, our proposed framework FAIR can generate accurate long-term trajectories, achieving a significant error reduction compared with the best baseline on four benchmark datasets. Extensive ablation studies and visualization further validate the superiority of our proposed FAIR. Xiao Luo 0001, Junyu Luo 0002, Huiyu Jiang, Hang Zhou 0008, Zhiping Xiao 0001, Wei Ju 0001, Carl Yang 0001, Ming Zhang 0004, Yizhou Sun |
KDD (1) | 2 |
| 2025 | Dual Prototype-Enhanced Contrastive Framework for Class-Imbalanced Graph Domain AdaptationabstractGraph transfer learning, especially in unsupervised domain adaptation, aims to transfer knowledge from a label-abundant source graph to an unlabeled target graph. However, most existing approaches overlook the common issue of label imbalance in the source domain, typically assuming a balanced label distribution that rarely holds in practice. Moreover, they face challenges arising from biased knowledge in the source graph and substantial domain distribution shifts. To remedy the above challenges, we propose a dual-branch prototype-enhanced contrastive framework for class-imbalanced graph domain adaptation in this paper. Specifically, we introduce a dual-branch graph encoder to capture both local and global information, generating class-specific prototypes from a distilled anchor set. Then, a prototype-enhanced contrastive learning framework is introduced. On the one hand, we encourage class alignment between the two branches based on constructed prototypes to alleviate the bias introduced by class imbalance. On the other hand, we infer the pseudo-labels for the target domain and align sample pairs across domains that share similar semantics to reduce domain discrepancies. Experimental results show that our ImGDA outperforms the state-of-the-art methods across multiple datasets and settings. The code is available at: https://github.com/maxin88scu/ImGDA. Yifan Wang 0014, Siyu Yi, Wei Ju 0001, Junyu Luo 0002, Yusheng Zhao, Xiao Luo 0001, Jiancheng Lv 0001 |
NeurIPS | 5 |
| 2025 | MATE: Masked optimal transport with dynamic selection for partial label graph learning
Yiyang Gu, Binqi Chen, Ziyue Qiao, Xiao Luo 0001, Junyu Luo 0002, Zhiping Xiao 0001, Wei Ju 0001, Ming Zhang 0004 |
Artif. Intell. | 6 |
| 2025 | Cross-Domain Diffusion With Progressive Alignment for Efficient Adaptive RetrievalabstractUnsupervised efficient domain adaptive retrieval aims to transfer knowledge from a labeled source domain to an unlabeled target domain, while maintaining low storage cost and high retrieval efficiency. However, existing methods typically fail to address potential noise in the target domain, and directly align high-level features across domains, thus resulting in suboptimal retrieval performance. To address these challenges, we propose a novel Cross-Domain Diffusion with Progressive Alignment method (COUPLE). This approach revisits unsupervised efficient domain adaptive retrieval from a graph diffusion perspective, simulating cross-domain adaptation dynamics to achieve a stable target domain adaptation process. First, we construct a cross-domain relationship graph and leverage noise-robust graph flow diffusion to simulate the transfer dynamics from the source domain to the target domain, identifying lower noise clusters. We then leverage the graph diffusion results for discriminative hash code learning, effectively learning from the target domain while reducing the negative impact of noise. Furthermore, we employ a hierarchical Mixup operation for progressive domain alignment, which is performed along the cross-domain random walk paths. Utilizing target domain discriminative hash learning and progressive domain alignment, COUPLE enables effective domain adaptive hash learning. Extensive experiments demonstrate COUPLE's effectiveness on competitive benchmarks. Junyu Luo 0002, Yusheng Zhao, Xiao Luo 0001, Zhiping Xiao 0001, Wei Ju 0001, Li Shen 0008, Dacheng Tao, Ming Zhang 0004 |
IEEE Trans. Image Process. | 1 |
| 2024 | Multi- View Teacher with Curriculum Data Fusion for Robust Unsupervised Domain AdaptationabstractGraph Neural Networks (GNNs) have emerged as an effective tool for graph classification, yet their reliance on extensive labeled data poses a significant challenge, especially when such labels are scarce. To address this challenge, this paper presents a novel framework, denoted as Multi-View Teacher with Curriculum Data Fusion (MTDF). MTDF achieves robust unsupervised domain adaptation in both the model and data perspectives. On the one hand, MTDF utilizes a multi-teacher framework with diverse update strategies for robust adaptation. Moreover, it employs a complementary perspective consistency model from local implicit representation and global explicit graph structure. On the other hand, MTDF generates source-mimicry data at the target domain to serve as a bridge to overcome the challenge of domain shift. MTDF achieves stable unsupervised domain adaptation through bi-directional processes from the perspective of both the model and the data. We have conducted comprehensive experimental evaluations across multiple real-world datasets with a range of baseline methods to demonstrate the superior performance of our proposed method. Yuhao Tang, Junyu Luo 0002, Ling Yang 0006, Xiao Luo 0001, Wentao Zhang 0001, Bin Cui 0001 |
ICDE | 2 |
| 2024 | Rank and Align: Towards Effective Source-free Graph Domain Adaptation
Junyu Luo 0002, Zhiping Xiao 0001, Yifan Wang 0014, Xiao Luo 0001, Jingyang Yuan, Wei Ju 0001, Langechuan Liu, Ming Zhang 0004 |
IJCAI | 1 |
| 2024 | A Survey of Data-Efficient Graph Learning
Wei Ju 0001, Siyu Yi, Yifan Wang 0014, Qingqing Long, Junyu Luo 0002, Zhiping Xiao 0001, Ming Zhang 0004 |
IJCAI | 5 |
| 2024 | EGODE: An Event-attended Graph ODE Framework for Modeling Rigid DynamicsabstractThis paper studies the problem of rigid dynamics modeling, which has a wide range of applications in robotics, graphics, and mechanical design. The problem is partly solved by graph neural network (GNN) simulators. However, these approaches cannot effectively handle the relationship between intrinsic continuity and instantaneous changes in rigid dynamics. Moreover, they usually neglect hierarchical structures across mesh nodes and objects in systems. In this paper, we propose a novel approach named Event-attend Graph ODE (EGODE) for effective rigid dynamics modeling. In particular, we describe the rigid system using both mesh node representations and object representations. To model continuous dynamics across hierarchical structures, we use a coupled graph ODE framework for the evolution of both types of representations over a long period. In addition, to capture instantaneous changes during the collision, we introduce an event module, which can effectively estimate the occurrence of the collision and update the states of both mesh node and object representations during evolution. Extensive experiments on a range of benchmark datasets validate the superiority of the proposed EGODE compared to various state-of-the-art baselines. The source code can be found at https://github.com/yuanjypku/EGODE. Jingyang Yuan, Gongbo Sun, Zhiping Xiao 0001, Hang Zhou 0008, Xiao Luo 0001, Junyu Luo 0002, Yusheng Zhao, Wei Ju 0001, Ming Zhang 0004 |
NeurIPS | 6 |
| 2024 | GALA: Graph Diffusion-Based Alignment With Jigsaw for Source-Free Domain AdaptationabstractSource-free domain adaptation is a crucial machine learning topic, as it contains numerous applications in the real world, particularly with respect to data privacy. Existing approaches predominantly focus on Euclidean data, such as images and videos, while the exploration of non-Euclidean graph data remains scarce. Recent graph neural network (GNN) approaches could suffer from serious performance decline due to domain shift and label scarcity in source-free adaptation scenarios. In this study, we propose a novel method named Graph Diffusion-based Alignment with Jigsaw (GALA) tailored for source-free graph domain adaptation. To achieve domain alignment, GALA employs a graph diffusion model to reconstruct source-style graphs from target data. Specifically, a score-based graph diffusion model is trained using source graphs to learn the generative source styles. Then, we introduce perturbations to target graphs via a stochastic differential equation instead of sampling from a prior, followed by the reverse process to reconstruct source-style graphs. We feed them into an off-the-shelf GNN and introduce class-specific thresholds with curriculum learning, which can generate accurate and unbiased pseudo-labels for target graphs. Moreover, we develop a simple yet effective graph mixing strategy named graph jigsaw to combine confident graphs and unconfident graphs, which can enhance generalization capabilities and robustness via consistency learning. Extensive experiments on benchmark datasets validate the effectiveness of GALA. The source code is available at https://github.com/luo-junyu/GALA. Junyu Luo 0002, Yiyang Gu, Xiao Luo 0001, Wei Ju 0001, Zhiping Xiao 0001, Yusheng Zhao, Jingyang Yuan, Ming Zhang 0004 |
IEEE Trans. Pattern Anal. Mach. Intell. | 1 |
| 2022 | 3D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selectionabstract3D visual grounding aims to locate the referred target object in 3D point cloud scenes according to a free-form language description. Previous methods mostly follow a two-stage paradigm, i.e., language-irrelevant detection and cross-modal matching, which is limited by the isolated architecture. In such a paradigm, the detector needs to sample keypoints from raw point clouds due to the inherent properties of 3D point clouds (irregular and large-scale), to generate the corresponding object proposal for each keypoint. However, sparse proposals may leave out the target in detection, while dense proposals may confuse the matching model. Moreover, the language-irrelevant detection stage can only sample a small proportion of keypoints on the target, deteriorating the target prediction. In this paper, we propose a 3D Single-Stage Referred Point Progressive Selection (3D-SPS) method, which progressively selects keypoints with the guidance of language and directly locates the target. Specifically, we propose a Description-aware Keypoint Sampling (DKS) module to coarsely focus on the points of language-relevant objects, which are significant clues for grounding. Besides, we devise a Target-oriented Progressive Mining (TPM) module to finely concentrate on the points of the target, which is enabled by progressive intra-modal relation modeling and inter-modal target mining. 3D-SPS bridges the gap between detection and matching in the 3D visual grounding task, localizing the target at a single stage. Experiments demonstrate that 3D-SPS achieves state-of-the-art performance on both ScanRe-fer and Nr3D/Sr3D datasets. Junyu Luo 0002, Jiahui Fu 0003, Xianghao Kong, Chen Gao 0005, Haibing Ren, Huaxia Xia, Si Liu 0001 |
CVPR | 1 |
| 2021 | FedSkel: Efficient Federated Learning on Heterogeneous Systems with Skeleton Gradients UpdateabstractFederated learning aims to protect users' privacy while performing data analysis from different participants. However, it is challenging to guarantee the training efficiency on heterogeneous systems due to the various computational capabilities and communication bottlenecks. In this work, we propose FedSkel to enable computation-efficient and communication-efficient federated learning on edge devices by only updating the model's essential parts, named skeleton networks. FedSkel is evaluated on real edge devices with imbalanced datasets. Experimental results show that it could achieve up to 5.52x speedups for CONV layers' back-propagation, 1.82x speedups for the whole training process, and reduce 64.8% communication cost, with negligible accuracy loss. Junyu Luo 0002, Jianlei Yang 0001, Xucheng Ye, Xin Guo 0008, Weisheng Zhao 0001 |
CIKM | 1 |
| 2021 | TransRefer3D: Entity-and-Relation Aware Transformer for Fine-Grained 3D Visual GroundingabstractRecently proposed fine-grained 3D visual grounding is an essential and challenging task, whose goal is to identify the 3D object referred by a natural language sentence from other distractive objects of the same category. Existing works usually adopt dynamic graph networks to indirectly model the intra/inter-modal interactions, making the model difficult to distinguish the referred object from distractors due to the monolithic representations of visual and linguistic contents. In this work, we exploit Transformer for its natural suitability on permutation-invariant 3D point clouds data and propose a TransRefer3D network to extract entity-and-relation aware multimodal context among objects for more discriminative feature learning. Concretely, we devise an Entity-aware Attention (EA) module and a Relation-aware Attention (RA) module to conduct fine-grained cross-modal feature matching. Facilitated by co-attention operation, our EA module matches visual entity features with linguistic entity features while RA module matches pair-wise visual relation features with linguistic relation features, respectively. We further integrate EA and RA modules into an Entity-and-Relation aware Contextual Block (ERCB) and stack several ERCBs to form our TransRefer3D for hierarchical multimodal context modeling. Extensive experiments on both Nr3D and Sr3D datasets demonstrate that our proposed model significantly outperforms existing approaches by up to 10.6% and claims the new state-of-the-art performance. To the best of our knowledge, this is the first work investigating Transformer architecture for fine-grained 3D visual grounding task. Dailan He, Yusheng Zhao, Junyu Luo 0002, Tianrui Hui, Shaofei Huang 0001, Aixi Zhang, Si Liu 0001 |
ACM Multimedia | 3 |
| 2020 | SparseTrain: Exploiting Dataflow Sparsity for Efficient Convolutional Neural Networks TrainingabstractTraining Convolutional Neural Networks (CNNs) usually requires a large number of computational resources. In this paper, SparseTrain is proposed to accelerate CNN training by fully exploiting the sparsity. It mainly involves three levels of innovations: activation gradients pruning algorithm, sparse training dataflow, and accelerator architecture. By applying a stochastic pruning algorithm on each layer, the sparsity of back-propagation gradients can be increased dramatically without degrading training accuracy and convergence rate. Moreover, to utilize both natural sparsity (resulted from ReLU or Pooling layers) and artificial sparsity (brought by pruning algorithm), a sparse-aware architecture is proposed for training acceleration. This architecture supports forward and back-propagation of CNN by adopting 1-Dimensional convolution dataflow. We have built a cycle-accurate architecture simulator to evaluate the performance and efficiency based on the synthesized design with 14nm FinFET technologies. Evaluation results on AlexNet/ResNet show that SparseTrain could achieve about 2.7× speedup and 2.2× energy efficiency improvement on average compared with the original training process. Pengcheng Dai, Jianlei Yang 0001, Xucheng Ye, Xingzhou Cheng, Junyu Luo 0002, Linghao Song, Yiran Chen 0001, Weisheng Zhao 0001 |
DAC | 5 |
| 2020 | Accelerating CNN Training by Pruning Activation Gradients
Xucheng Ye, Pengcheng Dai, Junyu Luo 0002, Xin Guo 0008, Yingjie Qi, Jianlei Yang 0001, Yiran Chen 0001 |
ECCV (25) | 3 |