VLDB 2026 Research / reviewers in the wild / expert
Yudong Zhang 0005
dblp:39/2699-5
· DBLP profile ↗
27ranked-venue papers
9as first author
27since 2021 · last 2025
0000-0003-4941-0214ORCID · conflict
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 13 · 4 first-author · 13 since 2021Databases, data management, data science and information retrieval · 10 · 3 first-author · 10 since 2021Graphics, computer vision, multimedia, augmented reality and games · 9 · 3 first-author · 9 since 2021Applied, interdisciplinary, general and emerging computing · 3 · 1 first-author · 3 since 2021Computer networks · 2 · 1 first-author · 2 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Drawing Informative Gradients from Sources: A One-stage Transfer Learning Framework for Cross-city Spatiotemporal ForecastingabstractSpatiotemporal forecasting (STF) is pivotal in urban computing, yet data scarcity in developing cities hampers robust model training. Addressing this, recent studies leverage transfer learning to migrate knowledge from data-rich (source) to data-poor (target) cities. This strategy, while effective, faces challenges as pre-trained models risk absorbing noise and harmful information due to data distribution disparities, potentially undermining the accuracy of forecasts for target cities. To address this issue, we propose a one-stage STF framework named Target-Skewed Joint Training (TSJT). Central to TSJT is a novel Target-Skewed Backward training strategy that selectively refines gradients from source city data, preserving only the elements that positively impact the target city. To further enhance the quality of these gradients, we have designed a Node Prompting Module (NPM). TSJT is crafted for seamless integration with existing STF models, endowing them with the capability to efficiently tackle challenges stemming from data scarcity. Experimental results on several real-world datasets from multiple cities substantiate the efficacy of TSJT in the realm of cross-city transfer learning. Yudong Zhang 0005, Xu Wang 0029, Zhaoyang Sun, Kai Wang 0036, Yang Wang 0015 |
AAAI | 1 |
| 2025 | Time-Space-Interlaced Spatiotemporal Graph Forecasting via Two-Stage Summarized AttentionabstractTypical spatiotemporal graph forecasting methods process graph-structured spatiotemporal data respectively from spatial and temporal perspectives with the idea of divide and conquer. Existing works are incapable of capturing long-term transdimensional correlations among different spatial points in different time planes, i.e., time-space-interlaced correlations. To tackle this issue, we propose a two-stage summarized attention network to establish transdimensional direct message passing routes between different data points in different time planes and spaces, thus enabling the extraction of time-space-interlaced long-term correlations. Specifically, a novel spatiotemporal embedding is proposed to implement time-space-interlaced learning by expanding orthogonal spatial and temporal dimensionalities into one-dimensionality, a series of temporal context fusion units are added to address the fluctuation dislocation insensitivity issue which is caused by time-space-dimension expansion, and an ingenious two-stage design can significantly reduce the computation complexity of such time-space-interlaced learning. Extensive experiments illustrate the superior performance of our proposed approach on real-world spatiotemporal datasets. Zhaoyang Sun, Yudong Zhang 0005, Kai Wang 0036, Binwu Wang, Yang Wang 0015, Xu Wang 0029 |
ICASSP | 2 |
| 2025 | Embedding Enhanced MLP Enables Simple and Extensible Spatiotemporal ForecastingabstractSpatiotemporal forecasting facilitates many real world intelligent systems. Combining graph learning with temporal models has recently become popular in spatiotemporal forecasting. Although graph convolution enhances the modeling of spatial correlations, it results in unsatisfactory efficiency and poor extensibility in existing models. Consequently, existing graph-learning-based methods struggle to handle emerging nodes and are difficult to deploy on large-scale datasets. In this paper, we argue that graph learning in spatiotemporal forecasting is to discriminate different nodes thus generating node-specific features. To achieve the same effect of graph learning, we propose to use node embeddings to learn node-specific features and introduce a simple yet well-performing Embedding Enhanced MLP (E2MLP) spatiotemporal forecasting model. A hierarchical MLP framework is proposed, where node embeddings are introduced in each procedure of the framework. E2MLP outperforms existing SOTA spatiotemporal forecasting models on five real-world widely-used datasets, and can be easily scaled to newly emerging nodes without any performance influence on existing nodes. The source codes are publicly available from https://github.com/Ziyan2019/E2MLP Yudong Zhang 0005, Pengkun Wang 0001, Xu Wang 0029, Yang Wang 0015 |
ICASSP | 2 |
| 2025 | DIFFODE: Neural ODE with Differentiable Hidden State for Irregular Time Series AnalysisabstractIrregular time series analysis is increasingly essential in data management due to the proliferation of complex data irregularly sampled by real-world systems. Traditional time series models, including RNN-based models and transformer variants, face significant challenges in generalizing to continuous-time paradigms, which are essential for capturing the ongoing dynamics of irregular time series. Neural Ordinary Differential Equations (NODEs) assume a continuous latent dynamic and provide an elegant framework for irregular time series analysis, yet they suffer from limitations like fragmented latent processes and the inability to fully exploit interdependencies among observations. To address these challenges, we propose a novel Differentiable hidden state enhanced neural ODE framework, termed DIFFODE, designed to effectively model irregular time series. Concretely, we introduce an attention-based differential hidden state that maps irregular observations into a continuous hidden state space, enabling the extraction of latent dynamics while preserving temporal continuity. Leveraging the theory of generalized inverses, DIFFODE innovatively derives ODEs to describe hidden state dynamics. Furthermore, we incorporate the Hoyer metric into our framework to enhance its capacity to capture subtle yet critical temporal shifts, significantly improving the accuracy of time series modeling. Extensive experiments on both synthetic and real-world datasets demonstrate the effectiveness of DIFFODE across three key tasks, including irregular time series classification, interpolation, and extrapolation. Yudong Zhang 0005, Xu Wang 0029, Zhengyang Zhou, Lei Bai 0001, Yang Wang 0015 |
ICDE | 1 |
| 2025 | COFlowNet: Conservative Constraints on Flows Enable High-Quality Candidate GenerationabstractGenerative flow networks (GFlowNets) have been considered as powerful tools for generating candidates with desired properties. Given that evaluating the property of candidates can be complex and time-consuming, existing GFlowNets train proxy models for efficient online evaluation. However, the performance of proxy models is heavily dependent on the amount of data and is of considerable uncertainty. Therefore, it is of great interest that how to develop an offline GFlowNet that does not rely on online evaluation. Under the offline setting, the limited data results in an insufficient exploration of state space. The insufficient exploration means that offline GFlowNets can hardly generate satisfying candidates out of the distribution of training data. Therefore, it is critical to restrict the offline model to act in the distribution of training data. The distinctive training goal of GFlownets poses a unique challenge for making such restrictions. Tackling the challenge, we propose Conservative Offline GFlowNet (COFlowNet) in this paper. We define unsupported flow, edges containing unseen states in training data. Models can learn extremely little knowledge about unsupported flow from training data. By constraining the model from exploring unsupported flows, we restrict COFlowNet to explore as optimal trajectories on the training set as possible, thus generating better candidates. In order to improve the diversity of candidates, we further introduce a quantile version of unsupported flow restriction. Experimental results on several widely-used datasets validate the effectiveness of COFlowNet in generating high-scored and diverse candidates. All implementations are available at https://github.com/yuxuan9982/COflownet. Yudong Zhang 0005, Xu Wang 0029, Zhaoyang Sun, Chen Zhang 0007, Pengkun Wang 0001, Yang Wang 0015 |
ICLR | 1 |
| 2025 | Time-Frequency Disentanglement Boosted Pre-Training: A Universal Spatio-Temporal Modeling FrameworkabstractCurrent spatio-temporal modeling techniques largely rely on the abundant data and the design of task-specific models. However, many cities lack well-established digital infrastructures, making data scarcity and the high cost of model development significant barriers to application deployment. Therefore, this work aims to enable spatio-temporal learning to cope with the problems of few-shot data modeling and model generalizability. To this end, we propose a Universal Spatio-Temporal Correlationship pre-training framework (USTC), for spatio-temporal modeling across different cities and tasks. To enhance the spatio-temporal representations during pre-training, we propose to decouple the time-frequency patterns within data, and leverage contrastive learning to maintain the time-frequency consistency. To further improve the adaptability to downstream tasks, we design a prompt generation module to mine personalized spatio-temporal patterns on the target city, which can be integrated with the learned common spatio-temporal representations to collaboratively serve downstream tasks. Extensive experiments conducted on real-world datasets demonstrate that USTC significantly outperforms the advanced baselines in forecasting, imputation, and extrapolation across cities. Yudong Zhang 0005, Zhaoyang Sun, Xu Wang 0029, Kai Wang 0036, Yang Wang 0015 |
IJCAI | 1 |
| 2025 | MobiMixer: A Multi-Scale Spatiotemporal Mixing Model for Mobile Traffic PredictionabstractUnderstanding mobile traffic data and predicting future trends are essential for wireless operators and service providers to allocate resources efficiently and manage energy effectively. Despite the strong performance of existing models, accurately forecasting mobile traffic remains a challenge due to limited spatial and temporal modeling capabilities and high computational complexity. This paper introduces MobiMixer, a lightweight and efficient multi-scale spatiotemporal mixing model. Its core concept is to integrate multi-scale information from both spatial and temporal dimensions to improve performance on mobile traffic data. We develop a hierarchical interaction module that incorporates super nodes to enable global high-level feature interactions among nodes with common patterns. Additionally, we employ a dynamic time warping strategy to decouple mobile traffic sequences into stable and seasonal components, which are then modeled at different scales using a multi-scale temporal mixing module. We conduct extensive experiments on mobile traffic datasets collected from four international cities. Compared with 21 state-of-the-art benchmark models, MobiMixer demonstrates highly competitive performance, achieving a maximum improvement of 48.49% on the Milan mobile dataset. The model achieves an improvement in training efficiency of up to 10.69 times and reduces memory usage by 33.01%. The source code is available athttps://github.com/PoorOtterBob/Submitted_Code. Jiaming Ma, Binwu Wang, Pengkun Wang 0001, Zhengyang Zhou, Yudong Zhang 0005, Xu Wang 0029, Yang Wang 0015 |
IEEE Trans. Mob. Comput. | 5 |
| 2024 | Towards Dynamic Spatial-Temporal Graph Learning: A Decoupled PerspectiveabstractWith the progress of urban transportation systems, a significant amount of high-quality traffic data is continuously collected through streaming manners, which has propelled the prosperity of the field of spatial-temporal graph prediction. In this paper, rather than solely focusing on designing powerful models for static graphs, we shift our focus to spatial-temporal graph prediction in the dynamic scenario, which involves a continuously expanding and evolving underlying graph. To address inherent challenges, a decoupled learning framework (DLF) is proposed in this paper, which consists of a spatial-temporal graph learning network (DSTG) with a specialized decoupling training strategy. Incorporating inductive biases of time-series structures, DSTG can interpret time dependencies into latent trend and seasonal terms. To enable prompt adaptation to the evolving distribution of the dynamic graph, our decoupling training strategy is devised to iteratively update these two types of patterns. Specifically, for learning seasonal patterns, we conduct thorough training for the model using a long time series (e.g., three months of data). To enhance the learning ability of the model, we also introduce the masked auto-encoding mechanism. During this period, we frequently update trend patterns to expand new information from dynamic graphs. Considering both effectiveness and efficiency, we develop a subnet sampling strategy to select a few representative nodes for fine-tuning the weights of the model. These sampled nodes cover unseen patterns and previously learned patterns. Experiments on dynamic spatial-temporal graph datasets further demonstrate the competitive performance, superior efficiency, and strong scalability of the proposed framework. Binwu Wang, Pengkun Wang 0001, Yudong Zhang 0005, Xu Wang 0029, Zhengyang Zhou, Lei Bai 0001, Yang Wang 0015 |
AAAI | 3 |
| 2024 | A Twist for Graph Classification: Optimizing Causal Information Flow in Graph Neural NetworksabstractGraph neural networks (GNNs) have achieved state-of-the-art results on many graph representation learning tasks by exploiting statistical correlations. However, numerous observations have shown that such correlations may not reflect the true causal mechanisms underlying the data and thus may hamper the ability of the model to generalize beyond the observed distribution. To address this problem, we propose an Information-based Causal Learning (ICL) framework that combines information theory and causality to analyze and improve graph representation learning to transform information relevance to causal dependence. Specifically, we first introduce a multi-objective mutual information optimization objective derived from information-theoretic analysis and causal learning principles to simultaneously extract invariant and interpretable causal information and reduce reliance on non-causal information in correlations. To optimize this multi-objective objective, we enable a causal disentanglement layer that effectively decouples the causal and non-causal information in the graph representations. Moreover, due to the intractability of mutual information estimation, we derive variational bounds that enable us to transform the above objective into a tractable loss function. To balance the multiple information objectives and avoid optimization conflicts, we leverage multi-objective gradient descent to achieve a stable and efficient transformation from informational correlation to causal dependency. Our approach provides important insights into modulating the information flow in GNNs to enhance their reliability and generalization. Extensive experiments demonstrate that our approach significantly improves the robustness and interpretability of GNNs across different distribution shifts. Visual analysis demonstrates how our method converts informative dependencies in representations into causal dependencies. Zhe Zhao 0008, Pengkun Wang 0001, Haibin Wen, Yudong Zhang 0005, Zhengyang Zhou, Yang Wang 0015 |
AAAI | 4 |
| 2024 | Gradient Reactivation Enhanced Causal Attention for Out-Of-Distribution Generalizable Graph ClassificationabstractSeeking for generalizable graph representations becomes hot spot in the area of graph learning. Recently, causality theory has been applied for extracting the causal relations between graph data and labels, which are generalizable under distribution shift and result in better OOD generalization. In this paper, for more accurately capturing causal representation of graph data, we propose a gradient reactivation enhanced causal subgraph extraction method. The proposed model utilizes attention mechanism to extract the causal features and attenuates the confounding effect of shortcut features. For ensuring stability of extracted causal features, we propose a novel gradient reactivation method to filter features with greater effect on making prediction. Extensively experimental result proves the effectiveness of the proposed model. Xu Wang 0029, Pengfei Gu, Yudong Zhang 0005, Binwu Wang, Pengkun Wang 0001, Yang Wang 0015 |
ICASSP | 3 |
| 2024 | Graph Networks Stand Strong: Enhancing Robustness via Stability ConstraintsabstractGraph neural networks (GNNs) have achieved great success in graph classification tasks across many domains. However, the varying quality of real-world graph data leads to stability and reliability issues for real-world applications of graph neural networks (GNNs). Improving the robustness of GNNs would help enhance the quality and safety of GNNs in real-world applications. Recently, there have been studies that incorporate insights from information theory, causal theory, etc. into graph classification tasks to improve robustness. However, these strategies rely on extensive task-specific designs that increase model complexity and limit the scope of the methods. In this work, we leverage the interdependence between model stability and robustness by introducing stability constraints to graph neural network models through two different consistency regularization methods. To balance the trade-off between stability constraints and classification performance, we adaptively adjust the strength of the constraints dynamically using multi-objective optimization, making our method applicable to graph classification tasks of varying scales and domains. Extensive experiments on graph datasets from different domains demonstrate the superiority of our proposed method. Zhe Zhao 0008, Pengkun Wang 0001, Haibin Wen, Yudong Zhang 0005, Binwu Wang, Yang Wang 0015 |
ICASSP | 4 |
| 2024 | Kill Two Birds with One Stone: Rethinking Data Augmentation for Deep Long-tailed LearningabstractReal-world tasks are universally associated with training samples that exhibit a long-tailed class distribution, and traditional deep learning models are not suitable for fitting this distribution, thus resulting in a biased trained model. To surmount this dilemma, massive deep long-tailed learning studies have been proposed to achieve inter-class fairness models by designing sophisticated sampling strategies or improving existing model structures and loss functions. Habitually, these studies tend to apply data augmentation strategies to improve the generalization performance of their models. However, this augmentation strategy applied to balanced distributions may not be the best option for long-tailed distributions. For a profound understanding of data augmentation, we first theoretically analyze the gains of traditional augmentation strategies in long-tailed learning, and observe that augmentation methods cause the long-tailed distribution to be imbalanced again, resulting in an intertwined imbalance: inherent data-wise imbalance and extrinsic augmentation-wise imbalance, i.e., two 'birds' co-exist in long-tailed learning. Motivated by this observation, we propose an adaptive Dynamic Optional Data Augmentation (DODA) to address this intertwined imbalance, i.e., one 'stone' simultaneously 'kills' two 'birds', which allows each class to choose appropriate augmentation methods by maintaining a corresponding augmentation probability distribution for each class during training. Extensive experiments across mainstream long-tailed recognition benchmarks (e.g., CIFAR-100-LT, ImageNet-LT, and iNaturalist 2018) prove the effectiveness and flexibility of the DODA in overcoming the intertwined imbalance. Binwu Wang, Pengkun Wang 0001, Wei Xu 0055, Xu Wang 0029, Yudong Zhang 0005, Kun Wang 0056, Yang Wang 0015 |
ICLR | 5 |
| 2024 | STONE: A Spatio-temporal OOD Learning Framework Kills Both Spatial and Temporal ShiftsabstractTraffic prediction is a crucial task in the Intelligent Transportation System (ITS), receiving significant attention from both industry and academia. Numerous spatio-temporal graph convolutional networks have emerged for traffic prediction and achieved remarkable success. However, these models have limitations in terms of generalization and scalability when dealing with Out-of-Distribution (OOD) graph data with both structural and temporal shifts. To tackle the challenges of spatio-temporal shift, we propose a framework called STONE by learning invariable node dependencies, which achieve stable performance in variable environments. STONE initially employs gated-transformers to extract spatial and temporal semantic graphs. These two kinds of graphs represent spatial and temporal dependencies, respectively. Then we design three techniques to address spatio-temporal shifts. Firstly, we introduce a Fréchet embedding method that is insensitive to structural shifts, and this embedding space can integrate loose position dependencies of nodes within the graph. Secondly, we propose a graph intervention mechanism to generate multiple variant environments by perturbing two kinds of semantic graphs without any data augmentations, and STONE can explore invariant node representation from environments. Finally, we further introduce an explore-to-extrapolate risk objective to enhance the variety of generated environments. We conduct experiments on multiple traffic datasets, and the results demonstrate that our proposed model exhibits competitive performance in terms of generalization and scalability. Binwu Wang, Jiaming Ma, Pengkun Wang 0001, Xu Wang 0029, Yudong Zhang 0005, Zhengyang Zhou, Yang Wang 0015 |
KDD | 5 |
| 2024 | Meta Koopman decomposition for time series forecasting under temporal distribution shifts
Yudong Zhang 0005, Xu Wang 0029, Zhaoyang Sun, Pengkun Wang 0001, Binwu Wang, Yang Wang 0015 |
Adv. Eng. Informatics | 1 |
| 2024 | Face Anti-Spoofing with Unknown Attacks: A Comprehensive Feature Extraction and Representation Perspective
Li-Min Li, Binwu Wang, Xu Wang 0029, Pengkun Wang 0001, Yudong Zhang 0005, Yang Wang 0015 |
J. Comput. Sci. Technol. | 5 |
| 2024 | Brave the Wind and the Waves: Discovering Robust and Generalizable Graph Lottery TicketsabstractThe training and inference of Graph Neural Networks (GNNs) are costly when scaling up to large-scale graphs. Graph Lottery Ticket (GLT) has presented the first attempt to accelerate GNN inference on large-scale graphs by jointly pruning the graph structure and the model weights. Though promising, GLT encounters robustness and generalization issues when deployed in real-world scenarios, which are also long-standing and critical problems in deep learning ideology. In real-world scenarios, the distribution of unseen test data is typically diverse. We attribute the failures on out-of-distribution (OOD) data to the incapability of discerning causal patterns, which remain stable amidst distribution shifts. In traditional spase graph learning, the model performance deteriorates dramatically as the graph/network sparsity exceeds a certain high level. Worse still, the pruned GNNs are hard to generalize to unseen graph data due to limited training set at hand. To tackle these issues, we propose the Resilient Graph Lottery Ticket (RGLT) to find more robust and generalizable GLT in GNNs. Concretely, we reactivate a fraction of weights/edges by instantaneous gradient information at each pruning point. After sufficient pruning, we conduct environmental interventions to extrapolate potential test distribution. Finally, we perform last several rounds of model averages to further improve generalization. We provide multiple examples and theoretical analyses that underpin the universality and reliability of our proposal. Further, RGLT has been experimentally verified across various independent identically distributed (IID) and out-of-distribution (OOD) graph benchmarks. Kun Wang 0056, Yuxuan Liang 0002, Xinglin Li, Guohao Li 0001, Bernard Ghanem, Roger Zimmermann, Zhengyang Zhou, Huahui Yi, Yudong Zhang 0005, Yang Wang 0015 |
IEEE Trans. Pattern Anal. Mach. Intell. | 9 |
| 2024 | Adaptive and Interactive Multi-Level Spatio-Temporal Network for Traffic ForecastingabstractTraffic forecasting is a challenging research topic due to the complex spatial and temporal dependencies among different roads. Though great efforts have been made on traffic forecasting, existing works still have the following shortcomings: i) Most methods only directly perform on the original road network topology which cannot accommodate the diverse traffic patterns and multi-granularity traffic forecasting requirements driven by the natural multi-level urban structure and layout, ii) The existing studies based on the spatio-temporal multi-granularity perspective ignore the interactions between the fine-grained information and coarse-grained information, resulting in the spatio-temporal correlation under multi-granularity inaccurately modeled. To solve the problems, we propose an Adaptive and Interactive Multi-level Spatio-Temporal network (AIMST) for traffic forecasting. Specifically, we first devise a learnable adaptive hierarchical clustering method to automatically generate more coarse-grained graphs from the initial road networks and the traffic data. Then, the spatio-temporal graph convolutional networks are executed on the constructed hierarchical traffic graph of each level correspondingly to capture the spatio-temporal patterns. Furthermore, a multi-level bidirectional interaction module is designed to emphasize the multi-grained interaction patterns among different levels. Extensive experiments on two real-world traffic datasets demonstrate that our framework is superior to several state-of-the-art baselines. Yudong Zhang 0005, Pengkun Wang 0001, Binwu Wang, Xu Wang 0029, Zhe Zhao 0008, Zhengyang Zhou, Lei Bai 0001, Yang Wang 0015 |
IEEE Trans. Intell. Transp. Syst. | 1 |
| 2024 | Modeling Spatio-Temporal Mobility Across Data Silos via Personalized Federated LearningabstractSpatio-temporal mobility modeling plays a pivotal role in the advancement of mobile computing. Nowadays, data is frequently held by various distributed silos, which are isolated from each other and confront limitations on data sharing. Given this, there have been some attempts to introduce federated learning into spatio-temporal mobility modeling. Meanwhile, the distributional heterogeneity inherent in the spatio-temporal data also puts forward requirements for model personalization. However, the existing methods tackle personalization in a model-centric manner and fail to explore the data characteristics in various data silos, thus ignoring the fact that the fundamental cause of insufficient personalization in the model is the heterogeneous distribution of data. In this paper, we propose a novel distribution-oriented personalizedFederated learning framework forCross-siloSpatio-Temporal mobility modeling (namedFedCroST), that leverages learnable spatio-temporal prompts to implicitly represent the local data distribution patterns of data silos and guide the local models to learn the personalized information. Specifically, we focus on the potential characteristics within temporal distribution and devise a conditional diffusion module to generate temporal prompts that serve as guidance for the evolution of the time series. Simultaneously, we emphasize the structure distribution inherent in node neighborhoods and propose adaptive spatial structure partition to construct the spatial prompts, augmenting the spatial information representation. Furthermore, we introduce a denoising autoencoder to effectively harness the learned multi-view spatio-temporal features and obtain personalized representations adapted to local tasks. Our proposal highlights the significance of latent spatio-temporal data distributions in enabling personalized federated spatio-temporal learning, providing new insights into modeling spatio-temporal mobility in data silo scenarios. Extensive experiments conducted on real-world datasets demonstrate that FedCroST outperforms the advanced baselines by a large margin in diverse cross-silo spatio-temporal mobility modeling tasks. Yudong Zhang 0005, Xu Wang 0029, Pengkun Wang 0001, Binwu Wang, Zhengyang Zhou, Yang Wang 0015 |
IEEE Trans. Mob. Comput. | 1 |
| 2023 | Long-Tailed Time Series Classification via Feature Space Rebalancing
Pengkun Wang 0001, Xu Wang 0029, Binwu Wang, Yudong Zhang 0005, Lei Bai 0001, Yang Wang 0015 |
DASFAA (1) | 4 |
| 2023 | A Knowledge-Driven Memory System for Traffic Flow Prediction
Binwu Wang, Yudong Zhang 0005, Pengkun Wang 0001, Xu Wang 0029, Lei Bai 0001, Yang Wang 0015 |
DASFAA (4) | 2 |
| 2023 | Pondering About Task Spatial Misalignment: Classification-Localization Equilibrated Object DetectionabstractObject detection is a fundamental task in computer vision, consisting of both classification and localization tasks. Previous works mostly perform classification and localization with shared feature extractor like Convolution Neural Network. However, the tasks of classification and localization exhibit different sensitivities with regard to the same feature, hence the "task spatial misalignment" issue. This issue can result in a hedge issue between the performances of localizer and classifier. To address these issues, we first propose a novel Dynamic Coefficient Loss to simultaneously consider and balance the performances of classification and localization tasks. To well address anchor label misjudgment issue in irregular- shaped object detection, we define a new classification-aware IoU metric to assign anchors intelligently. Finally, we further introduce the localization factor into NMS by proposing a Classification-Localization balanced NMS. Extensive experiments on MS COCO and PASCAL VOC demonstrate that our proposals can improve RetinaNet by around 1.5% AP with various backbones. Yudong Zhang 0005, Xu Wang 0029, Pengkun Wang 0001, Yang Wang 0015 |
ICASSP | 1 |
| 2023 | Pattern Expansion and Consolidation on Evolving Graphs for Continual Traffic PredictionabstractRecently, spatiotemporal graph convolutional networks are becoming popular in the field of traffic flow prediction and significantly improve prediction accuracy. However, the majority of existing traffic flow prediction models are tailored to static traffic networks and fail to model the continuous evolution and expansion of traffic networks. In this work, we move to investigate the challenge of traffic flow prediction on an expanding traffic network. And we propose an efficient and effective continual learning framework to achieve continuous traffic flow prediction without the access to historical graph data, namely Pattern Expansion and Consolidation based on Pattern Matching based (PECPM). Specifically, we first design a pattern bank based on pattern matching to store representative patterns of the road network. With the expansion of the road network, the model configured with such a bank module can achieve continuous traffic prediction by effectively managing patterns stored in the bank. The core idea is to continuously update new patterns while consolidating learned ones. Specifically, we design a pattern expansion mechanism that can detect evolved and new patterns from the updated network, then these unknown patterns are expanded into the pattern bank to adapt to the updated road network. Additionally, we propose a pattern consolidation mechanism that includes both a bank preservation mechanism and a pattern traceability mechanism. This can effectively consolidate the learned patterns in the bank without requiring access to detailed historical graph data. We construct experiments on real-world traffic datasets to demonstrate the competitive performance, superior efficiency, and strong generalization ability of PECPM. Binwu Wang, Yudong Zhang 0005, Xu Wang 0029, Pengkun Wang 0001, Zhengyang Zhou, Lei Bai 0001, Yang Wang 0015 |
KDD | 2 |
| 2023 | An Observed Value Consistent Diffusion Model for Imputing Missing Values in Multivariate Time SeriesabstractMissing values, which are common in multivariate time series, is most important obstacle towards the utilization and interpretation of those data. Great efforts have been employed on how to accurately impute missing values in multivariate time series, and existing works either use deep learning networks to achieve deterministic imputations or aim at generating different plausible imputations by sampling multiple noises from a same distribution and then denoising them. However, these models either fall short of modeling the uncertainties of imputations due to their deterministic nature or perform poorly in terms of interpretability and imputation accuracy due to their ignorance of the correlations between the latent representations of both observed and missing values which are parts of samples from a same distribution. To this end, in this paper, we explicitly take the correlations between observed and missing values into account, and theoretically re-derive the Evidence Lower BOund (ELBO) of conditional diffusion model in the scenario of multivariate time series imputation. Based on the newly derived ELBO, we further propose a novel multivariate imputation diffusion model (MIDM) which is equipped with novel noise sampling, adding and denoising mechanisms for multivariate time series imputation, and the series of newly designed technologies jointly ensure the involving of the consistency between observed and missing values. Extensive experiments on both the tasks of multivariate time series imputation and forecasting witness the superiority of our proposed MIDM model on generating conditional estimations. Xu Wang 0029, Pengkun Wang 0001, Yudong Zhang 0005, Binwu Wang, Zhengyang Zhou, Yang Wang 0015 |
KDD | 4 |
| 2023 | Maintaining the Status Quo: Capturing Invariant Relations for OOD Spatiotemporal LearningabstractSpatiotemporal (ST) learning has become a crucial technique for urban digitalization. Due to expansions and dynamics of cities, current spatiotemporal models are inclined to suffer distribution shifts between training and testing sets, leading to the OOD delimma. However, few studies focus on such OOD problem in temporal regressions, let alone spatiotemporal learning. Spatiotemporal data usually reveals segment-level heterogeneity within periodicity and complex spatial dependencies, posing challenges to invariance extraction. In this paper, we find that ST relations make sense for generalization and devise a Causal ST learning framework, CauSTG, which enables invariant relation transferred to OOD scenarios. Specifically, we take temporal steps as environments, and transform spatial-temporal relations into learnable parameters. To tackle heterogeneity in periodicity, we partition temporal steps into sub-environments by identifying distinctive trend patterns, enabling re-organized samples trained separately. To extract invariance within ST observations, we propose a spatiotemporal consistency learner and a hierarchical invariance explorer to jointly filter out stable relations. Our spatiotemporal learner quantifies bi-directional spatial consistency and extracts disentangled seasonal-trend patterns via trainable parameters. Further, the hierarchical invariance explorer constructs variation-based filter to achieve both local and global invariances. Experiments reveal that CauSTG can increase at most 10.26% performance against best baselines, and visualized invariant relations can well interpret the physical rationales. The appendix and codes can be available in our Github repository. Zhengyang Zhou, Qihe Huang, Kuo Yang 0002, Kun Wang 0056, Xu Wang 0029, Yudong Zhang 0005, Yuxuan Liang 0002, Yang Wang 0015 |
KDD | 6 |
| 2023 | Knowledge Expansion and Consolidation for Continual Traffic Prediction With Expanding GraphsabstractAccurate traffic prediction plays a vital role in intelligent transport managements and applications. However, in the vast majority of existing works, the focus is mainly on modeling spatiotemporal correlations in static traffic networks. Thus, the continuous expansion and evolution of traffic networks are ignored. In this work, we study the problem of traffic prediction with expanding road network structures under the continual learning paradigm. Considering the model prediction performance, efficiency, and data accessibility, a SpatioTemporal Knowledge Expansion and Consolidation (STKEC) framework is proposed. This framework contains an influence-based knowledge expansion strategy to help the spatiotemporal learning model integrate new spatiotemporal traffic patterns and a memory-augmented knowledge consolidation mechanism to preserve the learned spatiotemporal patterns without accessing the data in previous graphs. Extensive experiments are conducted on a large-scale dataset and verify the superior performance of STKEC in continual traffic prediction. Binwu Wang, Yudong Zhang 0005, Pengkun Wang 0001, Xu Wang 0029, Lei Bai 0001, Yang Wang 0015 |
IEEE Trans. Intell. Transp. Syst. | 2 |
| 2022 | Countering Modal Redundancy and Heterogeneity: A Self-Correcting Multimodal FusionabstractFusing multimodal heterogeneous data plays a vital role in recognition and prediction tasks in various fields, e.g., action recognition and traffic accident forecast. Yet, there remain some key challenges, such as heterogeneous feature interaction and feature redundancies, that significantly affect the performance of multimodal fusion. To tackle these challenges, we first devise a Unified Feature Interaction Module (UFIM) in which a novel orthogonal attention component is designed to obtain fine-grained inter-modal interaction information among heterogeneous features. Then, we propose a novel Self-Correcting Transformer Module (SCTM) which employs a modified transformer to obtain the one-to-many correlation information between the current modal feature and the merged features of other modalities to alleviate the redundancy problem. Extensive experiments on four cross-domain tasks demonstrate the effectiveness and generalization ability of our proposed method. Pengkun Wang 0001, Xu Wang 0029, Binwu Wang, Yudong Zhang 0005, Lei Bai 0001, Yang Wang 0015 |
ICDM | 4 |
| 2022 | CMT-Net: A Mutual Transition Aware Framework for Taxicab Pick-ups and Drop-offs Co-PredictionabstractWith increasing population of modern cities, accurate estimation of regional passenger demands is critical to online taxicab services as such platforms aim at a reformation of taxicab scheduling for a more efficient order dispatching. Though great efforts have been made on passenger demand predictions, existing works still have the following shortcomings: i) they mostly performed based on uniform grid partition, which results in the imbalance of demand volumes among regions and even non-vehicle regions in such partition, ii) none of previous demand forecasting efforts have highlighted the important mutual influences between pick-ups and drop-offs, which are of great significance for taxicab scheduling. To this end, we first devise a multi-kernel based clustering to achieve a taxicab-behavior and geographic-aware sub-region partition, hence a more balanced and compact regional division is obtained. Subsequently, we emphasize the essential factors with regard to mutual transition quantification in taxicab predictions, then propose a Transfer-LSTM and an Origin-Destination-based transition matrix to respectively capture the drop-to-pick and pick-to-drop spatiotemporal transition patterns. Hence, a novel mutual-transition-aware co-prediction framework is devised by capturing complex spatiotemporal interactions between pick-ups and drop-offs. Extensive experiments on two real-world taxicab datasets demonstrate our co-prediction framework is superior to state-of-the-art methods, thus providing novel perspectives to urban human mobility understanding and transition-based taxicab scheduling. Yudong Zhang 0005, Binwu Wang, Ziyang Shan, Zhengyang Zhou, Yang Wang 0015 |
WSDM | 1 |