Zheng Dong 0006

dblp:27/1207-6 · DBLP profile ↗
← Back
7ranked-venue papers
2as first author
7since 2021 · last 2025
0009-0008-4400-7614ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 6 · 2 first-author · 6 since 2021Databases, data management, data science and information retrieval · 4 · 2 first-author · 4 since 2021Applied, interdisciplinary, general and emerging computing · 2 · 1 first-author · 2 since 2021Computer networks · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
YearPublicationVenuePosition
2025 How Different from the Past? Spatio-Temporal Time Series Forecasting with Self-Supervised Deviation Learning
abstract
Spatio-temporal forecasting is essential for real-world applications such as traffic management and urban computing. Although recent methods have shown improved accuracy, they often fail to account for dynamic deviations between current inputs and historical patterns. These deviations contain critical signals that can significantly affect model performance. To fill this gap, we propose $\textbf{ST-SSDL}$, a $\underline{S}$patio-$\underline{T}$emporal time series forecasting framework that incorporates a $\underline{S}$elf-$\underline{S}$upervised $\underline{D}$eviation $\underline{L}$earning scheme to capture and utilize such deviations. ST-SSDL anchors each input to its historical average and discretizes the latent space using learnable prototypes that represent typical spatio-temporal patterns. Two auxiliary objectives are proposed to refine this structure: a contrastive loss that enhances inter-prototype discriminability and a deviation loss that regularizes the distance consistency between input representations and corresponding prototypes to quantify deviation. Optimized jointly with the forecasting objective, these components guide the model to organize its hidden space and improve generalization across diverse input conditions. Experiments on six benchmark datasets show that ST-SSDL consistently outperforms state-of-the-art baselines across multiple metrics. Visualizations further demonstrate its ability to adaptively respond to varying levels of deviation in complex spatio-temporal scenarios. Our code and datasets are available at https://github.com/Jimmy-7664/ST-SSDL.
Zheng Dong 0006, Jiawei Yong, Shintaro Fukushima, Kenjiro Taura, Renhe Jiang
NeurIPS2
2025 Evaluating the Generalization Ability of Spatiotemporal Model in Urban Scenario
abstract
Spatiotemporal neural networks have shown great promise in urban scenarios by effectively capturing temporal and spatial correlations. However, urban environments are constantly evolving, and current model evaluations are often limited to traffic scenarios and use data mainly collected only a few weeks after training period to evaluate model performance. The generalization ability of these models remains largely unexplored. To address this, we propose a Spatiotemporal Out-of-Distribution (ST-OOD) benchmark, which comprises six urban scenario: bike-sharing, 311 services, pedestrian counts, traffic speed, traffic flow, ride-hailing demand, and bike-sharing, each with in-distribution (same year) and out-of-distribution (next years) settings. We extensively evaluate state-of-the-art spatiotemporal models and find that their performance degrades significantly in out-of-distribution settings, with most models performing even worse than a simple Multi-Layer Perceptron (MLP). Our findings suggest that current leading methods tend to over-rely on parameters to overfit training data, which may lead to good performance on in-distribution data but often results in poor generalization. We also investigated whether dropout could mitigate the negative effects of overfitting. Our results showed that a slight dropout rate could significantly improve generalization performance on most datasets, with minimal impact on in-distribution performance. However, balancing in-distribution and out-of-distribution performance remains a challenging problem. We hope that the proposed benchmark will encourage further research on this critical issue.
Hongjun Wang 0007, Jiyuan Chen, Tong Pan, Zheng Dong 0006, Renhe Jiang, Xuan Song 0001
IEEE Trans. Mob. Comput.4
2024 Spatial-Temporal-Decoupled Masked Pre-training for Spatiotemporal Forecasting
Renhe Jiang, Zheng Dong 0006, Jinliang Deng, Xuan Song 0001
IJCAI3
2024 Heterogeneity-Informed Meta-Parameter Learning for Spatiotemporal Time Series Forecasting
abstract
Spatiotemporal time series forecasting plays a key role in a wide range of real-world applications. While significant progress has been made in this area, fully capturing and leveraging spatiotemporal heterogeneity remains a fundamental challenge. Therefore, we propose a novel Heterogeneity-Informed Meta-Parameter Learning scheme. Specifically, our approach implicitly captures spatiotemporal heterogeneity through learning spatial and temporal embeddings, which can be viewed as a clustering process. Then, a novel spatiotemporal meta-parameter learning paradigm is proposed to learn spatiotemporal-specific parameters from meta-parameter pools, which is informed by the captured heterogeneity. Based on these ideas, we develop a Heterogeneity-Informed Spatiotemporal Meta-Network (HimNet) for spatiotemporal time series forecasting. Extensive experiments on five widely-used benchmarks demonstrate our method achieves state-of-the-art performance while exhibiting superior interpretability. Our code is available at https://github.com/XDZhelheim/HimNet.
Zheng Dong 0006, Renhe Jiang, Hangchen Liu, Jinliang Deng, Qingsong Wen, Xuan Song 0001
KDD1
2023 Spatio-Temporal Adaptive Embedding Makes Vanilla Transformer SOTA for Traffic Forecasting
abstract
With the rapid development of the Intelligent Transportation System (ITS), accurate traffic forecasting has emerged as a critical challenge. The key bottleneck lies in capturing the intricate spatio-temporal traffic patterns. In recent years, numerous neural networks with complicated architectures have been proposed to address this issue. However, the advancements in network architectures have encountered diminishing performance gains. In this study, we present a novel component called spatio-temporal adaptive embedding that can yield outstanding results with vanilla transformers. Our proposed Spatio-Temporal Adaptive Embedding transformer (STAEformer) achieves state-of-the-art performance on five real-world traffic forecasting datasets. Further experiments demonstrate that spatio-temporal adaptive embedding plays a crucial role in traffic forecasting by effectively capturing intrinsic spatio-temporal relations and chronological information in traffic time series.
Hangchen Liu, Zheng Dong 0006, Renhe Jiang, Jiewen Deng, Jinliang Deng, Quanjun Chen, Xuan Song 0001
CIKM2
2022 Learning Latent Road Correlations from Trajectories
abstract
A core component of the Intelligent Transportation System (ITS) is road network, which forms the most basic transport infrastructure, and becomes widely applied in many traffic applications. In most traffic models, the spatial representation of road network is learned only through static graph connection while dynamic driver preference and traffic conditions in the real world are ignored. Therefore, in this paper, a novel trajectory-based road network representation is proposed. By mining vehicle trajectories, our proposed method can learn dynamic route choice through embeddings of each road in a next-hop prediction model. Then road correlations are calculated by the embeddings to build a latent correlation graph that can be applied in various traffic-related applications. Extensive experiment results prove the effectiveness and rationality of our proposed approach.
Zheng Dong 0006, Quanjun Chen, Renhe Jiang, Huanchen Wang, Xuan Song 0001
IEEE Big Data1
2022 A Geomagnetic Sensor Dataset for Traffic Flow Prediction
abstract
Traffic state prediction is essential in Intelligent Transportation Systems for surveillance, management, and daily commuting. For developing high-accuracy prediction models, real-world traffic state datasets are necessary for training model parameters and evaluating prediction results. However, limited by the existing traffic collection devices, most of the current open datasets for traffic state prediction cannot obtain accurate traffic flow information. In contrast, some datasets directly use detection devices in freeway systems, so they cannot reflect complex urban traffic states. Therefore, a dataset from advanced devices that can record the flow from point to point on an urban road network attracts more attention and drives the progress of research on traffic state prediction models. To deal with the above issues, we introduce a Suburban Traffic Flow dataset using Geomagnetic sensors, or STF-G dataset, constructed for traffic flow prediction. The STF-G dataset consists of 2.5 billion vehicle driving scenarios and 319 corresponding geomagnetic sensors. The data was collected over 20 months and processed with two regional road graphs. We also do the Benchmark experiments in STF-G for analyzing and evaluating the performance of graph neural network models in traffic flow prediction and compare them to the other datasets with the same baseline.
Huanchen Wang, Quanjun Chen, Zheng Dong 0006, Xuan Song 0001, Donglong Yang, Manxia Liu
IEEE Big Data3