Fenghua Zhu

dblp:70/2344 · DBLP profile ↗
← Back
39ranked-venue papers
5as first author
25since 2021 · last 2026
0000-0003-2886-6968ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Applied, interdisciplinary, general and emerging computing · 26 · 5 first-author · 13 since 2021Artificial intelligence and machine learning · 10 · 9 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 3 since 2021Human-computer interaction and ubiquitous computing · 2 · 2 since 2021Systems, architecture and hardware · 1 · 1 since 2021
YearPublicationVenuePosition
2026 Predictive reinforcement learning based on heterogeneous graph model for trajectory planning
Xingyuan Dai, Hub Ali, Fenghua Zhu
Expert Syst. Appl.4
2026 Enhancing pavement disease classification through wavelet frequency features and attention mechanisms
Fenghua Zhu, Zhaozhe Gao, Benlan Shen
Vis. Comput.4
2025 HPLaw: Heterogeneous Parallel LiDARs for Adverse Weather in V2V
abstract
Parallel LiDAR emerges as an innovative framework for next-generation intelligent LiDAR systems in autonomous driving. In parallel LiDAR research, V2V (Vehicle-to-Vehicle) cooperative perception is a promising technology which can effectively enhance perception range and accuracy through inter-agent information exchange. Currently, sensor heterogeneity remains a critical challenge in V2V. Although some work has made initial attempts to address this issue, existing studies are primarily conducted under ideal clear-weather conditions, ignoring the impact of variable weather factors in real-world applications. In fact, adverse weather has been shown to significantly degrade the performance of LiDAR systems, with the risk of cumulative degradation in V2V. To address this challenge, we first introduce OPV2V-W and V2V4Real-W as new benchmarks to study sensor heterogeneity in V2V under adverse weather. Then we propose the HPLaw architecture (Heterogeneous Parallel LiDARs for Adverse Weather), a self-knowledge distillation method designed to enhance model robustness across varying weather scenarios. HPLaw employs an efficient PF network to facilitate heterogeneous feature fusion and incorporates an SAKD module to extract weather-invariant features. Extensive experiments demonstrate that the student model in HPLaw achieves outstanding performance under all weather conditions, exhibiting remarkable robustness.
Xingxia Wang, Boyi Sun, Yutong Wang 0001, Fenghua Zhu, Fei-Yue Wang 0001
IROS6
2025 EPDNet: Light-weight small target detection algorithm based on pruning and logical distillation
Gaofeng Zhu, Fenghua Zhu, Gang Xiong 0001
Appl. Intell.3
2025 CoEF: Vehicular cooperative perception based on entropy theory and feature re-projection
Zunlei Feng, Gang Xiong 0001, Peijun Ye 0001, Guangmin Liu, Haina Tang, Fenghua Zhu
Expert Syst. Appl.7
2025 FLCSDet: Federated Learning-Driven Cross-Spatial Vessel Detection for Maritime Surveillance With Privacy Preservation
abstract
Maritime surveillance plays a vital role in reducing maritime accidents and improving maritime safety. To enhance situational awareness for maritime movements, deep learning-based visual object detection has become an important part of maritime surveillance. However, the detection results are highly dependent on the training datasets collected from different departments (i.e., clients). If the sub-datasets from departments are sensitive and private in cross-department maritime surveillance, it will be intractable to directly combine these sub-datasets to train the learning-based object detection method. To solve this issue, we propose a federated learning-driven cross-spatial vessel detection model, called FLCSDet, for maritime surveillance with privacy preservation. In particular, an efficient multi-scale attention module is integrated into our FLCSDet to achieve local cross-spatial feature learning. To improve the federated-learning aggregation method, we propose an optimized algorithm based on the proportion of valid data on departments to adaptively select the allocating weights and preserve the specific characteristics of client data. In addition, we employ transfer learning to further improve the robustness and convergence of our FLCSDet under different experimental scenarios. Compared with several representative federated learning-based detection methods, our FLCSDet could achieve superior detection performance in terms of both quantitative and qualitative results. Moreover, comprehensive experiments conducted on real datasets from both inland waterways and open seas demonstrate the robustness and generalization of our method in intelligent transportation systems. The source code is available athttps://github.com/huangyanh/FLCSDet.
Yanhong Huang, Ryan Wen Liu, Yijing Lin, Jiawen Kang 0001, Fenghua Zhu, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.5
2024 Interpretable Autonomous Driving Model Based on Cognitive Reinforcement Learning
abstract
With the rapid development of autonomous driving technology, the safety of driving systems has increasingly become the focus of attention. However, although many existing autonomous driving decision-making algorithms, such as deep reinforcement learning, demonstrate excellent performance, their decision-making processes lack interpretability and are opaque to users. To address this problem, this paper constructs an interpretable driving model from the perspective of human cognition, which can not only imitate human driving behavior through cognitive reinforcement learning methods, but also show better performance in driving experiments. In addition, the paper also proposes an analysis method for abnormal driving behavior, which provides a new idea for discovering potential unsafe behaviors during driving and exploring the possible impact of this behavior pattern on driving tasks.
Hao Qi 0011, Fenghua Zhu, Peijun Ye 0001
IV3
2024 DATraj: A Dynamic Graph Attention Based Model for Social-Aware Pedestrian Trajectory Prediction
abstract
Accurately forecasting the future paths of numerous agents is vital for the efficacy of autonomous systems. In crowded scenarios such as sidewalks, subways and airports, pedestrians instinctively modify their motion pattern in response to the environmental context and social consensus like preserving personal space and circumventing physical contact. Thus, the task to predict future pedestrian trajectory presents considerable challenges owing to the complex interaction among agents and the inherent uncertainty in predicting each agent's subsequent actions. Inspired by the recent success of Graph Neural Networks (GNN), a model named DATraj is introduced for predicting pedestrian trajectory. DATraj first uses a temporal encoder composed of attention mechanism to capture the spatial-temporal dynamics of pedestrians. The encoder can learn the motion pattern and subtle movement of pedestrian in the crowded scenario. Graph Attention Networks (GAT) is used in many models to catch social interaction between individuals. However common GATs compute a static attention: the ranking of the attention scores is unconditioned on the query node. DATraj implement the global interaction parts using the improved dynamic attention which every query uniquely prioritizes the attention coefficients correlated with the keys, this provides a much better robustness to noise. Experiments show that our trajectory prediction model achieves better performance on several public datasets.
Zeze Si, Peijun Ye 0001, Gang Xiong 0001, Fenghua Zhu
IV5
2024 Self-Aware Adaptive Alignment: Enabling Accurate Perception for Intelligent Transportation Systems
abstract
Achieving top-notch performance in Intelligent Transportation detection is a critical research area. However, many challenges still need to be addressed when it comes to detecting in a cross-domain scenario. In this paper, we propose a Self-Aware Adaptive Alignment (SA3), by leveraging an efficient alignment mechanism and recognition strategy. Our proposed method employs a specified attention-based alignment module trained on source and target domain datasets to guide the image-level features alignment process, enabling the local-global adaptive alignment between the source domain and target domain. Features from both domains, whose channel importance is re-weighted, are fed into the region proposal network, which facilitates the acquisition of salient region features. Also, we introduce an instance-to-image level alignment module specific to the target domain to adaptively mitigate the domain gap. To evaluate the proposed method, extensive experiments have been conducted on popular cross-domain object detection benchmarks. Experimental results show that SA3 achieves superior results to the previous state-of-the-art methods.
Tong Xiang, Hongxia Zhao, Fenghua Zhu, Yuanyuan Chen 0003
IV3
2024 Real-Time Multi-Scene Visibility Enhancement for Promoting Navigational Safety of Vessels Under Complex Weather Conditions
abstract
The visible-light camera, which is capable of environment perception and navigation assistance, has emerged as an essential imaging sensor for marine surface vessels in intelligent waterborne transportation systems (IWTS). However, the visual imaging quality inevitably suffers from several kinds of degradations (e.g., limited visibility, low contrast, color distortion, etc.) under complex weather conditions (e.g., haze, rain, and low-lightness). The degraded visual information will accordingly result in inaccurate environment perception and delayed operations for navigational risk. To promote the navigational safety of vessels, many computational methods have been presented to perform visual quality enhancement under poor weather conditions. However, most of these methods are essentially specific-purpose implementation strategies, only available for one specific weather type. To overcome this limitation, we propose to develop a general-purpose multi-scene visibility enhancement method, i.e., edge reparameterization- and attention-guided neural network (ERANet), to adaptively restore the degraded images captured under different weather conditions. In particular, our ERANet simultaneously exploits the channel attention, spatial attention, and reparameterization technology to enhance the visual quality while maintaining low computational cost. Extensive experiments conducted on standard and IWTS-related datasets have demonstrated that our ERANet could outperform several representative visibility enhancement methods in terms of both imaging quality and computational efficiency. The superior performance of IWTS-related object detection and scene segmentation could also be steadily obtained after ERANet-based visibility enhancement under complex weather conditions.
Ryan Wen Liu, Yuxu Lu, Yuan Gao 0015, Yu Guo 0008, Wenqi Ren, Fenghua Zhu, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.6
2024 Double Domain Guided Real-Time Low-Light Image Enhancement for Ultra-High-Definition Transportation Surveillance
abstract
Real-time transportation surveillance is an essential part of the intelligent transportation system (ITS). However, images captured under low-light conditions often suffer poor visibility with types of degradation, such as noise interference and vague edge features, etc. With the development of imaging devices, the quality of the visual surveillance data is continually increasing, like 2K and 4K, which have more strict requirements on the efficiency of image processing. To satisfy the requirements on both enhancement quality and computational speed, this paper proposes a double domain guided real-time low-light image enhancement network (DDNet) for ultra-high-definition (UHD) transportation surveillance. Specifically, we design an encoder-decoder structure as the main architecture of the learning network. In particular, the enhancement processing is divided into two subtasks (i.e., color enhancement and gradient enhancement) via the proposed coarse enhancement module (CEM) and LoG-based gradient enhancement module (GEM), which are embedded in the encoder-decoder structure. It enables the network to enhance the color and edge features simultaneously. Through the decomposition and reconstruction on both color and gradient domains, our DDNet can restore the detailed feature information concealed by the darkness with better visual quality and efficiency. The evaluation experiments on standard and transportation-related datasets demonstrate that our DDNet provides superior enhancement quality and efficiency compared with state-of-the-art methods. Besides, the object detection and scene segmentation experiments indicate the practical benefits for higher-level image analysis under low-light environments in ITS. The source code is available at https://github.com/QuJX/DDNet.
Jingxiang Qu, Ryan Wen Liu, Yuan Gao 0015, Yu Guo 0008, Fenghua Zhu, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.5
2024 Multi-Task Learning-Enabled Automatic Vessel Draft Reading for Intelligent Maritime Surveillance
abstract
The accurate and efficient vessel draft reading (VDR) is an important component of intelligent maritime surveillance, which could be exploited to assist in judging whether the vessel is normally loaded or overloaded. The computer vision technique with an excellent price-to-performance ratio has become a popular medium to estimate vessel draft depth. However, the traditional estimation methods easily suffer from several limitations, such as sensitivity to low-quality images, high computational cost, etc. In this work, we propose a multi-task learning-enabled computational method (termed MTL-VDR) for generating highly reliable VDR. In particular, our MTL-VDR mainly consists of four components, i.e., draft mark detection, draft scale recognition, vessel/water segmentation, and final draft depth estimation. We first construct a benchmark dataset related to draft mark detection and employ a powerful and efficient convolutional neural network to accurately perform the detection task. The multi-task learning method is then proposed for simultaneous draft scale recognition and vessel/water segmentation. To obtain more robust VDR under complex conditions (e.g., damaged and stained scales, etc.), the accurate draft scales are generated by an automatic correction method, which is presented based on the spatial distribution rules of draft scales. Finally, an adaptive computational method is exploited to yield an accurate and robust draft depth. Extensive experiments have been implemented on the realistic dataset to compare our MTL-VDR with state-of-the-art methods. The results have demonstrated its superior performance in terms of accuracy, robustness, and efficiency. The computational speed exceeds 40 FPS, which satisfies the requirements of real-time maritime surveillance to guarantee vessel traffic safety.
Jingxiang Qu, Ryan Wen Liu, Chenjie Zhao, Yu Guo 0008, Sendren Sheng-Dong Xu, Fenghua Zhu
IEEE Trans. Intell. Transp. Syst.6
2024 Auxiliary Network Enhanced Hierarchical Graph Reinforcement Learning for Vehicle Repositioning
abstract
Affected by people’s dynamic social activities, the imbalance between vehicle supply and demand in the Mobility-On-Demand(MOD) system is a common phenomenon. To improve traffic efficiency, an Auxiliary Network Enhanced Hierarchical Graph Reinforcement Learning (AHGRL) method is proposed for vehicle repositioning. Firstly, a hierarchical graph reinforcement learning (HGRL) framework is designed. The complex vehicle repositioning problem in real road networks is divided into many sub-tasks and multiple reinforcement learning algorithms are designed to solve decision problems of different levels. Traffic congestion is also considered and road nodes are clustered dynamically. And then an auxiliary graph reinforcement learning (AGRL) algorithm is designed for the actuator. It contains the prediction branch and the repositioning branch. States and rewards of agents could be designed accurately with the support of the prediction branch. The two branches cooperate in an auxiliary way to achieve excellent forecasting and repositioning effects. Finally, to enable efficient multi-vehicle coordination, a discrete Soft Actor-Critic algorithm is adopted in the repositioning branch, which learns multiple optimal actions for vehicles in the same area. Comparative experiments with real data demonstrate the effectiveness of our method. And ablation experiments verify the effectiveness and universality of the HGRL framework and the AGRL algorithm.
Jinhao Xi, Fenghua Zhu, Peijun Ye 0001, Gang Xiong 0001, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.2
2023 Parallel Reasoning Based on ACP Method for Power Grid Dispatching
abstract
Multi-source heterogeneous knowledge collaboration is the technical foundation for establishing a complete knowledge base. A parallel reasoning framework based on the ACP method is proposed to establish a complete knowledge base. The contribution of this framework is three-fold. First, it provides a virtual experimental platform for generating the artificial data needed for missing knowledge extraction by constructing an artificial system. Second, it generates artificial big data and organizes it into a knowledge graph to achieve structured representation and storage of system control knowledge by carrying out calculation experiments related to missing scene knowledge. Finally, it achieves unbiased application and update of knowledge through parallel execution, completing the optimization and control of the actual system. Parallel reasoning provides an effective technical means for multi-source knowledge collaboration and provides strong support for building knowledge-enhanced complex system control systems. The effectiveness of parallel reasoning is verified through experiments.
Yancai Xu, Linyao Yang, Fenghua Zhu, Xiao Wang 0002, Fei-Yue Wang 0001
SMC3
2023 Conservative-Progressive Collaborative Learning for Semi-Supervised Semantic Segmentation
abstract
Pseudo supervision is regarded as the core idea in semi-supervised learning for semantic segmentation, and there is always a tradeoff between utilizing only the high-quality pseudo labels and leveraging all the pseudo labels. Addressing that, we propose a novel learning approach, called Conservative-Progressive Collaborative Learning (CPCL), among which two predictive networks are trained in parallel, and the pseudo supervision is implemented based on both the agreement and disagreement of the two predictions. One network seeks common ground via intersection supervision and is supervised by the high-quality labels to ensure a more reliable supervision, while the other network reserves differences via union supervision and is supervised by all the pseudo labels to keep exploring with curiosity. Thus, the collaboration of conservative evolution and progressive exploration can be achieved. To reduce the influences of the suspicious pseudo labels, the loss is dynamic re-weighted according to the prediction confidence. Extensive experiments demonstrate that CPCL achieves state-of-the-art performance for semi-supervised semantic segmentation.
Siqi Fan 0002, Fenghua Zhu, Zunlei Feng, Mingli Song, Fei-Yue Wang 0001
IEEE Trans. Image Process.2
2023 Asynchronous Trajectory Matching-Based Multimodal Maritime Data Fusion for Vessel Traffic Surveillance in Inland Waterways
abstract
The automatic identification system (AIS) and video cameras have been widely exploited for vessel traffic surveillance in inland waterways. The AIS data could provide vessel identity and dynamic information on vessel position and movements. In contrast, the video data could describe the visual appearances of moving vessels without knowing the information on identity, position, movements, etc. To further improve vessel traffic surveillance, it becomes necessary to fuse the AIS and video data to simultaneously capture the visual features, identity, and dynamic information for the vessels of interest. However, the performance of AIS and video data fusion is susceptible to issues such as data spatial difference, message asynchronous transmission, visual object occlusion, etc. In this work, we propose a deep learning-based simple online and real-time vessel data fusion method (termed DeepSORVF). We first extract the AIS-and video-based vessel trajectories, and then propose an asynchronous trajectory matching method to fuse the AIS-based vessel information with the corresponding visual targets. In addition, by combining the AIS-and video-based movement features, we also present a prior knowledge-driven anti-occlusion method to yield accurate and robust vessel tracking results under occlusion conditions. To validate the efficacy of our DeepSORVF, we have also constructed a new benchmark dataset (termed FVessel) for vessel detection, tracking, and data fusion. It consists of many videos and the corresponding AIS data collected in various weather conditions and locations. The experimental results have demonstrated that our method is capable of guaranteeing high-reliable data fusion and anti-occlusion vessel tracking. The DeepSORVF code and FVessel dataset are publicly available at https://github.com/gy65896/DeepSORVF and https://github.com/gy65896/FVessel, respectively.
Yu Guo 0008, Ryan Wen Liu, Jingxiang Qu, Yuxu Lu, Fenghua Zhu
IEEE Trans. Intell. Transp. Syst.5
2023 Parallel Emergency Management of Incidents by Integrating OODA and PREA Loops: The C2 Mechanism and Modes
abstract
Given the differences of command and control (C2) activities between the field command center and the emergency operations center (EOC), this article combined the edge C2 theory with the parallel C2 theory, and proposed a parallel incident C2 mode based on the observe–orient–decide–act (OODA) loop and planning–readiness–execution–assessment (PREA) loop. The aim is to build up a PREA loop-based parallel incident C2 mode and its related operating mechanism of edge empowerment and energy release in parallel incident C2 mode. The parallel incident C2 mode based on the PREA loop and OODA loop supports the co-existence and connection of the two roles of the incident C2 agent at the emergency scene. The two roles are the executive role of emergency response and operation and the command and organization role of the edge emergency system. This article initiates a deep integration of two different C2 process mechanisms in the emergency response and operation process, taking into account the local emergency scene and the global emergency system. Taken together, a key issue has been well addressed regarding the contradiction that the traditional emergency response cannot be reconciled in terms of rapidity and thoroughness.
Fenghua Zhu, Huachao Cui, Jirong Qin
IEEE Trans. Syst. Man Cybern. Syst.3
2022 Bridging the Micro and Macro: Calibration of Agent-Based Model Using Mean-Field Dynamics
abstract
Calibration of agent-based models (ABM) is an essential stage when they are applied to reproduce the actual behaviors of distributed systems. Unlike traditional methods that suffer from the repeated trial and error and slow convergence of iteration, this article proposes a new ABM calibration approach by establishing a link between agent microbehavioral parameters and systemic macro-observations. With the assumption that the agent behavior can be formulated as a high-order Markovian process, the new approach starts with a search for an optimal transfer probability through a macrostate transfer equation. Then, each agent's microparameter values are computed using mean-field approximation, where his complex dependencies with others are approximated by an expected aggregate state. To compress the agent state space, principal component analysis is also introduced to avoid high dimensions of the macrostate transfer equation. The proposed method is validated in two scenarios: 1) population evolution and 2) urban travel demand analysis. Experimental results demonstrate that compared with the machine-learning surrogate and evolutionary optimization, our method can achieve higher accuracies with much lower computational complexities.
Peijun Ye 0001, Yuanyuan Chen 0003, Fenghua Zhu, Wanze Lu, Fei-Yue Wang 0001
IEEE Trans. Cybern.3
2022 PRECOM: A Parallel Recommendation Engine for Control, Operations, and Management on Congested Urban Traffic Networks
abstract
This paper proposes a parallel recommendation engine, PRECOM, for traffic control operations to mitigate congestion of road traffic in the metropolitan area. The recommendation engine can provide, in real-time, effective and optimal control plans to traffic engineers, who are responsible for manually calibrating traffic signal plans especially when a road network suffers from heavy congestion due to disruptive events. With the idea of incorporating expert knowledge in the operation loop, the PRECOM system is designed to include three conceptual components: an artificial system model, a computational experiment module, and a parallel execution module. Meanwhile, three essential algorithmic steps are implemented in the recommendation engine: a candidate generator based on a graph model, a spatiotemporal ranker, and a context-aware re-ranker. The PRECOM system has been deployed in the city of Hangzhou, China, through both offline and online evaluation. The experimental results are promising, and prove that the recommendation system can provide effective support to the current human-in-the-loop control scheme in the practice of traffic control, operations, and management.
Junchen Jin, Dingding Rong, Yuqi Pang, Fenghua Zhu, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.4
2022 Data Augmented Deep Behavioral Cloning for Urban Traffic Control Operations Under a Parallel Learning Framework
abstract
It is indispensable for professional traffic signal engineers to perform manual operations of traffic signal control (TSC) to mitigate traffic congestion, especially with complicated scenarios. However, such a task is time-consuming, and the level of congestion mitigation heavily relies on individual expertise in engineering practice. Therefore, it is cost-effective to learn traffic engineers’ knowledge to enhance the problem-solving skills for a large-scale urban traffic network. In this paper, a data augmented deep behavioral cloning (DADBC) method is proposed to imitate the problem-solving skills of traffic engineers. The method is under a conceptual framework, parallel learning (PL) framework, that incorporates machine learning techniques for solving decision-making problems in complex systems. The DADBC method enhances a hybrid demonstration by exploiting a generative adversarial network (GAN) and then uses the deep behavioral cloning (DBC) model to learn traffic engineers’ control schemes. According to the validation results using the real manipulation data from Hangzhou, China, our method can imitate complex human behaviors in intervening traffic signal control operations to improve traffic efficiency in urban areas.
Xiaoshuang Li, Peijun Ye 0001, Junchen Jin, Fenghua Zhu, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.4
2022 Fine-Grained Vessel Traffic Flow Prediction With a Spatio-Temporal Multigraph Convolutional Network
abstract
The accurate and robust prediction of vessel traffic flow is gaining importance in maritime intelligent transportation system (ITS), such as vessel traffic services, maritime spatial planning, and traffic safety management, etc. To achieve fine-grained vessel traffic flow prediction, we will first generate the maritime traffic network (which is essentially a graph), and then propose a graph-driven neural network. In particular, to represent various correlations among spatio-temporal vessel traffic flow, we tend to extract the feature points (i.e., starting, way and ending points) by utilizing the knowledge of vessel positioning data. These feature points are essentially related to the geometrical structures of massive vessel trajectories collected from massive automatic identification system (AIS) records, contributing to the generation of maritime traffic network. We then propose a spatio-temporal multi-graph convolutional network (STMGCN)-based vessel traffic flow prediction method by exploiting multiple types of inherent correlations in the generated maritime graph. The proposed STMGCN mainly contains one spatial multi-graph convolutional layer and two temporal gated convolutional layers, beneficial for extracting spatial and temporal traffic flow patterns. The main benefit of our graph-driven prediction method is that it takes full advantage of the maritime graph and multi-graph learning. Comprehensive experiments have been implemented on realistic AIS dataset to compare our method with several state-of-the-art prediction methods. The fine-grained prediction results have demonstrated our superior performance in terms of both accuracy and robustness.
Maohan Liang, Ryan Wen Liu, Yang Zhan 0007, Huanhuan Li 0001, Fenghua Zhu, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.5
2022 HMDRL: Hierarchical Mixed Deep Reinforcement Learning to Balance Vehicle Supply and Demand
abstract
The imbalance of vehicle supply and demand is a common phenomenon that influences the efficiency of online ride-hailing systems greatly. To address this problem, a three-level hierarchical mixed deep reinforcement learning method (HMDRL) is proposed to reposition idle vehicles. A manager operates at the top level, where action-abstraction is conducted from the time dimension and is adaptive for spatially scalable and time-varying systems. Coordinators locate at the middle level and a parallel coordination mechanism that is independent of the decision order is designed to improve the efficiency of the repositioning. The bottom level is composed of executive workers to reposition vehicles with mixed states and the states contain spatiotemporal information of agents’ neighbor areas. Two reward functions are designed for the manager and the coordinators, respectively, aiming to improve the training effect by avoiding sparse rewards. A simulator based on real orders is designed and HMDRL is compared with six methods. Experimental results demonstrate that HMDRL outperforms all the other methods. In three comparison experiments, the order response rate is increased by 0.62% to 8.29%, 1.5% to 7.78%, 1.18% to 4.75%, respectively.
Jinhao Xi, Fenghua Zhu, Peijun Ye 0001, Haina Tang, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.2
2022 MLRNN: Taxi Demand Prediction Based on Multi-Level Deep Learning and Regional Heterogeneity Analysis
abstract
Taxi demand prediction is valuable for the decision-making of online taxi-hailing platforms. Data-driven deep learning approaches have been widely utilized in this area, and many complex spatiotemporal characteristics of taxi demand have been studied. However, the heterogeneity of demand patterns among different taxi zones has not been taken into account. To this end, this paper explores zone clustering and how to utilize the inter-zone heterogeneity to improve the prediction. First, based on the pairwise clustering theory, a taxi zone clustering algorithm is designed by considering the correlations among different taxi zones. Then, both the cluster-level and the global-level prediction modules are developed to extract intra- and inter-cluster characteristics, respectively. Finally, a Multi-Level Recurrent Neural Networks (MLRNN) model is proposed by combining the two modules. Experiments on two taxi trip records datasets from New York City demonstrate that our model improves the prediction accuracy compared with other state-of-the-art methods.
Chizhan Zhang, Fenghua Zhu, Peijun Ye 0001, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.2
2022 Taxi Demand Prediction Using Parallel Multi-Task Learning Model
abstract
Accurate and real-time taxi demand prediction can help managers pre-allocate taxi resources in cities, which assists drivers quickly finding passengers and reduce passengers’ waiting time. Most of the existing studies focus on mining spatial-temporal characteristics of taxi demand distributions, while lacking in modeling the correlations between taxi pick-up demand and the drop-off demand from the perspective of multi-task learning. In this article, we propose a multi-task learning model containing three parallel LSTM layers to co-predict taxi pick-up and drop-off demands, and compare the performance of single demand prediction methodology and that of two demands’ co-prediction methodology. Experimental results on real-world datasets demonstrate that the pick-up demand and the drop-off demand do depend on each other, and the effectiveness of the proposed co-prediction methods.
Chizhan Zhang, Fenghua Zhu, Xiao Wang 0002, Leilei Sun, Haina Tang
IEEE Trans. Intell. Transp. Syst.2
2021 SCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation
abstract
How to learn effective features from large-scale point clouds for semantic segmentation has attracted increasing attention in recent years. Addressing this problem, we propose a learnable module that learns Spatial Contextual Features from large-scale point clouds, called SCF in this paper. The proposed module mainly consists of three blocks, including the local polar representation block, the dual-distance attentive pooling block, and the global contextual feature block. For each 3D point, the local polar representation block is firstly explored to construct a spatial representation that is invariant to the z-axis rotation, then the dual-distance attentive pooling block is designed to utilize the representations of its neighbors for learning more discriminative local features according to both the geometric and feature distances among them, and finally, the global contextual feature block is designed to learn a global context for each 3D point by utilizing its spatial location and the volume ratio of the neighborhood to the global point cloud. The proposed module could be easily embedded into various network architectures for point cloud segmentation, naturally resulting in a new 3D semantic segmentation network with an encoder-decoder architecture, called SCF-Net in this work. Extensive experimental results on two public datasets demonstrate that the proposed SCF-Net performs better than several state-of-the-art methods in most cases.
Siqi Fan 0002, Qiulei Dong, Fenghua Zhu, Peijun Ye 0001, Fei-Yue Wang 0001
CVPR3
2020 Consistent Population Synthesis With Multi-Social Relationships Based on Tensor Decomposition
abstract
Social relationships have a strong influence on individual travel behavior and, consequently, on travel demand. However, most current literatures on population synthesis, which is the fundamental building block of disaggregated travel demand forecasting and agent-based traffic simulation, only considers the household impact. This paper makes two contributions in this regard. First, a methodological issue is identified: the existence of multiple social relationships (e.g., a dual set of constraints from social institutions or structures) makes it more difficult to generate a consistent synthetic population, meaning that this population satisfies constraints from more than one type of social organizations. A tensor decomposition method is then proposed to generate a consistent population with multi-social relationships. To our knowledge, this is the first time that this type of methodological issue has been addressed. Our sample-based method constitutes an improvement compared to existing approaches in that it can respect constraints from multiple social organizations without reducing accuracy. A numerical test concerning individual, household, and enterprise, using Chinese national population and economic census data, indicates that the new method can lead to stable and relatively small errors in total. The source code is available from https://github.com/PeijunYe/MulSocPopSyn.git.
Peijun Ye 0001, Fenghua Zhu, Samer Sabri, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.2
2020 Parallel Transportation Systems: Toward IoT-Enabled Smart Urban Traffic Control and Management
abstract
IoT-driven intelligent transportation systems (ITS) have great potential and capacity to make transportation systems efficient, safe, smart, reliable, and sustainable. The IoT provides the access and driving forces of seamlessly integrating transportation systems from the physical world to the virtual counterparts in the cyber world. In this paper, we present visions and works on integrating the artificial intelligent transportation systems and the real intelligent transportation systems to create and enhance “intelligence” of IoT-enabled ITS. With the increasing ubiquitous and deep sensing capacity of IoT-enabled ITS, we can quickly create artificial transportation systems equivalent to physical transportation systems in computers, and thus have parallel intelligent transportation systems, i.e. the real intelligent transportation systems and artificial intelligent transportation systems. The evolution process of transportation system is studied in the view of the parallel world. We can use a large number of long-term iterative simulation to predict and analyze the expected results of operations. Thus, truly effective and smart ITS can be planned, designed, built, operated and used. The foundation of the parallel intelligent transportation systems is based on the ACP theory, which is composed of artificial societies, computational experiments, and parallel execution. We also present some case studies to demonstrate the effectiveness of parallel transportation systems.
Fenghua Zhu, Yuanyuan Chen 0003, Xiao Wang 0002, Gang Xiong 0001, Fei-Yue Wang 0001
IEEE Trans. Intell. Transp. Syst.1
2018 Autonomous RC-Car for Education Purpose in iSTEM Projects
abstract
Software simulation and real environment running parallel execution is a lately proposed method, which also provides full coverage and convenience to accomplish autonomous driving education purpose. This paper introduces a new high-school iSTEM program of autonomous vehicles education. This program uses a Scaled RC-Car platform with several sensors and Raspberry Pi embedded platform, to build an autonomous driving car in scaled indoor simulation environment. The RC-Car is capable of safely autonomous driving. Many existing algorithms are put together to provide the necessary functions of autonomous driving, such lane detection, obstacle detection, lane following, vehicle control etc. In this paper, we provide the details of this program, hardware and software components of the RC-Car, Deep learning end-to-end approaching of algorithm deployment, and future works.
WeiHang Feng, Yun Pei 0001, Bin Hai, Wuling Huang, Xiaoyan Gong, Fenghua Zhu
Intelligent Vehicles Symposium6
2018 Cyber-Physical-Social Systems: The State of the Art and Perspectives
abstract
This paper is to discuss the state, trend, and frontiers of development of cyber-physical-social systems (CPSSs) in China. The demand for developing CPSS is discussed in detail, followed by the Artificial societies, Computational experiments, Parallel execution (ACP) approach for CPSS and knowledge automation. The development of ACP based on CPSS in transportation, energy, information, Internet of Things, and Internet of Minds (IoM) is discussed to demonstrate the cutting-edge applications in CPSS. Finally, the blockchainized IoM technology and the concepts of parallel society are described. This paper will contribute to the transition from the current social construct to a futuristic intelligent society.
Jun Jason Zhang, Fei-Yue Wang 0001, Xiao Wang 0002, Gang Xiong 0001, Fenghua Zhu, Jiachen Hou, Shuangshuang Han, Yong Yuan 0003, Qingchun Lu, Yishi Lee
IEEE Trans. Comput. Soc. Syst.5
2017 A Parallel Transportation Management and Control System for Bus Rapid Transit Using the ACP Approach
abstract
Bus rapid transit (BRT) has been proved to be an effective tool to improve mass transit services. However, BRT's adaptive operations like management and scheduling under different scenarios are too complicated to implement using traditional methods. The ACP approach, which is based on holism and complex system theory and consists of artificial systems (A), computational experiments (C) and parallel execution (P), offers an efficient new method to cope with these complex systems, including BRT. In this paper, the parallel transportation management and control system for BRT (PTMS-BRT) is presented, which is designed and implemented using the ACP approach. PTMS-BRT integrates such functions as BRT's monitoring, warning, forecasting, incident management, and real-time scheduling, to provide its operations smoother, safer, more efficient, and reliable. It has been piloted successfully in Guangzhou BRT to demonstrate it as another successful example of parallel transportation systems.
Xisong Dong, Yuetong Lin, Dayong Shen, Zhengxi Li, Fenghua Zhu, Bin Hu 0010, Dong Fan, Gang Xiong 0001
IEEE Trans. Intell. Transp. Syst.5
2017 Parallel Transportation Management and Control System for Subways
abstract
The subway's daily management and control are too complicated to be handled by using traditional methods. Based on the artificial systems, computational experiments, and parallel execution (ACP) approach, the Parallel Transportation Management and Control System for Subways (PTMS -Subway) is proposed. First, the dynamic status perception and management platform for subways (SPMP-Subway) is constructed, and artificial subway systems (ASS) are designed and constructed, and then they are validated by the real-time data from SPMP-Subway. Then, the design content and construction process of computational experiments platform are performed. Finally, through the interactions of parallel execution system between actual subway and its ASS, a set of practical management and control algorithms can be validated and improved. PTMS-Subway can implement those advanced functions, such as real-time monitoring, warning, forecasting, scheduling optimization, incidence management, and so on, to improve its reliability, efficiency, safety, and service level. SPMP-Subway and PTMS-Subway have been piloted in Subway Lines 1 and 2 in Suzhou, China, and achieved the expected results and benefits successfully.
Gang Xiong 0001, Dayong Shen, Xisong Dong, Bin Hu 0010, Dong Fan, Fenghua Zhu
IEEE Trans. Intell. Transp. Syst.6
2016 Parallel Transportation Management and Control System and Its Applications in Building Smart Cities
abstract
Advancements in complexity, complex systems, and the intelligence sciences, particularly smart city technologies, have shown great potential in aiding to ease traffic congestion. The overall approach and the main ideas in building smart transportation for smart cities, particularly ACP (artificial system, computational experiment, and parallel execution)-based parallel transportation management and control systems (PTMS), are presented. PTMS can be expanded to the new generation of intelligent transportation systems. The main components of the proposed architecture include social signal and social traffic, ITS clouds and services, agent-based traffic control, and transportation knowledge automation. Some technical details of these components are discussed. Finally, one case study is introduced, and the effectiveness is analyzed.
Fenghua Zhu, Songhang Chen, Gang Xiong 0001
IEEE Trans. Intell. Transp. Syst.1
2014 Growing Spatially Embedded Social Networks for Activity-Travel Analysis Based on Artificial Transportation Systems
abstract
Social activity-travel has gained more and more attention as it is a growing percentage of the whole travel. To study its generation mechanism and behavioral characteristics, social network data are usually essential. However, due to individual privacy, it is rather difficult for traditional methods such as questionnaires to collect abundant reliable data. Therefore, we propose a novel method to grow realistic social networks based on artificial transportation systems (ATS). By incorporating the activity-travel simulation provided by ATS and a new agent-based model for social interaction, the method takes into account human mobility to generate spatially embedded social networks. Human mobility shapes and impacts social networks dynamically but is usually ignored by related studies. A case study based on computational experiments is carried out to verify the method. The results indicate that the method can generate social networks with similar topological and spatial characteristics to real social networks.
Songhang Chen, Fenghua Zhu, Jianping Cao
IEEE Trans. Intell. Transp. Syst.2
2014 Parallel Public Transportation System and Its Application in Evaluating Evacuation Plans for Large-Scale Activities
abstract
This paper proposes a method based on the Artificial societies, computational experiments, and Parallel execution (ACP) approach to build parallel public transportation systems (PPTSs). The framework and components of a PPTS are analyzed, and some details for building the PPTS are discussed. One prototype based on intelligent traffic clouds is established. One specific PPTS is developed for the Guangzhou 2010 Asian Games in the case study, and its effectiveness is verified through the evaluation of two evacuation plans for the Asian Games.
Fenghua Zhu, Songhang Chen, Zhi-Hong Mao, Qinghai Miao
IEEE Trans. Intell. Transp. Syst.1
2013 UTN-Model-Based Traffic Flow Prediction for Parallel-Transportation Management Systems
abstract
Aiming to comply with the requirement of parallel-transportation management systems (PtMS), this paper presents a short-term traffic flow prediction method for signal-controlled urban traffic networks (UTNs) based on the macroscopic UTN model. In contrast with other time-series-based or spatio-temporal correlation methods, the proposed method focuses more on using the substantial mechanism of traffic transmission in road networks and the topology model of the entire UTN. Furthermore, this approach employs a speed-density model based on the fundamental diagram (FD) to obtain more accurate travel times in links. In the comparison experiment, the microscopic traffic simulation software CORSIM is adopted to simulate the real urban traffic. The experiment results fully verify the outstanding performances of the proposed prediction method.
Qing-Jie Kong, Yanyan Xu 0002, Shu Lin 0002, Ding Wen, Fenghua Zhu, Yuncai Liu
IEEE Trans. Intell. Transp. Syst.5
2013 Parallel Traffic Management System and Its Application to the 2010 Asian Games
abstract
Field data are important for convenient daily travel of urban residents, reducing traffic congestion and accidents, pursuing a low-carbon environment-friendly sustainable development strategy, and meeting the extra peak traffic demand of large sporting events or large business activities, etc. To meet the field data demand during the 2010 Asian (Para) Games held in Guangzhou, China, based on the novel Artificial systems, Computational experiments, and Parallel execution (ACP) approach, the Parallel Traffic Management System (PtMS) was developed. It successfully helps to achieve smoothness, safety, efficiency, and reliability of public transport management during the two games, supports public traffic management and decision making, and helps enhance the public traffic management level from experience-based policy formulation and manual implementation to scientific computing-based policy formulation and implementation. The PtMS represents another new milestone in solving the management difficulty of real-world complex systems.
Gang Xiong 0001, Xisong Dong, Dong Fan, Fenghua Zhu, Kunfeng Wang
IEEE Trans. Intell. Transp. Syst.4
2013 Computational Traffic Experiments Based on Artificial Transportation Systems: An Application of ACP Approach
abstract
The Artificial societies, Computational experiments, and Parallel execution (ACP) approach provides us an opportunity to look into new methods that address transportation problems from new perspectives. In this paper, we present our work and results of applying the ACP approach on modeling and analyzing transportation systems, particularly carrying out computational experiments based on artificial transportation systems (ATSs). Two aspects in the modeling process are analyzed. The first is growing an ATS from the bottom up using agent-based technologies. The second is modeling environmental impacts under the principle of “simple is consistent.” Finally, three computational experiments are carried out on one specific ATS, i.e., Jinan-ATS, and numerical results are presented to illustrate the applications of our method.
Fenghua Zhu, Ding Wen, Songhang Chen
IEEE Trans. Intell. Transp. Syst.1
2011 A Game-Engine-Based Platform for Modeling and Computing Artificial Transportation Systems
abstract
A game-engine-based modeling and computing platform for artificial transportation systems (ATSs) is introduced. As an important feature, the artificial-population module (APM) is described in both its macroscopic and microcosmic aspects. In this module, each person is designed similarly to the actors in games. The traffic-simulation module (TSM) is another important module, which takes advantage of Delta3D to construct a 3-D simulation environment. All mobile actors are also managed by this module with the help of the dynamic-actor-layer (DAL) mechanism that is offered by Delta3D. The platform is designed as agent-oriented, modularized, and distributed. Both modules, together with components that are responsible for message processing, rules, network, and interactions, are organized by the game manager (GM) in a flexible architecture. With the help of the network component, the platform can be constructed to implement a distributed simulation. Finally, four experiments are introduced to show functions and features of the platform.
Qinghai Miao, Fenghua Zhu, Changjian Cheng, Xiaogang Qiu
IEEE Trans. Intell. Transp. Syst.2
2011 A Case Study of Evaluating Traffic Signal Control Systems Using Computational Experiments
abstract
A new traffic signal control system (TSCS) evaluation method that uses computational experiments based on artificial transportation systems (ATSs) is proposed in this paper. Some basic ideas of the method are discussed, i.e., generating reasonable travel demand, modeling the influence of environment, and designing communication interface. Using a 30-day computational experiment on ATSs, a case study is carried out to evaluate three TSCSs, which are implemented using fixed-time (FT), queue-based responsive (QBR), and adaptive dynamic program (ADP) algorithms, respectively. Aside from normal weather, three types of adverse weather, i.e., rain, wind, and fog, are modeled in the computational experiment. After analyzing aggregate data and detailed operating record, reliable evaluation results are obtained from this case study. Furthermore, several interesting phenomena are observed in this case study, which have yet to be noticed by previous work.
Fenghua Zhu, Guoxi Li, Ding Wen
IEEE Trans. Intell. Transp. Syst.1