Maritime traffic analysis plays a vital role in port operations and logistics coordination. Although Automatic Identification System (AIS) provides rich vessel movement data, analyzing port-to-port traffic remains challenging due to data heterogeneity and missing trajectory segments. We present PortVIS, a web-based interactive system that supports the comprehensive analysis and visualization of maritime traffic. PortVIS integrates multi-sourced datasets—including AIS records, port and anchorage metadata, and wind field data—to enable trajectory segmentation, regional analysis, and data imputation. Users can import raw AIS records and segment them into port-to-port trips using our system. These segmented trajectories can then be filtered and queried based on vessel information and trip attributes. Users can also define custom zones (e.g., anchorages or transit areas) and explore traffic patterns through maps and charts. Missing trajectory segments are reconstructed using our recent imputation approach to improve data quality. By integrating trajectory processing and various visual analytics, PortVIS provides a unified tool for maritime mobility analysis.

Large-scale human mobility data (e.g. GPS data) encodes valuable information interested by various fields. Extracting stay and movement behaviors from noisy positioning record sequences is a critical preliminary step to utilize human mobility data. For the past two decades, this processing has been founded on a simple intuition proposed by Hariharan and Zheng et al.[18, 48], which uses manually selected parameters to make recursive, rule-based classification as to whether data points in a positioning record sequence constitute noise, move, or stay. This de facto processing approach, despite its simplicity, is inherently sensitive to parameter choice and suffers from the low efficiency of sequential processing. These inherent limitations make it practically infeasible, when confronted with the large-scale, fine-grained human mobility datasets in industry. To address this fundamental problem in human mobility data utilization, we innotatively rethink the distinction in representation patterns of noise/stay/move within the positioning record sequence from the lens of topological persistence, culminating in a novel pipeline for robust and efficient human mobility data processing. This is grounded in our empirical observation that topological persistence features of stay/move/noise exhibit robust and generalizable discriminability across variations in parameter choice, individuals, and geographical regions. By introducing the Laplacian to simplify the computation of topological persistence features, our processing pipeline is capable to exploit GPUs' parallel capacity for efficient processing. Experiments on real-world GPS datasets totaling up to thousand billion data points demonstrate that our method produces processing results comparable to those of human annotators, while requiring only 10% of the time consumed by previous approaches. We further show that our method is scalable for cumulative data volume and remains effective in identifying stay/move behaviors that traditional techniques consistently fail to handle, even under conditions of severe positioning errors and diverse behavioral patterns.

Large-scale human mobility exhibits spatial and temporal patterns that can assist policymakers in decision making. Although traditional prediction models attempt to capture these patterns, they are often affected by nonperiodic public events, such as disasters and occasional celebrations. Since regular human mobility patterns are affected by these events, estimating their causal effects is critical to accurate mobility predictions. News articles provide unique perspectives on these events, though processing them is a challenge. In this study, we propose a causality based prediction model, CausalMob, to analyze the causal effects of public events. We first utilize large language models (LLMs) to extract human intentions from news and transform them into features that act as causal treatments. Next, the model learns representations of spatio-temporal regional covariates from multiple data sources to serve as confounders for causal inference. Finally, we present a causal effect estimation framework to ensure that event features remain independent of confounders during prediction. Based on large-scale real-world data, the experimental results show that the proposed model excels in human mobility prediction, outperforming state-of-the-art models.

Trajectory representation learning (TRL) maps trajectories to vector embeddings and facilitates tasks such as trajectory classification and similarity search. State-of-the-art (SOTA) TRL methods transform raw GPS trajectories to grid or road trajectories to capture high-level travel semantics, i.e., regions and roads. However, they lose fine-grained spatial-temporal details as multiple GPS points are grouped into a single grid cell or road segment. To tackle this problem, we propose the BLU rred Encoding method, dubbed BLUE, which gradually reduces the precision of GPS coordinates to create hierarchical patches with multiple levels. The low-level patches are small and preserve fine-grained spatial-temporal details, while the high-level patches are large and capture overall travel patterns. To complement different patch levels with each other, our BLUE is an encoder-decoder model with a pyramid structure. At each patch level, a Transformer is used to learn the trajectory embedding at the current level, while pooling prepares inputs for the higher level in the encoder, and up-resolution provides guidance for the lower level in the decoder. BLUE is trained using the trajectory reconstruction task with the MSE loss. We compare BLUE with 8 SOTA TRL methods for 3 downstream tasks, the results show that BLUE consistently achieves higher accuracy than all baselines, outperforming the best-performing baselines by an average of 30.90%. Our code is available at https://github.com/slzhou-xy/BLUE.

Analyzing the causal impact of various government-related policies on the epidemic spread is of critical importance. This article aims to investigate the problem of assessing the causal effects of different COVID-19-related policies on the USA epidemic spread in different counties at any given time period, while eliminating biased interference from unobserved confounders (e.g., the vigilance of residents). However, the infection outcome of each region is influenced not only by its own confounding factors but also by policy interventions implemented in neighboring regions. Furthermore, the government policy index may exhibit a time-delay influence on outbreak dynamics. To this end, we implement observational data about different COVID-19-related policies (treatment) and outbreak dynamics (outcome) across different U.S. counties over time and develop a causal framework that learns the representations of time-varying confounders to tackle the aforementioned issues. More specifically, we employ one recurrent structure to capture the accumulative effects stemming from the policy history and then utilize hypergraph neural network to model the interactions among spatial regions. Our experimental results demonstrate the effectiveness of the proposed framework in quantifying the causal impact of different policy types on epidemics. Compared with baseline methods, our assessment provides valuable insights for future policy-making endeavors.

Maritime transportation, vital for nearly 90% of global trade, necessitates precise vessel trajectory prediction for safety and efficiency. Although the Automatic Identification System (AIS) provides a comprehensive data source, how to model these multi-modal and heterogeneous time-varying sequences (such as vessels’ kinetic information and ocean weather factors) poses a formidable challenge. Moreover, most existing approaches are limited by the confined scope of vessel trajectory modeling, making it impossible to consider the unique characteristics of maritime transportation system. To tackle these challenges, we propose a novel framework called AISFuser to i) encode unique maritime traffic network into graphical representations, and ii) introduce the heterogeneity into multi-modal temporal embeddings through Self-Supervised Learning (SSL). Specifically, our AISFuser is constructed by combining an attention-based graph block with a transformer network to encode information across space and time, respectively. In terms of temporal dimension, one SSL auxiliary task is also designed to enhance the heterogeneity of temporal representations and supplement the main vessel prediction task. We validate the effectiveness of the proposed AISFuser on a real-world AIS dataset. Extensive experimental results demonstrate that our method can forecast multiple attributes of vessel trajectory for over 10 hours into the future, outperforming competitive baselines.

Maritime traffic management increasingly relies on vessel position information provided by terrestrial and satellite networks of the Automatic Identification System (AIS). Unfortunately, the problem of missing AIS data can lead to long-term gaps in vessel trajectory, raising corresponding security concerns regarding collision risks and illicit activities. Existing imputation approaches are often constrained by vehicle-based low-sampling trajectories, hindering their ability to address unique characteristics of maritime transportation systems and long-term missing scenarios. To tackle these challenges, we propose a novel generative framework for long-term vessel trajectory imputation. Our framework considers irregular tracks of vessels, which differ from those of cars due to the absence of a structured road network, and ensures the continuity of multi-point imputed trajectories. Specifically, we first utilize a pre-trained trajectory embedding block to capture patterns of vessel movements. Subsequently, we introduce a diffusion-based model for generating missing trajectories, where observed trajectory modeling with transformer encoding architecture and embeddings of both historical vessel trajectory and external factors serve as conditional information. In particular, we design a physics-guided discriminator in the training stage, which imposes kinematic constraints between locations and angles to improve the continuity of the imputed trajectories. Comprehensive experiments and analysis on a real-world AIS dataset confirm the effectiveness of our proposed approach.

Urban time series data forecasting featuring significant contributions to sustainable development is widely studied as an essential task of the smart city. However, with the dramatic and rapid changes in the world environment, the assumption that data obey Independent Identically Distribution is undermined by the subsequent changes in data distribution, known as concept drift, leading to weak replicability and transferability of the model over unseen data. To address the issue, previous approaches typically retrain the model, forcing it to fit the most recent observed data. However, retraining is problematic in that it leads to model lag, consumption of resources, and model re-invalidation, causing the drift problem to be not well solved in realistic scenarios. In this study, we propose a new urban time series prediction model for the concept drift problem, which encodes the drift by considering the periodicity in the data and makes on-the-fly adjustments to the model based on the drift using a meta-dynamic network. Experiments on real-world datasets show that our design significantly outperforms state-of-the-art methods and can be well generalized to existing prediction backbones by reducing their sensitivity to distribution changes.

To understand human mobility following the typhoon, analyzing the causal impact of extreme typhoon weather on human mobility is important for disaster emergency management. However, the unobserved confounders (e.g., the characteristic of each region) correlate with the strength of typhoon weather and also affect human mobility during typhoon, which may generate biased influences on the causal analysis process. Besides, these confounders may be time-varying following the dynamic movements of typhoon. In this work, we develop a neural network-based continuous causal effect estimation framework to mitigate the interference from (unobserved) confounders and assess the continuous causal responses of typhoon-related weather (treatment) on several types of human mobility (outcome) across different counties at any given period. To this end, we integrate the big data from two huge typhoons in Japan (i.e., Typhoon Faxai and Hagibis) and leverage multiple sources of covariates (i.e., residents' vigilance and basic mobility patterns) from different counties to learn the representations of time-varying confounders. The experimental results indicate the effectiveness of our proposed framework in capturing the confounders for quantifying the causal impact of extreme weather during the typhoon process, compared with several existing causal studies.

Today, thanks to the rapid developing mobile and sensor networks in IoT (Internet of Things) systems, spatio-temporal big data are being constantly generated. They have brought us a data-driven possibility to sense and understand crowd mobility on a city scale. A fundamental task towards the next-generation mobility services, such as Intelligent Transportation Systems (ITS), Mobility-as-a-Service (MaaS), is spatio-temporal predictive modeling of the geo-sensory signals. There is a recent line of research leveraging deep learning techniques to boost the forecasting performance on such tasks. While simulating the regularity of mobility behaviors (e.g., routines, periodicity) in a more sophisticated way, the existing studies ignore an important part of urban activities, i.e., events. Including holidays, extreme weathers, pandemic, accidents, various urban events happen from time to time and cause non-stationary phenomena, which by nature make the spatio-temporal forecasting task challenging. We thereby envision an event-aware urban mobility prediction model that is capable of fast adapting and making reliable predictions in different scenarios, which is crucial to decision making towards emergency response and urban resilience.

Mobility digital twin, which is a a virtual replica of the mobility in the physical world, is the key building block of modern smart city applications at a metropolitan scale, including traffic regulation, emergency management and epidemic control. To duplicate the mobility in the physical world and show the potential outcome based on either the current state or manipulated conditions, we are facing with three main challenges: 1) how to sense real-time human mobility at a large scale and assimilate different data sources to infer a dynamic city mobility state; 2) how to make an accurate prediction for the mobility replica that adapts with dynamic city mobility state; 3) how to simulate the mobility in response to different conditions. In this talk, we will present our recent studies, practices and perspectives on mobility digital twin in addressing these above challenges, with applications in the real-world scenarios with industrial connections.

Human mobility nowcasting is a fundamental research problem for intelligent transportation planning, disaster responses and management, etc. In particular, human mobility under big disasters such as hurricanes and pandemics deviates from its daily routine to a large extent, which makes the task more challenging. Existing works mainly focus on traffic or crowd flow prediction in normal situations. To tackle this problem, in this study, disaster-related Twitter data is incorporated as a covariate to understand the public awareness and attention about the disaster events and thus perceive their impacts on the human mobility. Accordingly, we propose a Meta-knowledge-Memorizable Spatio-Temporal Network (MemeSTN), which leverages memory network and meta-learning to fuse social media and human mobility data. Extensive experiments over three real-world disasters including Japan 2019 typhoon season, Japan 2020 COVID-19 pandemic, and US 2019 hurricane season were conducted to illustrate the effectiveness of our proposed solution. Compared to the state-of-the-art spatio-temporal deep models and multivariate-time-series deep models, our model can achieve superior performance for nowcasting human mobility in disaster situations at both country level and state level.

Predicting the density and flow of the crowd or traffic at a citywide level becomes possible by using the big data and cutting-edge AI technologies. It has been a very significant research topic with high social impact, which can be widely applied to emergency management, traffic regulation, and urban planning. In particular, by meshing a large urban area to a number of fine-grained mesh-grids, citywide crowd and traffic information in a continuous time period can be represented with 4D tensor (Timestep, Height, Width, Channel). Based on this idea, a series of methods have been proposed to address grid-based prediction for citywide crowd and traffic. In this study, we revisit the density and in-out flow prediction problem and publish a new aggregated human mobility dataset generated from a real-world smartphone application. Comparing with the existing ones, our dataset holds several advantages including large mesh-grid number, fine-grained mesh size, and high user sample. Towards this large-scale crowd dataset, we propose a novel deep learning model called DeepCrowd by designing pyramid architectures and high-dimensional attention mechanism based on Convolutional LSTM. Lastly, thorough and comprehensive performance evaluations are conducted to demonstrate the superiority of the proposed DeepCrowd comparing to multiple state-of-the-art methods.

Travel time estimation from GPS trips is of great importance to order duration, ridesharing, taxi dispatching, etc. However, the dense trajectory is not always available due to the limitation of data privacy and acquisition, while the origin-destination (OD) type of data, such as NYC taxi data, NYC bike data, and Capital Bikeshare data, is more accessible. To address this issue, this paper starts to estimate the OD trips travel time combined with the road network. Subsequently, aMulti-taskWeaklySupervisedLearning Framework forTravelTimeEstimation (MWSL-TTE) has been proposed to infer transition probability between roads segments, and the travel time on road segments and intersection simultaneously. Technically, given an OD pair, the transition probability intends to recover the most possible route. And then, the output of travel time is equal to the summation of all segments’ and intersections’ travel time in this route. A novel route recovery function has been proposed to iteratively maximize the current routes’ co-occurrence probability, and minimize the discrepancy between routes’ probability distribution and the inverse distribution of routes’ estimation loss. Moreover, the expected log-likelihood function based on a weakly-supervised framework has been deployed in optimizing the travel time from road segments and intersections concurrently. We conduct experiments on a wide range of real-world taxi datasets in Xi’an and Chengdu and demonstrate our method's effectiveness on route recovery and travel time estimation.

Citywide crowd prediction can be of great importance for emergency management, traffic regulation, and urban planning. By meshing a large urban area to a number of fine-grained mesh-grids as illustrated in Fig. 1 , citywide crowd in a continuous time period can be represented with a four-dimensional tensor ${\mathbb{R}^{Timestep{\text{ }}p \times {\text{ }}Height{\text{ }} \times {\text{ }}Width{\text{ }} \times {\text{ }}Channel{\text{ }}}}$ in an analogous manner to video data, where each Timestep can be seen as one video frame, Height , Width is two-dimensional index for mesh-grids, and each Channel stores an aggregated scalar value for each mesh-grid. Specifically, given historical observations of crowd density and in-out flow x d = d 1 ,…,d t , xf = f 1 ,…, f t at timestamp t , we aim to build prediction models for the next-step density and in-out flow y d = d t +1, yf = f t +1, where y d means how many people will be in each mesh-grid at the next timestamp, and yf means how many people will flow into or out from each mesh-grid in next time interval. Al-though many deep models [1] – [6] have been proposed to address such tasks, their actual effects are still not well validated on large-scale and high-quality datasets. The datasets used in most of the works so far are originally generated based on taxi or bicycle trip data, which don’t cover and reflect the citywide crowd density and flow. Thus, we first publish new crowd flow data called BousaiTYO and BousaiOSA [7] . These new datasets are created using the GPS log data collected from a popular smartphone app of Yahoo! Japan Corporation, which can well reflect the real-world crowd flow in Tokyo and Osaka. As shown by Table 1 , our dataset has: (1) larger spatial area; (2) finer mesh size; (3) higher user sample.

Finding out similar regions between cities is important to a variety of real-world applications, such as point-of-interest recommendations, site selection, and travel guidance. With the help of the increasing number of location-based social network users, we can measure the intercity similarity from a new perspective of spatiotemporal characteristics of human mobility. In this paper, we developed an interactive intercity regional similarity explorer (IRSE) that 1) visualizes regional spatiotemporal human mobility features, 2) searches similar region candidates in the target city, and 3) explores the regional similarity from different views in a quantitative and illustrative way. In this paper, we show how our system can be useful in exploring regional similarity across cities in the world by use cases, which will interest various users from different countries in the demonstration session. Demo available at: https://bit.ly/3OjwnGu

Knowing "what is happening" and "what will happen" of the mobility in a city is the building block of a data-driven smart city system. In recent years, mobility digital twin that makes a virtual replication of human mobility and predicting or simulating the fine-grained movements of the subjects in a virtual space at a metropolitan scale in near real-time has shown its great potential in modern urban intelligent systems. However, few studies have provided practical solutions. The main difficulties are four-folds: 1) the daily variation of human mobility is hard to model and predict; 2) the transportation network enforces a complex constraints on human mobility; 3) generating a rational fine-grained human trajectory is challenging for existing machine learning models; and 4) making a fine-grained prediction incurs high computational costs, which is challenging for an online system. Bearing these difficulties in mind, in this paper we propose a two-stage human mobility predictor that stratifies the coarse and fine-grained level predictions. In the first stage, to encode the daily variation of human mobility at a metropolitan level, we automatically extract citywide mobility trends as crowd contexts and predict long-term and long-distance movements at a coarse level. In the second stage, the coarse predictions are resolved to a fine-grained level via a probabilistic trajectory retrieval method, which offloads most of the heavy computations to the offline phase. We tested our method using a real-world mobile phone GPS dataset in the Kanto area in Japan, and achieved good prediction accuracy and a time efficiency of about 2 min in predicting future 1h movements of about 220K mobile phone users on a single machine to support more higher-level analysis of mobility prediction.

Predicting the density and flow of the crowd at a citywide level is significant for city management. By meshing a large urban area to a number of fine-grained mesh-grids, citywide crowd and traffic information in a continuous time period can be represented with 4D tensor (Timestep, Height, Width, Channel). Based on this, we revisit the density and in-out flow prediction problem and publish a new aggregated human mobility dataset generated from a real-world smartphone application. Compared with the existing ones, our dataset has larger mesh-grid number, finer-grained mesh size, and higher user sample. Towards such kind of large-scale crowd dataset, we propose a novel deep learning model called DeepCrowd by designing pyramid architectures and high-dimensional attention mechanism based on Convolutional LSTM. Both the datasets and codes are made available at https://github.com/deepkashiwa20/DeepCrowd.

Event crowd management has been a significant research topic with high social impact. When some big events happen such as an earthquake, typhoon, and national festival, crowd management becomes the first priority for governments (e.g., police) and public service operators (e.g., subway/bus operator) to protect people’s safety or maintain the operation of public infrastructures. However, under such event situations, human behavior will become very different from daily routines, which makes prediction of crowd dynamics at big events become highly challenging, especially at a citywide level. Therefore in this study, we aim to extract the “deep” trend only from the current momentary observations and generate an accurate prediction for the trend in the short future, which is considered to be an effective way to deal with the event situations. Motivated by these, we build an online system called DeepUrbanEvent, which can iteratively take citywide crowd dynamics from the current one hour as input and report the prediction results for the next one hour as output. A novel deep learning architecture built with recurrent neural networks is designed to effectively model these highly complex sequential data in an analogous manner to video prediction tasks. Experimental results demonstrate the superior performance of our proposed methodology to the existing approaches. Lastly, we apply our prototype system to multiple big real-world events and show that it is highly deployable as an online crowd management system.

Nowadays, with the rapid development of IoT (Internet of Things) and CPS (Cyber-Physical Systems) technologies, big spatiotemporal data are being generated from mobile phones, car navigation systems, and traffic sensors. By leveraging state-of-the-art deep learning technologies on such data, urban traffic prediction has drawn a lot of attention in AI and Intelligent Transportation System community. The problem can be uniformly modeled with a 3D tensor (T, N, C), where T denotes the total time steps, N denotes the size of the spatial domain (i.e., mesh-grids or graph-nodes), and C denotes the channels of information. According to the specific modeling strategy, the state-of-the-art deep learning models can be divided into three categories: grid-based, graph-based, and multivariate time-series models. In this study, we first synthetically review the deep traffic models as well as the widely used datasets, then build a standard benchmark to comprehensively evaluate their performances with the same settings and metrics. Our study named DL-Traff is implemented with two most popular deep learning frameworks, i.e., TensorFlow and PyTorch, which is already publicly available as two GitHub repositories https://github.com/deepkashiwa20/DL-Traff-Grid and https://github.com/deepkashiwa20/DL-Traff-Graph. With DL-Traff, we hope to deliver a useful resource to researchers who are interested in spatiotemporal data analysis.

Forecasting incident occurrences (e.g. crime, EMS, traffic accident) is a crucial task for emergency service providers and transportation agencies in performing response time optimization and dynamic fleet management. However, such events are by nature rare and sparse, which causes the label imbalance problem and inferior performance of models relying on data sufficiency. The existing studies circumvent, instead of truly solving, this issue by defining the incident prediction problem in a coarse-grained temporal (e.g. daily) setting, which leaves the proposed models unrobust to fine-grained dynamics and trivial for the real-world decision making. In this paper, we tackle the temporally fine-grained incident prediction problem in a sparse setting by explicitly exploiting the behind-the-scene chainlike triggering mechanism. Moreover, this chain effect roots in multiple domains (i.e. spatial, categorical), which further entangles with the temporal dimension and happens to be time-variant. To be specific, we propose a novel deep learning framework, namely Spatio-Temporal-Categorical Graph Neural Networks (STC-GNN), to handle the multidimensional and dynamic chain effect for performing fine-grained multi-incident co-prediction. Extensive experiments on three real-world city-level incident datasets verify the insightfulness of our perspective and effectiveness of the proposed model.

Forecasting regional ambulance demand plays a fundamental part in dynamic fleet allocation and redeployment. This topic has been gaining increasing significance, as virtually every country is experiencing an aging population, with generally higher level of vulnerability and demand for the emergency medical service (EMS). Although exploring the spatial and temporal correlations in EMS historical records, the existing methods principally consider the former time-invariant, which does not necessarily hold in reality. Moreover, this assumption ignores the fact that the behind-the-scenes dynamics are people, whose demographic profiles and activity patterns could be determinants of regional EMS demands. In this paper, we are therefore motivated to mine the collective daily routines in human mobility, to further represent the evolving spatial correlations. Particularly, we model profiled mobility groups as multiple random walkers and propose a novel bicomponent neural network, including a heterogeneous multi-graph convolution layer and spatio-temporal interlacing attention module, to perform the prediction task. Experimental results on the real-world data verify the effectiveness of introducing dynamic human mobility and the advantage of our approach over the state-of-the-art models.

Nowadays, GPS devices have increased explosively and produced huge amounts of trajectory data related to people's outgoing. Through those big location data, many researches aim to analyze human mobility for urban development, such as human movement prediction/modeling, POI (Point-Of-Interest) recommendation. However, trajectory data only contains timestamp and location information. The intention of human movement is not explicit so that it is hard to understand why people go to somewhere. The intention prior to the activity could be of great significance for analyzing and predicting human mobility, which has not been taken into consideration by the existing researches until the present. Thus, in this study, we propose a brand-new concept called human intentional mobility, aiming to employ intention information to predict people's outgoing. We carefully utilize user's search query to sense his intention as well as the intensity. For instance, if a user searches a certain POI for many times in a short period, it will represent a relatively high intention to go there. Then, to fully utilize this intention representation for predicting whether user will visit searched POI or not, we specially design Dual Sequential Interaction Network (DualSIN) as a novel and unique deep-learning model, which can effectively capture the sophisticated interactions among two kinds of sequential information (i.e., search sequence and mobility sequence) and typical categorical information (i.e., user attributes). Last, we evaluate our model on real-world dataset collected from Yahoo! Japan portal application, and demonstrate that it can achieve superior satisfactory performances to the-state-of-the-art models on multiple POI search queries.

When conducting agent economic simulation for supply chains, inter-company transaction data are essential. However, the current inter-firm transaction data are network data in which branch office information is aggregated into headquarters transaction data. This study proposes a method to estimate branch office transactions from inter-company transaction data aggregated among headquarters by using a gravity model. We also confirm the method's reliability by comparing the estimated transaction data with the inter-regional input-output tables. We analytically considered the transition for all network configurations, demonstrating that the transaction quantity depends on the amount of labor and distance. We also demonstrated that our model fits well with data from business transactions, implying that the whole network structure can be used to model money flow in the real world.

Many previous studies showed that house rent is affected by residential property characteristics, house surrounding environment, facilities, and so on. However, there are few researches on finding the relationship between house rent and people's activities. Thus, we used hourly location-based big data collected by mobile phone GPS data to monitor people's activities all over the city. Multiple residential property characteristics and environments helped to verify if there is a relationship between house rent and people congestion in Tokyo. We find that people congestion has relationship with house rent and make more accurate prediction. We also employed linear and regularization regression and artificial neural network as algorithm and find artificial neural network might be the best calculation method.

Extracting identifiable information from human trajectories is a fundamental task in many location-based services (LBS). However, various mobility patterns underlain in human trajectories are difficult to model by existing models. Moreover, we could hardly define a clear user set for user identification because the set of users are dynamic and changing everyday. Bearing these in mind, we apply a deep multiple instance learning method to handle the multimodal mobility patterns in a weak-supervised learning way, and address the dynamic user set problems via a pairwise loss with negative sampling. We utilize a multi-head attention mechanism to automatically extract multiple aspects and match the corresponding information between query trajectories and historical trajectories. Our method shows a good identification accuracy on three human GPS trajectory data sets comparing with baseline methods.

Event crowd management has been a significant research topic with high social impact. When some big events happen such as an earthquake, typhoon, and national festival, crowd management becomes the first priority for governments (e.g. police) and public service operators (e.g. subway/bus operator) to protect people's safety or maintain the operation of public infrastructures. However, under such event situations, human behavior will become very different from daily routines, which makes prediction of crowd dynamics at big events become highly challenging, especially at a citywide level. Therefore in this study, we aim to extract the deep trend only from the current momentary observations and generate an accurate prediction for the trend in the short future, which is considered to be an effective way to deal with the event situations. Motivated by these, we build an online system called DeepUrbanEvent which can iteratively take citywide crowd dynamics from the current one hour as input and report the prediction results for the next one hour as output. A novel deep learning architecture built with recurrent neural networks is designed to effectively model these highly-complex sequential data in an analogous manner to video prediction tasks. Experimental results demonstrate the superior performance of our proposed methodology to the existing approaches. Lastly, we apply our prototype system to multiple big real-world events and show that it is highly deployable as an online crowd management system.

This study examines the economic impact on the supply chain of a large-scale flood in the Arakawa river area in Tokyo by using the geographic information system (GIS) data on inter-firm transactions. First, we identify the firms that were unable to continue doing business due to damage by using flood simulation analysis data on the Arakawa area. Second, we identify the firms that have business relationships with affected firms by using inter-firm transaction network data. Then, we discuss and analyze the industrial structure of the firms that have relationships with affected firms. Finally, we estimate the amount of transactions affected. Our results are as follows. First, 15-28% of the firms in Japan have business relationships with the affected firms. The figure increases to 44-48% when second-order firms whose transaction partners have business relationships with affected firms are included, and to nearly 52% when fifth-order firms are included. The impact on major cities, such as Tokyo and Osaka, is significant. By industry, the economic impact on the financial and transportation industries is large, while that on the agriculture, forestry, and fisheries industries is small. These results indicate the importance of business continuity planning for large-scale floods.

Globalization leads to more and more outbound behavior. Understanding these behavior is of great significance to both outbound and inbound countries in a lot of fields. However, the previous research on outbound behavior mainly unitizes questionnaires or purely analyzes the statistical data, these data are either too difficult to acquire or unable to directly analyze public opinion. This paper aim to analyze outbound behavior through large volume of text and location information published on social network services (SNS) and look into a case study of Chinese people in Japan with the data acquired from Chinese microblog website, Sina Weibo. For text analysis, we utilize an adapted latent Dirichlet allocation model to extract the topics in text and discuss the spatial and temporal distribution of the topics. The experiment proves that the topics represent outbound behavior of tourists and foreign visitors can be found and explained in the experiment dataset, which indicates that SNS data is valid for analyzing outbound behavior.

In recent decades, the frequency and intensity of natural disasters has increased significantly, and this trend is expected to continue. Therefore, understanding and predicting human behavior and mobility during a disaster will play a vital role in planning effective humanitarian relief, disaster management, and long-term societal reconstruction. However, such research is very difficult to perform owing to the uniqueness of various disasters and the unavailability of reliable and large-scale human mobility data. In this study, we collect big and heterogeneous data (e.g., GPS records of 1.6 million users 1 over 3 years, data on earthquakes that have occurred in Japan over 4 years, news report data, and transportation network data) to study human mobility following natural disasters. An empirical analysis is conducted to explore the basic laws governing human mobility following disasters, and an effective human mobility model is developed to predict and simulate population movements. The experimental results demonstrate the efficiency of our model, and they suggest that human mobility following disasters can be significantly more predictable and be more easily simulated than previously thought.

The frequency and intensity of natural disasters has increased significantly in recent decades, and this trend is expected to continue. Hence, understanding and predicting human evacuation behavior and mobility will play a vital role in planning effective humanitarian relief, disaster management, and long-term societal reconstruction. However, existing models are shallow models, and it is difficult to apply them for understanding the “deep knowledge” of human mobility. Therefore, in this study, we collect big and heterogeneous data (e.g., GPS records of 1.6 million users over 3 years, data on earthquakes that have occurred in Japan over 4 years, news report data, and transportation network data), and we build an intelligent system, namely, DeepMob, for understanding and predicting human evacuation behavior and mobility following different types of natural disasters. The key component of DeepMob is based on a deep learning architecture that aims to understand the basic laws that govern human behavior and mobility following natural disasters, from big and heterogeneous data. Furthermore, based on the deep learning model, DeepMob can accurately predict or simulate a person’s future evacuation behaviors or evacuation routes under different disaster conditions. Experimental results and validations demonstrate the efficiency and superior performance of our system, and suggest that human mobility following disasters may be predicted and simulated more easily than previously thought.

Applications utilizing many types of location data, such as traffic congestion estimation and facility management using indoor pedestrian tracks, have been rapidly increasing. Such applications require the integration of various locational data from different data sources to produce more values. Efforts to ensure smoother data exchange are required for promoting the use of such applications because handling and integrating location data will enlarge the market for geo-spatial information. In response to this need, we had proposed a data encoding standard called `OGC®Moving Features' to contribute to smoother data exchange, and it was adopted as an international standard on Feb. 2015. We demonstrate in this work that OGC®Moving Features is an effective tool to advance technologies for applications using many types of location data, with referring "4Vs" to represent the most pressing bigdata issues.

Mining object-level knowledge, that is, building a comprehensive category model base, from a large set of cluttered scenes presents a considerable challenge to the field of artificial intelligence. How to initiate model learning with the least human supervision (i.e., manual labeling) and how to encode the structural knowledge are two elements of this challenge, as they largely determine the scalability and applicability of any solution. In this article, we propose a model-learning method that starts from a single-labeled object for each category, and mines further model knowledge from a number of informally captured, cluttered scenes. However, in these scenes, target objects are relatively small and have large variations in texture, scale, and rotation. Thus, to reduce the model bias normally associated with less supervised learning methods, we use the robust 3D shape in RGB-D images to guide our model learning, then apply the properly trained category models to both object detection and recognition in more conventional RGB images. In addition to model training for their own categories, the knowledge extracted from the RGB-D images can also be transferred to guide model learning for a new category, in which only RGB images without depth information in the new category are provided for training. Preliminary testing shows that the proposed method performs as well as fully supervised learning methods.

The frequency and intensity of natural disasters has significantly increased over the past decades and this trend is predicted to continue. Facing these possible and unexpected disasters, accurately predicting human emergency behavior and their mobility will become the critical issue for planning effective humanitarian relief, disaster management, and long-term societal reconstruction. In this paper, we build up a large human mobility database (GPS records of 1.6 million users over one year) and several different datasets to capture and analyze human emergency behavior and their mobility following the Great East Japan Earthquake and Fukushima nuclear accident. Based on our empirical analysis through these data, we find that human behavior and their mobility following large-scale disaster sometimes correlate with their mobility patterns during normal times, and are also highly impacted by their social relationship, intensity of disaster, damage level, government appointed shelters, news reporting, large population flow and etc. On the basis of these findings, we develop a model of human behavior that takes into account these factors for accurately predicting human emergency behavior and their mobility following large-scale disaster. The experimental results and validations demonstrate the efficiency of our behavior model, and suggest that human behavior and their movements during disasters may be significantly more predictable than previously thought.

The Great East Japan Earthquake and the Fukushima nuclear accident cause large human population movements and evacuations. Understanding and predicting these movements is critical for planning effective humanitarian relief, disaster management, and long-term societal reconstruction. In this paper, we construct a large human mobility database that stores and manages GPS records from mobile devices used by approximately 1.6 million people throughout Japan from 1 August 2010 to 31 July 2011. By mining this enormous set of Auto-GPS mobile sensor data, the short-term and long-term evacuation behaviors for individuals throughout Japan during this disaster are able to be automatically discovered. To better understand and simulate human mobility during the disasters, we develop a probabilistic model that is able to be effectively trained by the discovered evacuations via machine learning technique. Based on our training model, population mobility in various cities impacted by the disasters throughout the country is able to be automatically simulated or predicted. On the basis of the whole database, developed model, and experimental results, it is easy for us to find some new features or population mobility patterns after the recent severe earthquake, tsunami and release of radioactivity in Japan, which are likely to play a vital role in future disaster relief and management worldwide.

For reasons of public security, an intelligent surveillance system that can cover a large, crowded public area has become an urgent need. In this article, we propose a novel laser-based system that can simultaneously perform tracking, semantic scene learning, and abnormality detection in a fully online and unsupervised way. Furthermore, these three tasks cooperate with each other in one framework to improve their respective performances. The proposed system has the following key advantages over previous ones: (1) It can cover quite a large area (more than 60×35m), and simultaneously perform robust tracking, semantic scene learning, and abnormality detection in a high-density situation. (2) The overall system can vary with time, incrementally learn the structure of the scene, and perform fully online abnormal activity detection and tracking. This feature makes our system suitable for real-time applications. (3) The surveillance tasks are carried out in a fully unsupervised manner, so that there is no need for manual labeling and the construction of huge training datasets. We successfully apply the proposed system to the JR subway station in Tokyo, and demonstrate that it can cover an area of 60×35m, robustly track more than 150 targets at the same time, and simultaneously perform online semantic scene learning and abnormality detection with no human intervention.

Multitarget tracking becomes significantly more challenging when the targets are in close proximity or frequently interact with each other. This article presents a promising online system to deal with these problems. The novelty of this system is that laser and vision are integrated with tracking and online learning to complement each other in one framework: when the targets do not interact with each other, the laser-based independent trackers are employed and the visual information is extracted simultaneously to train some classifiers online for “possible interacting targets”. When the targets are in close proximity, the classifiers learned online are used alongside visual information to assist in tracking. Therefore, this mode of cooperation not only deals with various tough problems encountered in tracking, but also ensures that the entire process can be completely online and automatic. Experimental results demonstrate that laser and vision fully display their respective advantages in our system, and it is easy for us to obtain a good trade-off between tracking accuracy and the time-cost factor.

A "mixed autoregressive hidden Markov model" (MAR-HMM) is proposed for modeling people's movements. MAR-HMM is equivalent to a special case of an autoregressive hidden Markov model (AR-HMM), which takes into account changes of people's internal properties. The number of parameters is thus reduced in the case of MAR-HMM. A dataset is applied to evaluate MAR-HMM in this study. The prediction rate of MAR-HMM is 56.8% and that of AR-HMM is 51.5%. It is therefore concluded that MAR-HMM is applicable to trajectory analysis of pedestrians.