Demo Data from SIGIR 2026 / reviewers in the wild / expert
Weiming Huang 0001
dblp:13/8593-1
· DBLP profile ↗
32ranked-venue papers
3as first author
30since 2021 · last 2026
0000-0002-3208-4208ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 23 · 3 first-author · 22 since 2021Artificial intelligence and machine learning · 16 · 16 since 2021Graphics, computer vision, multimedia, augmented reality and games · 4 · 4 since 2021Applied, interdisciplinary, general and emerging computing · 2 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Databases, data mining, and information retrieval
12 papers |
Data mining · 69% Knowledge graphs · 11% Information retrieval · 8% | |
| Artificial intelligence
12 papers |
Representation and self-supervised learning · 45% Graph learning · 26% Knowledge representation and reasoning · 12% | |
| Interdisciplinary, comprehensive, and emerging computing
5 papers |
Smart cities and intelligent transportation · 100% |
Topics — the 30 heaviest of 40, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Representation and self-supervised learning
contrastive learning |
3.4 | 5 | 2026 | UrbanMFM: Spatial Graph-Based Multiscale Foundation Models for Learning Generalized Urban Representation · IEEE Trans. Knowl. Data Eng. 2026 Road Network Representation Learning with the Third Law of Geography · NeurIPS 2024 Urban Region Embedding via Multi-View Contrastive Prediction · AAAI 2024 |
Data mining › representation learning
urban region embedding |
3.3 | 4 | 2026 | Region Embedding With Adaptive Correlation Discovery for Predicting Urban Socioeconomic Indicators · IEEE Trans. Knowl. Data Eng. 2026 Cross-City Latent Space Alignment for Consistency Region Embedding · ICML 2025 Urban Region Embedding via Multi-View Contrastive Prediction · AAAI 2024 |
Data mining
representation learning |
2.4 | 3 | 2026 | Multi-View Urban Region Embedding via Commonality-Specificity Disentanglement · KDD (1) 2026 Learning Hierarchy-Enhanced POI Category Representations Using Disentangled Mobility Sequences · IJCAI 2024 Pre-Trained Semantic Embeddings for POI Categories Based on Multiple Contexts · IEEE Trans. Knowl. Data Eng. 2023 |
Data mining
urban computing |
2.4 | 3 | 2026 | Region Embedding With Adaptive Correlation Discovery for Predicting Urban Socioeconomic Indicators · IEEE Trans. Knowl. Data Eng. 2026 Urban Region Embedding via Multi-View Contrastive Prediction · AAAI 2024 Urban Region Representation Learning with OpenStreetMap Building Footprints · KDD 2023 |
Smart cities and intelligent transportation
urban computing |
1.1 | 2 | 2026 | Profiling Urban Streets: A Semi-Supervised Prediction Model Based on Street View Imagery and Spatial Topology · KDD 2024 Multi-View Urban Region Embedding via Commonality-Specificity Disentanglement · KDD (1) 2026 |
Machine learning › Graph learning › graph structure learning
adaptive graph construction |
1.0 | 1 | 2026 | Region Embedding With Adaptive Correlation Discovery for Predicting Urban Socioeconomic Indicators · IEEE Trans. Knowl. Data Eng. 2026 |
Machine learning › Graph learning
urban region representation learning |
1.0 | 1 | 2026 | UrbanMFM: Spatial Graph-Based Multiscale Foundation Models for Learning Generalized Urban Representation · IEEE Trans. Knowl. Data Eng. 2026 |
Data mining › spatiotemporal data mining
human mobility prediction |
1.0 | 1 | 2026 | Beyond Routines: Adaptive Mobility Prediction via Sequential-Relational Fusion · KDD (1) 2026 |
Data mining › spatiotemporal data mining › mobility data mining › location prediction
next location prediction |
1.0 | 1 | 2026 | Beyond Routines: Adaptive Mobility Prediction via Sequential-Relational Fusion · KDD (1) 2026 |
Natural language and speech › Language models and text generation
large language model |
0.9 | 1 | 2025 | SILO: Semantic Integration for Location Prediction with Large Language Models · KDD (2) 2025 |
Machine learning › Representation and self-supervised learning › representation matching › feature alignment › embedding alignment
latent space alignment |
0.9 | 1 | 2025 | Cross-City Latent Space Alignment for Consistency Region Embedding · ICML 2025 |
Information retrieval › retrieval models
sparse retrieval |
0.9 | 1 | 2025 | Reconciling Geospatial Prediction and Retrieval via Sparse Representations · NeurIPS 2025 |
Data mining › structured data mining
spatial data mining |
0.9 | 1 | 2025 | Cross-City Latent Space Alignment for Consistency Region Embedding · ICML 2025 |
Data mining
spatiotemporal data mining |
0.9 | 1 | 2025 | Reconciling Geospatial Prediction and Retrieval via Sparse Representations · NeurIPS 2025 |
Machine learning › Learning paradigms › semi-supervised learning
graph-based semi-supervised learning |
0.8 | 1 | 2024 | Profiling Urban Streets: A Semi-Supervised Prediction Model Based on Street View Imagery and Spatial Topology · KDD 2024 |
Machine learning › Representation and self-supervised learning › contrastive learning
graph contrastive learning |
0.8 | 1 | 2024 | Road Network Representation Learning with the Third Law of Geography · NeurIPS 2024 |
Machine learning › Graph learning
graph representation learning |
0.8 | 1 | 2024 | Road Network Representation Learning with the Third Law of Geography · NeurIPS 2024 |
Machine learning › Representation and self-supervised learning › contrastive learning
multi-view contrastive learning |
0.8 | 1 | 2024 | Urban Region Embedding via Multi-View Contrastive Prediction · AAAI 2024 |
Machine learning › Graph learning › graph representation learning
road network representation |
0.8 | 1 | 2024 | Road Network Representation Learning with the Third Law of Geography · NeurIPS 2024 |
Natural language and speech › Information extraction and text analysis › data annotation
semantic annotation |
0.8 | 1 | 2024 | Exploring Urban Semantics: A Multimodal Model for POI Semantic Annotation with Street View Images and Place Names · IJCAI 2024 |
Machine learning › Representation and self-supervised learning
user preference modeling |
0.8 | 1 | 2024 | Going Where, by Whom, and at What Time: Next Location Prediction Considering User Preference and Temporal Regularity · KDD 2024 |
Machine learning › Graph learning › graph neural network
graph convolutional network |
0.7 | 1 | 2023 | Towards an Integrated View of Semantic Annotation for POIs with Spatial and Textual Information · IJCAI 2023 |
Machine learning › Representation and self-supervised learning › representation learning › visual representation learning
region representation |
0.7 | 1 | 2023 | Urban Region Representation Learning with OpenStreetMap Building Footprints · KDD 2023 |
Recommender systems › representation learning for recommendation
embedding-based recommendation |
0.7 | 1 | 2023 | Pre-Trained Semantic Embeddings for POI Categories Based on Multiple Contexts · IEEE Trans. Knowl. Data Eng. 2023 |
Knowledge graphs › domain-specific knowledge graph
geospatial knowledge graph |
0.7 | 1 | 2023 | Mining Geospatial Relationships from Text · Proc. ACM Manag. Data 2023 |
Knowledge graphs
knowledge graph construction |
0.7 | 1 | 2023 | Mining Geospatial Relationships from Text · Proc. ACM Manag. Data 2023 |
Knowledge graphs
link prediction |
0.7 | 1 | 2023 | Mining Geospatial Relationships from Text · Proc. ACM Manag. Data 2023 |
Spatial and temporal data management › location data
points of interest |
0.7 | 1 | 2023 | Pre-Trained Semantic Embeddings for POI Categories Based on Multiple Contexts · IEEE Trans. Knowl. Data Eng. 2023 |
Information retrieval › document processing › document analysis › document representation
semantic embedding |
0.7 | 1 | 2023 | Pre-Trained Semantic Embeddings for POI Categories Based on Multiple Contexts · IEEE Trans. Knowl. Data Eng. 2023 |
Smart cities and intelligent transportation
urban planning |
0.3 | 1 | 2026 | UrbanMFM: Spatial Graph-Based Multiscale Foundation Models for Learning Generalized Urban Representation · IEEE Trans. Knowl. Data Eng. 2026 |
Methods — techniques the papers use, named apart from their topics
contrastive learning · 10.1transformer · 3.8disentangled representation learning · 2.8latent space alignment · 2.6knowledge transfer · 2.6large language model · 2.4spatial graph · 2.0orthogonality constraints · 2.0multi-graph embedding · 2.0foundation model · 2.0disentanglement · 2.0graph-based relational reasoning · 1.0confidence-aware gating · 1.0dual-logits strategy · 0.9street view images · 0.8place names · 0.8
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Multi-View Urban Region Embedding via Commonality-Specificity DisentanglementabstractMulti-view region embedding has become an important technique to be pursued due to the increasing availability of diverse urban sensing data. Existing methods typically adopt attention-based fusion or contrastive alignment to integrate multiple data sources such as human mobility and points-of-interest (POIs) into unified region representations. However, these approaches often fail to effectively balance cross-view commonality modeling with the preservation of view-specific characteristics. To address this limitation, we propose ComSRE, a novel region embedding framework that explicitly disentangles shared and distinctive components in multi-view region representations. ComSRE integrates three key modules: (1) a Multi-view Representation Learning module that fuses complementary information across views, (2) a View-to-Commonality Contrastive Alignment module that aligns the representation of each view to a shared commonality anchor to enhance cross-view consistency, and (3) a Multi-view Differential Orthogonality module that isolates distinctive signals unique to each view and promotes their independence through orthogonality constraints. Extensive experiments on three real-world urban datasets demonstrate that ComSRE consistently outperforms state-of-the-art methods across multiple downstream tasks, achieving superior predictive accuracy and representation quality. Zechen Li 0003, Hongwei Jia, Kai Zhao 0011, Weiming Huang 0001, Meng Chen 0003 |
KDD (1) | 4 |
| 2026 | Beyond Routines: Adaptive Mobility Prediction via Sequential-Relational FusionabstractPredicting human mobility remains a fundamental challenge, especially when individuals deviate from routine patterns due to exploration, disruptions, or rare events. While sequential models like Transformers excel at capturing regular movement patterns, their performance often degrades under nonroutine scenarios involving rare or unfamiliar transitions. To address this, we propose ROAM (Routine-Oriented Adaptive Mobility Predictor), a novel framework that jointly models human mobility from both sequential and relational perspectives, enabling adaptive handling of both routine and nonroutine behaviors during prediction. ROAM combines a sequential encoder that captures historically frequent transitions with a complementary graph-based relational reasoning module that encodes both user-specific and group-level mobility structures. To dynamically integrate these views, we introduce a hierarchical confidence-aware gating mechanism that adaptively balances sequential and relational predictions based on their internal reliability. Extensive experiments on real-world mobility datasets show that ROAM consistently outperforms state-of-the-art baselines in next location prediction. Further analysis reveals that the combination of sequential and relational reasoning substantially improves robustness, particularly under out-of-routine scenarios. Tianao Sun, Ruizhe Liu, Wenzhen Jia, Kai Zhao 0011, Weiming Huang 0001, Meng Chen 0003 |
KDD (1) | 5 |
| 2026 | Urban region representation learning via dual spatial contrastsabstractRegion representation learning emerges as a new research paradigm to encode urban systems and facilitate geographic mapping. Recent studies have sought to reasonably introduce inductive biases, which refer to prior assumptions that guide model learning, from a geospatial perspective to improve the quality of region representations. However, there remain challenges in incorporating the spatial effects, e.g. spatial dependency and spatial heterogeneity, into inductive biases, as they are critical to the geographic awareness of region representations. In response, we developed a novel region representation learning framework, termed Region Graph Spatial Contrastive Learning (RGSCL), by leveraging building footprints and points of interest (POIs) along with prior spatial knowledge to derive region representations. Specifically, RGSCL first constructed multi-view region graphs with POIs, building footprints and their spatial proximity, to form a base representation space. Next, the algorithm adopted a contrastive learning mechanism with spatial effects to formulate a dual-spatial-contrast loss function to optimise the representation space. The dual-spatial-contrasts captured POI-building spatial dependency and the region’s spatial heterogeneity to compose semantics in region representations. Experimental results demonstrated that RGSCL improved performance in geographic mapping. This study offers new insights into GeoAI from the perspective of inductive biases with respect to spatial effects. Quan Qin, Tinghua Ai, Weiming Huang 0001, Shishuo Xu, Mingyi Du, Songnian Li |
Int. J. Geogr. Inf. Sci. | 3 |
| 2026 | Region Embedding With Adaptive Correlation Discovery for Predicting Urban Socioeconomic IndicatorsabstractA recent trend in urban computing involves utilizing multi-modal data for urban region embedding, which can be further expanded in a variety of downstream urban sensing tasks. Many previous studies rely on multi-graph embedding techniques and follow a two-stage paradigm: first building a k-nearest neighbor graph based on fixed region correlations for each view, and then blending multi-view information in a posterior stage to learn region representations. However, multi-graph construction and multi-graph representation learning are not associated in most existing two-stage studies, and the relationship between them is not leveraged, which can provide complementary information to each other. In this paper, we unify these two stages into one by constructing learnable weighted complete graphs of regions and propose a new one-stage Region Embedding method with Adaptive region correlation Discovery (READ). Specifically, READ comprises three modules, including a disentangled region feature learning module utilizing a city-context Transformer to encode regions' semantic and mobility features, and an adaptive weighted multi-graph construction module that builds multiple complete graphs with learnable weights based on disentangled features of regions. In addition, we propose a multi-graph representation learning module to yield effective region representations that integrate information from multiple graphs. We conduct thorough experiments on three downstream tasks to assess READ. Experimental results demonstrate that READ considerably outperforms state-of-the-art baseline methods in urban region embedding. Meng Chen 0003, Hongwei Jia, Zechen Li 0003, Weiming Huang 0001, Kai Zhao 0011, Yongshun Gong, Hongjun Dai |
IEEE Trans. Knowl. Data Eng. | 4 |
| 2026 | UrbanMFM: Spatial Graph-Based Multiscale Foundation Models for Learning Generalized Urban RepresentationabstractAs geospatial data from web platforms becomes increasingly accessible and regularly updated, urban representation learning has emerged as a critical research area for advancing urban planning. Recent studies have developed foundation model-based algorithms to leverage this data for various urban-related downstream tasks. However, current research has inadequately explored deep integration strategies for multiscale, multimodal urban data in the context of urban foundation models. This gap arises primarily because the relationships between micro-scale (e.g., individual points of interest and street view imagery) and macro-scale (e.g., region-wide satellite imagery) urban features are inherently implicit and highly complex, making traditional interaction modeling insufficient. This paper introduces a novel research problem – how to learn multiscale urban representations by integrating diverse geographic data modalities and modeling complex multimodal relationships across different spatial scales. To address this significant challenge, we propose UrbanMFM, a spatial graph-based multiscale foundation model framework explicitly designed to capture and leverage these intricate relationships. UrbanMFM utilizes a self-supervised learning paradigm that integrates diverse geographic data modalities, including POI data and urban imagery, through novel contrastive learning objectives and advanced sampling techniques. By explicitly modeling spatial graphs to represent complex multiscale urban relationships, UrbanMFM effectively facilitates deep interactions between multimodal data sources. Extensive experiments on datasets from Singapore, New York, and Beijing demonstrate that UrbanMFM outperforms the strongest baselines significantly in four representative downstream tasks. By effectively modelling spatial hierarchies with diverse data, UrbanMFM provides a more comprehensive and adaptable representation of urban environments. Miao Xie, Pasquale Balsebre, Weiming Huang 0001, Siqiang Luo, Gao Cong |
IEEE Trans. Knowl. Data Eng. | 4 |
| 2025 | Into the Unknown: Applying Inductive Spatial-Semantic Location Embeddings for Predicting Individuals' Mobility Beyond Visited PlacesabstractPredicting individuals' next locations is a core task in human mobility modelling, with wide-ranging implications for urban planning, transportation, public policy and personalised mobility services. Traditional approaches largely depend on location embeddings learned from historical mobility patterns, limiting their ability to encode explicit spatial information, integrate rich urban semantic context, and accommodate previously unseen locations. To address these challenges, we explore the application of CaLLiPer—a multi-modal representation learning framework that fuses spatial coordinates and semantic features of points of interest through contrastive learning—for location embedding in individual mobility prediction. CaLLiPer's embeddings are spatially explicit, semantically enriched, and inductive by design, enabling robust prediction performance even in scenarios involving emerging locations. Through extensive experiments on four public mobility datasets under both conventional and inductive settings, we demonstrate that CaLLiPer consistently outperforms strong baselines, particularly excelling in inductive scenarios. Our findings highlight the potential of multi-modal, inductive location embeddings to advance the capabilities of human mobility prediction systems. We also release the code and data (https://github.com/xlwang233/Into-the-Unknown) to foster reproducibility and future research. Xinglei Wang, Tao Cheng 0004, Stephen Law, Zichao Zeng, Ilya Ilyankou, Junyuan Liu, Lu Yin 0006, Weiming Huang 0001, Natchapon Jongwiriyanurak |
SIGSPATIAL/GIS | 8 |
| 2025 | Cross-City Latent Space Alignment for Consistency Region EmbeddingabstractLearning urban region embeddings has substantially advanced urban analysis, but their typical focus on individual cities leads to disparate embedding spaces, hindering cross-city knowledge transfer and the reuse of downstream task predictors. To tackle this issue, we present Consistency Region Embedding (CoRE), a unified framework integrating region embedding learning with cross-city latent space alignment. CoRE first embeds regions from two cities into separate latent spaces, followed by the alignment of latent space manifolds and fine-grained individual regions from both cities. This ensures compatible and comparable embeddings within aligned latent spaces, enabling predictions of various socioeconomic indicators without ground truth labels by migrating knowledge from label-rich cities. Extensive experiments show CoRE outperforms competitive baselines, confirming its effectiveness for cross-city knowledge transfer via aligned latent spaces. Meng Chen 0003, Hongwei Jia, Zechen Li 0003, Wenzhen Jia, Kai Zhao 0011, Hongjun Dai, Weiming Huang 0001 |
ICML | 7 |
| 2025 | SILO: Semantic Integration for Location Prediction with Large Language ModelsabstractNext location prediction is a critical task in human mobility modeling, with broad applications in personalized recommendation, urban planning, and location-based services. Recently, researchers have used prompt-based large language models (LLMs) to improve next location prediction with pre-trained knowledge. However, they face inherent challenges in bridging the gap between textual prompts for semantic contextual understanding and human mobility data for transition pattern modeling. In this paper, we introduce SILO, a framework designed for Semantic Integration in LOcation prediction via LLMs. We first construct a hybrid semantic space that seamlessly integrates ID-based embeddings, text-derived semantics, and auxiliary contextual information, enabling comprehensive modeling of sequential mobility patterns alongside contextual nuances. We then propose user-centric prompts that specify the prediction task for LLMs while embedding user context within a special token. Further, we utilize LLMs as the prediction backbone to process both user-specific prompts and hybrid ID-context embeddings of location sequences. To enhance predictive performance, we finally introduce a dual-logits strategy, combining sequential transition logits with user profile-guided semantic preference logits. Extensive experiments on two large-scale real-world mobility datasets demonstrate that SILO significantly outperforms state-of-the-art baselines, validating its effectiveness in modeling complex mobility patterns through semantic integration using LLMs. Tianao Sun, Meng Chen 0003, Bowen Zhang 0005, Genan Dai, Weiming Huang 0001, Kai Zhao 0011 |
KDD (2) | 5 |
| 2025 | Reconciling Geospatial Prediction and Retrieval via Sparse RepresentationsabstractUrban computing harnesses big data to decode complex urban dynamics and revolutionize location-based services. Traditional approaches have treated geospatial prediction tasks (e.g., estimating socio-economic indicators) and retrieval tasks (e.g., querying geographic objects) as isolated challenges, necessitating separate models with distinct training objectives. This fragmentation imposes significant computational burdens and limits cross-task synergy, despite advances in representation learning and multi-task foundation models.
We present UrbanSparse, a pioneering framework that unifies geospatial prediction and retrieval through a novel sparse-dense representation architecture. By synergistically combining these tasks, UrbanSparse eliminates redundant systems while amplifying their mutual strengths. Our approach introduces two innovations: (1) Bloom filter-based sparse encodings that compress high-sparsity geographic queries and fine-grained text terms for retrieval effectiveness, and (2) a dense semantic codebook that captures granular urban features to boost prediction accuracy. A two-view contrastive learning mechanism further bridges urban objects, regions, and contexts. Experiments on real-world datasets demonstrate 25.16% gains in prediction accuracy and 20.76% improvements in retrieval precision over state-of-the-art baselines, alongside 65.97% faster training. These advantages position UrbanSparse as a scalable solution for large urban datasets. To our knowledge, this is the first unified framework bridging geospatial prediction and retrieval, opening new frontiers in data-driven urban intelligence. Yi Li 0044, Yuanlong Chen, Weiming Huang 0001, Xiaoli Li 0001, Gao Cong |
NeurIPS | 3 |
| 2025 | GeoFM: how will geo-foundation models reshape spatial data science and GeoAI?abstractThe emerging field of geo-foundation models (GeoFM) has the potential to reshape GeoAI and spatial data science research, education, and practice. In this work, we motivate and define the term and put it into its historic context within GeoAI and spatial data science more broadly. Next, we review core datasets, models, and benchmarks. Based on this overview of the state-of-the-art, we introduce key research challenges for future GeoFM research, such as GeoAI scaling laws, geo-alignment of AI, truly multimodal GeoFM, and so on. Finally, we discuss potential risks of GeoFM research and outline the road ahead with a specific focus on the increasing role of international large-scale collaborations and the future of GeoAI and spatial data science education. Krzysztof Janowicz, Gengchen Mai, Weiming Huang 0001, Rui Zhu 0008, Ni Lao, Ling Cai 0002 |
Int. J. Geogr. Inf. Sci. | 3 |
| 2024 | Urban Region Embedding via Multi-View Contrastive PredictionabstractRecently, learning urban region representations utilizing multi-modal data (information views) has become increasingly popular, for deep understanding of the distributions of various socioeconomic features in cities. However, previous methods usually blend multi-view information in a posteriors stage, falling short in learning coherent and consistent representations across different views. In this paper, we form a new pipeline to learn consistent representations across varying views, and propose the multi-view Contrastive Prediction model for urban Region embedding (ReCP), which leverages the multiple information views from point-of-interest (POI) and human mobility data. Specifically, ReCP comprises two major modules, namely an intra-view learning module utilizing contrastive learning and feature reconstruction to capture the unique information from each single view, and inter-view learning module that perceives the consistency between the two views using a contrastive prediction learning scheme. We conduct thorough experiments on two downstream tasks to assess the proposed model, i.e., land use clustering and region popularity prediction. The experimental results demonstrate that our model outperforms state-of-the-art baseline methods significantly in urban region representation learning. Zechen Li 0003, Weiming Huang 0001, Kai Zhao 0011, Min Yang 0006, Yongshun Gong, Meng Chen 0003 |
AAAI | 2 |
| 2024 | City Foundation Models for Learning General Purpose Representations from OpenStreetMapabstractPre-trained Foundation Models (PFMs) have ushered in a paradigm-shift in AI, due to their ability to learn general-purpose representations that can be readily employed in downstream tasks. While PFMs have been successfully adopted in various fields such as NLP and Computer Vision, their capacity in handling geospatial data remains limited. This can be attributed to the intrinsic heterogeneity of such data, which encompasses different types, including points, segments and regions, as well as multiple information modalities. The proliferation of Volunteered Geographic Information initiatives, like OpenStreetMap, unveils a promising opportunity to bridge this gap. In this paper, we present CityFM, a self-supervised framework to train a foundation model within a selected geographical area. CityFM relies solely on open data from OSM, and produces multimodal representations, incorporating spatial, visual, and textual information. We analyse the entity representations generated by our foundation models from a qualitative perspective, and conduct experiments on road, building, and region-level downstream tasks. In all the experiments, CityFM achieves performance superior to, or on par with, application-specific algorithms. Pasquale Balsebre, Weiming Huang 0001, Gao Cong, Yi Li 0044 |
CIKM | 2 |
| 2024 | Learning Hierarchy-Enhanced POI Category Representations Using Disentangled Mobility Sequences
Hongwei Jia, Meng Chen 0003, Weiming Huang 0001, Kai Zhao 0011, Yongshun Gong |
IJCAI | 3 |
| 2024 | Exploring Urban Semantics: A Multimodal Model for POI Semantic Annotation with Street View Images and Place Names
Dabin Zhang, Meng Chen 0003, Weiming Huang 0001, Yongshun Gong, Kai Zhao 0011 |
IJCAI | 3 |
| 2024 | Profiling Urban Streets: A Semi-Supervised Prediction Model Based on Street View Imagery and Spatial TopologyabstractWith the expansion and growth of cities, profiling urban areas with the advent of multi-modal urban datasets (e.g., points-of-interest and street view imagery) has become increasingly important in urban planing and management. Particularly, street view images have gained popularity for understanding the characteristics of urban areas due to its abundant visual information and inherent correlations with human activities. In this study, we define a street segment represented by multiple street view images as the minimum spatial unit for analysis and predict its functional and socioeconomic indicators, which presents several challenges in modeling spatial distributions of images on a street and the spatial topology (adjacency) of streets. Meanwhile, Large Language Models are capable of understanding imagery data based on its extraordinary knowledge base and unveil a remarkable opportunity for profiling streets with images. In view of the challenges and opportunity, we present a semi-supervised Urban Street Profiling Model (USPM) based on street view imagery and spatial adjacency of urban streets. Specifically, given a street with multiple images, we first employ a newly designed spatial context-based contrastive learning method to generate feature vectors of images and then apply the LSTM-based fusion method to encode multiple images on a street to yield the street visual representation; we then create the descriptions of street scenes for street view images based on the SPHINX (a large language model) and produce the street textual representation; finally, we build an urban street graph based on spatial topology (adjacency) and employ a semi-supervised graph learning algorithm to further encode the street representations for prediction. We conduct thorough experiments with real-world datasets to assess the proposed USPM. The experimental results demonstrate that USPM considerably outperforms baseline methods in two urban prediction tasks. Meng Chen 0003, Zechen Li 0003, Weiming Huang 0001, Yongshun Gong, Yilong Yin |
KDD | 3 |
| 2024 | Going Where, by Whom, and at What Time: Next Location Prediction Considering User Preference and Temporal RegularityabstractNext location prediction is a crucial task in human mobility modeling, and is pivotal for many downstream applications like location-based recommendation and transportation planning. Although there has been a large body of research tackling this problem, the usefulness of user preference and temporal regularity remains underrepresented. Specifically, previous studies usually neglect the explicit user preference information entailed from human trajectories and fall short in utilizing the arrival time of next location, as a key determinant on next location. To address these limitations, we propose a Multi-Context aware Location Prediction model (MCLP) to predict next locations for individuals, where it explicitly models user preference and the next arrival time as context. First, we utilize a topic model to extract user preferences for different types of locations from historical human trajectories. Second, we develop an arrival time estimator to construct a robust arrival time embedding based on the multi-head attention mechanism. The two components provide pivotal contextual information for the subsequent prediction. Finally, we utilize the Transformer architecture to mine sequential patterns and integrate multiple contextual information to predict the next locations. Experimental results on two real-world mobility datasets show that our proposed MCLP outperforms baseline methods. Tianao Sun, Ke Fu, Weiming Huang 0001, Kai Zhao 0011, Yongshun Gong, Meng Chen 0003 |
KDD | 3 |
| 2024 | Road Network Representation Learning with the Third Law of GeographyabstractRoad network representation learning aims to learn compressed and effective vectorized representations for road segments that are applicable to numerous tasks. In this paper, we identify the limitations of existing methods, particularly their overemphasis on the distance effect as outlined in the First Law of Geography. In response, we propose to endow road network representation with the principles of the recent Third Law of Geography. To this end, we propose a novel graph contrastive learning framework that employs geographic configuration-aware graph augmentation and spectral negative sampling, ensuring that road segments with similar geographic configurations yield similar representations, and vice versa, aligning with the principles stated in the Third Law. The framework further fuses the Third Law with the First Law through a dual contrastive learning objective to effectively balance the implications of both laws. We evaluate our framework on two real-world datasets across three downstream tasks. The results show that the integration of the Third Law significantly improves the performance of road segment representations in downstream tasks. Haicang Zhou, Weiming Huang 0001, Yile Chen 0001, Tiantian He 0001, Gao Cong, Yew-Soon Ong |
NeurIPS | 2 |
| 2024 | Zero-shot urban function inference with street view images through prompting a pretrained vision-language modelabstractInferring urban functions using street view images (SVIs) has gained tremendous momentum. The recent prosperity of large-scale vision-language pretrained models sheds light on addressing some long-standing challenges in this regard, for example, heavy reliance on labeled samples and computing resources. In this paper, we present a novel prompting framework for enabling the pretrained vision-language model CLIP to effectively infer fine-grained urban functions with SVIs in a zero-shot manner, that is, without labeled samples and model training. The prompting framework UrbanCLIP comprises an urban taxonomy and several urban function prompt templates, in order to (1) bridge the abstract urban function categories and concrete urban object types that can be readily understood by CLIP, and (2) mitigate the interference in SVIs, for example, street-side trees and vehicles. We conduct extensive experiments to verify the effectiveness of UrbanCLIP. The results indicate that the zero-shot UrbanCLIP largely surpasses several competitive supervised baselines, e.g. a fine-tuned ResNet, and its advantages become more prominent in cross-city transfer tests. In addition, UrbanCLIP’s zero-shot performance is considerably better than the vanilla CLIP. Overall, UrbanCLIP is a simple yet effective framework for urban function inference, and showcases the potential of foundation models for geospatial applications. Weiming Huang 0001, Jing Wang 0225, Gao Cong |
Int. J. Geogr. Inf. Sci. | 1 |
| 2023 | Towards an Integrated View of Semantic Annotation for POIs with Spatial and Textual InformationabstractCategories of Point of Interest (POI) facilitate location-based services from many aspects like location search and POI recommendation. However, POI categories are often incomplete and new POIs are being consistently generated, this rises the demand for semantic annotation for POIs, i.e., labeling the POI with a semantic category. Previous methods usually model sequential check-in information of users to learn POI features for annotation. However, users' check-ins are hardly obtained in reality, especially for those newly created POIs. In this context, we present a Spatial-Textual POI Annotation (STPA) model for static POIs, which derives POI categories using only the geographic locations and names of POIs. Specifically, we design a GCN-based spatial encoder to model spatial correlations among POIs to generate POI spatial embeddings, and an attention-based text encoder to model the semantic contexts of POIs to generate POI textual embeddings. We finally fuse the two embeddings and preserve multi-view correlations for semantic annotation. We conduct comprehensive experiments to validate the effectiveness of STPA with POI data from AMap. Experimental results demonstrate that STPA substantially outperforms several competitive baselines, which proves that STPA is a promising approach for annotating static POIs in map services. Dabin Zhang, Ronghui Xu 0001, Weiming Huang 0001, Kai Zhao 0011, Meng Chen 0003 |
IJCAI | 3 |
| 2023 | Urban Region Representation Learning with OpenStreetMap Building FootprintsabstractThe prosperity of crowdsourcing geospatial data provides increasing opportunities to understand our cities. In particular, OpenStreetMap (OSM) has become a prominent vault of geospatial data on the Web. In this context, learning urban region representations from OSM data, which is unexplored in previous work, could be profitable for various downstream tasks. In this work, we utilize OSM buildings (footprints) complemented with points of interest (POIs) to learn region representations, as buildings' shapes, spatial distributions, and properties have tight linkages to different urban functions. However, appealing as it seems, urban buildings often exhibit complex patterns to form dense or sparse areas, which brings significant challenges for unsupervised feature extraction. To address the challenges, we propose RegionDCL1, an unsupervised framework to deeply mine urban buildings. In a nutshell, we leverage random points generated by Poisson Disk Sampling to tackle data-sparse areas and utilize triplet loss with a novel adaptive margin to preserve inter-region correlations. Furthermore, we train our model with group-level and region-level contrastive learning, making it adaptive to varying region partitions. Extensive experiments in two global cities demonstrate that RegionDCL consistently outperforms the state-of-the-art counterparts across different region partitions, and outputs effective representations for inferring urban land use and population density. Yi Li 0044, Weiming Huang 0001, Gao Cong, Hao Wang 0068, Zheng Wang 0046 |
KDD | 2 |
| 2023 | Uncovering the association between traffic crashes and street-level built-environment features using street view imagesabstractInvestigating the relationship between built environment factors and roadway safety is crucial for preventing road traffic accidents. Although studies have analyzed traffic-related built environment factors based on pre-determined zonal units, conclusive evidence regarding the relationship between streetscape features and traffic accidents at a fine-grained road segment level is still lacking. With the widespread availability of large-scale street view images, automatically analyzing urban built environments on a large scale is possible. Therefore, the aim of this study was to investigate the relationship between streetscape features and traffic accidents at a fine-grained road segment level using street view images. Specifically, we employed semantic image segmentation to extract streetscape elements from urban street view images, and then created traffic crash-related variables, including the street-level built environment variables, traffic variables, land-use indices, and proximity characteristics, at the road-segment level. Finally, we adopted a classification-then-regression strategy to model the number of traffic crashes while considering the zero-inflated and spatial heterogeneity issues. Our findings suggest that streetscape features can effectively reflect built-environment characteristics at the road-segment level. Moreover, a comparison of our proposed modeling method with existing models demonstrates its superior performance. The results provide insight into the development of effective planning strategies to improve traffic safety. Sheng Hu 0001, Hanfa Xing, Wei Luo 0010, Liang Wu 0005, Yongyang Xu, Weiming Huang 0001 |
Int. J. Geogr. Inf. Sci. | 6 |
| 2023 | Unsupervised land-use change detection using multi-temporal POI embeddingabstractRapid land-use change detection (LUCD) is pivotal for refined urban planning and management. In this paper, we investigate LUCD through learning embeddings of points of interest (POIs) from multiple temporalities. There are several prominent challenges: (1) the co-occurrence problem of multi-temporal POIs, (2) the heterogeneity of POI categorization, and (3) The lack of human-crafted labels. Therefore, multi-temporal POIs need to be aligned in the embedding space for effective LUCD. This study proposes a multi-temporal POI embedding (MT-POI2Vec) technique for LUCD in a fully unsupervised manner. In MT-POI2Vec, we first utilize random walks in POI networks to capture their single-period co-occurrence patterns; then, we leverage manifold learning to capture (1) single-period categorical semantics of POIs to enforce semantically similar POI embedding to be close and (2) cross-period categorical semantics to align multi-temporal POI embedding in a unified embedding space. We conducted experiments in Shenzhen, China, which demonstrates that the proposed method is effective. Compared with several baseline models, MT-POI2Vec can better align multi-temporal POIs and thus achieve higher performance in LUCD. In addition, our model can effectively identify areas with unchanged land use and land use changes in residential and industrial areas at a fine scale. Yao Yao 0004, Qia Zhu, Zijin Guo, Weiming Huang 0001, Yatao Zhang, Xiaoqin Yan, Anning Dong, Zhangwei Jiang, Qingfeng Guan 0001 |
Int. J. Geogr. Inf. Sci. | 4 |
| 2023 | Mining Geospatial Relationships from TextabstractA geospatial Knowledge Graph (KG) is a heterogeneous information network, capable of representing relationships between spatial entities in a machine-interpretable format, and has tremendous applications in logistics and social networks. Existing efforts to build a geospatial KG, have mainly used sparse spatial relationships, e.g., a district located inside a city, which provide only marginal benefits compared to a traditional database. In spite of the substantial advances in the tasks of link prediction and knowledge graph completion, identifying geospatial relationships remains challenging, particularly due to the fact that spatial entities are represented with single-point geometries, and textual attributes are frequently missing. In this study, we present GTMiner, a novel framework capable of jointly modeling Geospatial and Textual information to construct a knowledge graph, by mining three useful spatial relationships from a geospatial database, in an end-to-end fashion. The system is divided into three components: (1) a Candidate Selection module, to efficiently select a small number of candidate pairs; (2) a Relation Prediction component to predict spatial relationships between the entities; (3) a KG Refinement procedure, to improve both coverage and correctness of a geospatial knowledge graph. We carry out experiments on four cities' geospatial databases, from publicly-available sources and compare with existing algorithms for link prediction and geospatial data integration. Finally, we conduct an ablation study to motivate our design choices and an efficiency analysis to show that the time required by GTMiner for training and inference is comparable, or even shorter, than existing solutions. Pasquale Balsebre, Dezhong Yao 0002, Gao Cong, Weiming Huang 0001, Zhen Hai |
Proc. ACM Manag. Data | 4 |
| 2023 | A Spatial and Adversarial Representation Learning Approach for Land Use Classification with POIsabstractPoints-of-interests (POIs) have been proven to be indicative for sensing urban land use in numerous studies. However, recent progress mainly relies on spatial co-occurrence patterns among POI categories, which falls short in utilizing the rich semantic information embodied in POI hierarchical categories and in sensing the spatial distribution patterns of POIs at an individual zonal scale. In this context, we present a spatial and adversarial representation learning approach (SARL) for predicting land use of urban zones with POIs. SARL deeply mines the information from POIs from both spatial and categorical perspectives. Specifically, we first utilize a convolutional neural network to sense the spatial distribution patterns of POIs in each urban zone. We then leverage an autoencoder and an adversarial learning strategy to mine the POI categorical information in all hierarchical levels, which emphasizes the prominent and definitive POIs while preserves the overall POI hierarchical structures in each zone. Finally, we fuse these information from the two perspectives via a Wide & Deep network and carry out land use prediction with the fused embeddings. We conduct comprehensive experiments to validate the effectiveness of SARL in four European cities with real-world data. The results demonstrate that SARL substantially outperforms several competitive baselines. Ronghui Xu 0001, Weiming Huang 0001, Meng Chen 0003, Liqiang Nie |
ACM Trans. Intell. Syst. Technol. | 2 |
| 2023 | Pre-Trained Semantic Embeddings for POI Categories Based on Multiple ContextsabstractThe past decade has witnessed the increasingly created point-of-interest (POI) data, which are utilized to express the semantics of places. To understand the POI semantics, current methods usually embed POI categories into a latent space via certain trajectory sequential models, while neglecting the underlining spatial information. It is noteworthy that the complex spatial relationships among POI categories contain substantial information that benefits meaningful semantic embeddings for various POI categories. Inspired by this, we present a unified POI Category Embedding Method (CatEM for short), which jointly encodes the sequential transitions and spatial relations of POI categories as well as the adaptive semantic neighbors of each POI category. The merits of CatEM lie in that: (1) it considers the pairwise spatial similarities between categories and represents categories with larger similarity values with adjacent embeddings in the latent space, and (2) it adaptively locates neighbor categories with similar semantics in the embedding space to improve the adaptivity of POI category embedding. The proposed pre-trained POI category embeddings are justified by three downstream tasks. Extensive experiments demonstrate the superiority of our proposed model, as compared to several cutting-edge baselines. Junxiang Bing, Meng Chen 0003, Min Yang 0006, Weiming Huang 0001, Yongshun Gong, Liqiang Nie |
IEEE Trans. Knowl. Data Eng. | 4 |
| 2023 | HealthNet: A Health Progression Network via Heterogeneous Medical Information FusionabstractNumerous electronic health records (EHRs) offer valuable opportunities for understanding patients' health status at different stages, namely health progression. Extracting the health progression patterns allows researchers to perform accurate predictive analysis of patient outcomes. However, most existing works on this task suffer from the following two limitations: 1) the diverse dependencies among heterogeneous medical entities are overlooked, which leads to the one-sided modeling of patients' status and 2) the extraction granularity of patient's health progression patterns is coarse, limiting the model's ability to accurately infer the patient's future status. To address these challenges, a pretrained Health progression network via heterogeneous medical information fusion, HealthNet, is proposed in this article. Specifically, a global heterogeneous graph in HealthNet is built to integrate heterogeneous medical entities and the dependencies among them. In addition, the proposed health progression network is designed to model hierarchical medical event sequences. By this method, the fine-grained health progression patterns of patients' health can be captured. The experimental results on real disease datasets demonstrate that HealthNet outperforms the state-of-the-art models for both diagnosis prediction task and mortality prediction task. Fuqiang Yu, Li-Zhen Cui 0001, Huanhuan Chen 0001, Ning Liu 0014, Weiming Huang 0001, Hua Lu 0001 |
IEEE Trans. Neural Networks Learn. Syst. | 6 |
| 2022 | Similarity-Aware Collaborative Learning for Patient Outcome Prediction
Fuqiang Yu, Li-Zhen Cui 0001, Ning Liu 0014, Weiming Huang 0001 |
DASFAA (2) | 5 |
| 2022 | A design method for an intelligent manufacturing and service system for rehabilitation assistive devices and special groups
Zilin Wang 0004, Li-Zhen Cui 0001, Wei Guo 0017, Lei Zhao 0013, Xiaosong Gu, Weizhong Tang, Lingguo Bu, Weiming Huang 0001 |
Adv. Eng. Informatics | 9 |
| 2022 | Estimating urban functional distributions with semantics preserved POI embeddingabstractWe present a novel approach for estimating the proportional distributions of function types (i.e. functional distributions) in an urban area through learning semantics preserved embeddings of points-of-interest (POIs). Specifically, we represent POIs as low-dimensional vectors to capture (1) the spatial co-occurrence patterns of POIs and (2) the semantics conveyed by the POI hierarchical categories (i.e. categorical semantics). The proposed approach utilizes spatially explicit random walks in a POI network to learn spatial co-occurrence patterns, and a manifold learning algorithm to capture categorical semantics. The learned POI vector embeddings are then aggregated to generate regional embeddings with long short-term memory (LSTM) and attention mechanisms, to take account of the different levels of importance among the POIs in a region. Finally, a multilayer perceptron (MLP) maps regional embeddings to functional distributions. A case study in Xiamen Island, China implements and evaluates the proposed approach. The results indicate that our approach outperforms several competitive baseline models in all evaluation measures, and yields a relatively high consistency between the estimation and ground truth. In addition, a comprehensive error analysis unveils several intrinsic limitations of POI data for this task, e.g. ambiguous linkage between POIs and functions. Weiming Huang 0001, Li-Zhen Cui 0001, Meng Chen 0003, Daokun Zhang, Yao Yao 0004 |
Int. J. Geogr. Inf. Sci. | 1 |
| 2022 | Origin-Aware Location Prediction Based on Historical Vehicle TrajectoriesabstractNext location prediction is of great importance for many location-based applications and provides essential intelligence to various businesses. In previous studies, a common approach to next location prediction is to learn the sequential transitions with massive historical trajectories based on conditional probability. Nevertheless, due to the time and space complexity, these methods (e.g., Markov models) only utilize the just passed locations to predict next locations, neglecting earlier passed locations in the trajectory. In this work, we seek to enhance the prediction performance by incorporating the travel time from all the passed locations in the query trajectory to each candidate next location. To this end, we propose a novel prediction method, namely the Travel Time Difference Model, which exploits the difference between the shortest travel time and the actual travel time to predict next locations. Moreover, we integrate the Travel Time Difference Model with a Sequential and Temporal Predictor to yield a joint model. The joint prediction model integrates local sequential transitions, temporal regularity, and global travel time information in the trajectory for the next location prediction problem. We have conducted extensive experiments on two real-world datasets: the vehicle passage record data and the taxi trajectory data. The experimental results demonstrate significant improvements in prediction accuracy over baseline methods. Meng Chen 0003, Weiming Huang 0001, Yixuan Zuo, Xiaohui Yu 0001 |
ACM Trans. Intell. Syst. Technol. | 3 |
| 2019 | Water Body Extraction From Very High-Resolution Remote Sensing Imagery Using Deep U-Net and a Superpixel-Based Conditional Random Field ModelabstractWater body extraction (WBE) has attracted considerable attention in the field of remote sensing image analysis. Herein, we present an enhanced deep convolutional encoder-decoder (DCED) network (or Deep U-Net) specifically tailored to WBE from remote sensing images by applying superpixel segmentation and conditional random fields (CRFs). First, we preclassify the entire remote sensing image into the water and nonwater areas via Deep U-Net, using the results of class membership probabilities as the unary potential in the CRF model. The pairwise potential of CRF is defined by a linear combination of Gaussian kernels, which forms a fully connected neighbor structure. Next, regional restriction is incorporated into the approach to enhance the consistency of the connected area. We use the simple linear iterative clustering algorithm to generate superpixels and correct the binary classification results by calculating their average posterior probabilities. Finally, a highly efficient approximate inference algorithm, mean-field inference, is generated for the final model. The results from the experimental application to GaoFen-2 images and WorldView-2 images demonstrate that the proposed approach exhibits competitive quantitative and qualitative performance, which effectively reduces salt-and-pepper noise and retains the edge structures of water bodies. Compared to existing state-of-the-art methods, our proposed method achieves superior final results. Wenqing Feng, Haigang Sui, Weiming Huang 0001, Kaiqiang An |
IEEE Geosci. Remote. Sens. Lett. | 3 |
| 2018 | Synchronising geometric representations for map mashups using relative positioning and Linked DataabstractMap mashups, as a common way of presenting geospatial information on the Web, are generally created by spatially overlaying thematic information on top of various base maps. This simple overlay approach often raises geometric deficiencies due to geometric uncertainties in the data. This issue is particularly apparent in a multi-scale context because the thematic data seldom have synchronised level of detail with the base map. In this study, we propose, develop, implement and evaluate a relative positioning approach based on shared geometries and relative coordinates to synchronise geometric representations for map mashups through several scales. To realise the relative positioning between datasets, we adopt a Linked Data–based technical framework in which the data are organised according to ontologies that are designed based on the GeoSPARQL vocabulary. A prototype system is developed to demonstrate the feasibility and usability of the relative positioning approach. The results show that the approach synchronises and integrates the geometries of thematic data and the base map effectively, and the thematic data are automatically tailored for multi-scale visualisation. The proposed framework can be used as a new way of modelling geospatial data on the Web, with merits in terms of both data visualisation and querying. Weiming Huang 0001, Ali Mansourian, Ehsan Abdolmajidi, Haiqi Xu, Lars Harrie |
Int. J. Geogr. Inf. Sci. | 1 |