Accurate and robust image-based geo-localization at a global scale is challenging due to diverse environments, visually ambiguous scenes, and the lack of distinctive landmarks in many regions. While contrastive learning methods show promising performance by aligning features between street-view images and corresponding locations, they neglect the underlying spatial dependency in the geographic space. As a result, they fail to address the issue of false negatives - image pairs that are both visually and geographically similar but labeled as negatives, and struggle to effectively distinguish hard negatives, which are visually similar but geographically distant. To address this issue, we propose a novel spatially regularized contrastive learning strategy that integrates a semivariogram, which is a geostatistical tool for modeling how spatial correlation changes with distance. We fit the semivariogram by relating the distance of images in feature space to their geographical distance, capturing the expected visual content in a spatial correlation. With the fitted semivariogram, we define the expected visual dissimilarity at a given spatial distance as reference to identify hard negatives and false negatives. We integrate this strategy into GeoCLIP and evaluate it on the OSV5M dataset, demonstrating that explicitly modeling spatial priors improves image-based geo-localization performance, particularly at finer granularity.

Bavaria Buildings is a large, analysis-ready dataset providing openly available co-registered 40cm aerial imagery of Upper Bavaria paired with building footprint information. The Bavaria Buildings dataset (BBD) contains 18205 orthophotos of 2500 × 2500 pixels, where each pixel covers 40cm × 40cm in space (Digitales Orthophoto 40cm - DOP40). The dataset has been pre-processed and co-registered and also provides a set of 5.5 million image tiles of 250 × 250 pixels ready for deep learning and image analysis tasks. For each image tile, we provide two segmentation masks; one based on the official building footprints (Hausumringe) data as published by the Free State of Bavaria and one based on a historic OpenStreetMap (OSM) extract dating to 2021. The dataset is ready for essential analysis tasks, such as detection, segmentation, instance extraction, footprint geometry extraction, multimodal localization, and multimodal data quality assessment of buildings in Bavaria. We plan to update the dataset with each major re-publication of the upstream data sources to foster change detection research in the future. The BBD is available at https://doi.org/10.14459/2023mp1709451.

The recent advance of adapting pre-trained task-agnostic artificial intelligence (AI) models leads to great successes in downstream tasks via fine-tuning, or low-resource (i.e., few-shot and zero-shot) learning. However, when adapting such pre-trained AI models to geographical applications, it is still challenging to find the "sweet spot" of the model's generalizability and specializability (e.g., geographic generalizability v.s. spatial heterogeneity). For instance, a building detection task may require vision models with different parameters across different geographic areas of the world. In this paper, we rethink this interesting topic, namely Geographical Generalizability of GeoAI models, with a case study of detecting OpenStreetMap (OSM) missing buildings across different countries in sub-Saharan Africa. We consider a real-world scenario, in which we first train a Single-Shot Multibox Detection (SSD) base model for OSM missing building detection in Kakola, Tanzania, where a previous humanitarian mapping project of OSM was organized to map all possible buildings. Then we extrapolate this base model using Few-Shot Transfer Learning (FSTL) to a set of areas in the proximity of the test area in Cameroon. Here, we develop a Geographical Weighted Model Ensemble (GWME) method to improve Geographical Generalizability of GeoAI models. Moreover, we compare four unsupervised model ensemble weighting strategies: 1) Average weighting, 2) Image similarity weighting, 3) Geographical distance weighting, and 4) Self-attention-based weighting. Experiments show promising results of the proposed GWME method, which implicitly generates model weights from their location embedding and image feature embedding in an unsupervised manner. More specifically, the self-attention-based model ensemble achieves the highest performance. The results shed inspiring light on improving the generalizability and replicability of GeoAI models across geographic areas. Data and code are available at https://github.com/tum-bgd/GWME.

The ACM SIGSPATIAL Cup 2023 proposed the challenge to identify and map supraglacial lakes in Greenland in satellite imagery. The peculiarities of supraglacial lakes pose a hard problem for semantic segmentation and object detection tasks because the definition of a lake is ill-fitted to the inner workings of such approaches. For example, lakes are often covered by ice and snow and narrow streams can connect distinct lakes, which is not directly translatable to the semantic segmentation of water. It is also not well-posed for object detection, especially the identity relation - what is a lake, what is not (yet) a lake, and what are two lakes is challenging. In this context, we worked on adapting semantic segmentation using the Segment Anything Model and instance segmentation using Mask R-CNN to the setting. The latter ended up superior in our own evaluation and even got ranked second among all participants. We are proud that our approach has led to competitive performance. The source code is available from https://github.com/tum-bgd/GISCup23.

Hybrid classic-quantum systems utilized existing quantum hardware for machine learning (ML) by running pre- and post-processing on classic hardware to overcome the limitations of today's quantum computers. In this work, hybrid systems with several pre-processing techniques and two circuit architectures are evaluated by classifying remote sensing (RS) imagery. The potential of quantum machine learning (QML) for RS is investigated and particularly autoencoder methods are found to be suitable for pre-processing. The code is published in an open repository: https://github.com/tumbgd/qc4rs.