Image-based indoor localization using smartphones has become popular, leveraging visual landmarks and fingerprint extraction for localization. Fingerprint density significantly affects accuracy, but collecting dense, high-resolution fingerprints during on-site surveys is labor-intensive and incurs high computation/storage costs during matching. Additionally, efficient fingerprint extraction often constrains users to specific shooting poses, with deviations markedly reducing localization accuracy. To address these challenges, we introduce ARGILS, an Automated Real-time Generative Image Localization System. The key idea is to use cross sparse sampling instead of dense sampling, generate fingerprint features for missing locations, and quickly match locations through feature orthogonal decomposition. Cross sparse sampling ensures full coverage of scene features and helps to generate missing fingerprints. To maintain high localization resolution with sparse sampling, we designed a distance-constrained generative adversarial network to generate fingerprints for unsampled locations. Additionally, we developed an orthogonal fingerprint extraction method to decompose image features into horizontal and vertical directions in 2D space. To improve robustness against obstacles, we implemented a scanning localization scheme using key frame filtering and clustering. We have implemented ARGILS and performed extensive real-world evaluations. Experiment results show that when reducing 75% site survey effort, the average location error of ARGILS is around 2.5m in a shopping mall, 48% higher than state-of-the-art methods. ARGILS can also efficiently speed up localization process, with the time consumption ranging from 0.1 to 0.3 seconds on smartphones of various configurations.

Deep learning-based visual localization methods use convolutional neural networks to directly regress the position of a target. However, previous studies only consider localization in a single scene and neglect personalized localization in multiple scenes. Furthermore, changes in the scene result in a reduced accuracy due to the model’s lack of adaptability. Moreover, traditional centralized training methods pose data privacy concerns. In this paper, we propose a personalized semi-supervised federated learning framework with cloud-edge-end collaboration, called FedVL. The hierarchical architecture extends single-scene localization to multiple scenes, while the federated learning mechanism ensures data privacy. In this framework, we apply personalized federated learning to achieve scene-specific model and employ semi-supervised federated learning to allow the localization model to adapt to scene changes. Experiments conducted on indoor and outdoor datasets demonstrate the effectiveness of this approach.