High inter-class similarity and diverse geometric configurations in high spatial resolution remote sensing images pose significant challenges for remote sensing object detection. To address these challenges, this study proposed a novel remote sensing oriented object detector MGNet based on multi-cascaded feature selection and geometric constraints, designed to enhance discriminative feature representation and optimize oriented bounding box regression. First, we designed a novel backbone Multi-Cascaded Feature Selection Network (MCFSNet) to improve inter-class separability by jointly leveraging and fusing contextual information and multi-scale features. Second, we designed a Geometric-Constrained Probabilistic Loss, which introduced an angular offset factor and a geometric perception factor to refine angular prediction accuracy of square targets and shape sensitivity. To systematically evaluate angular localization performance, we constructed a Multi-scale Plane Remote Sensing Object Detection dataset (MPRSOD) with arbitrary-orientated annotations and proposed the Angle Error Rate (AER), the first dedicated evaluation metric for quantifying angular prediction errors. Extensive experiments on DIOR-R, DOTA V1.5, MAR20 and MPRSOD datasets demonstrate that MGNet obtains competitive mAP results while maintaining computational efficiency.

Hyperspectral images (HSIs) are vital for scene analysis, as they capture detailed spatial and spectral information to characterize surface materials. However, accurate HSI classification is challenged by significant intra-class spectral variability and spatial complexity. To address this, we leverage the fact that pixels of the same class typically form irregular local regions. We propose a structure-adaptive graph transformer (SAGT) that dynamically captures irregular spatial topologies and homogeneous spectral information to achieve adaptive HSI representation and precise classification. Specifically, a structure-aware self-attention (SASA) module is developed to embed graph structures into the self-attention mechanism as a robust positional indicator, which can be extended easily and effectively. SASA comprehensively accounts for the spatial structures and spectral autocorrelation of ground objects, facilitating the aggregation of homogeneous spectral information for noise-robust spectral representations. Additionally, a structure-adaptive pooling (SAP) module is designed to dynamically adjust graph structures by discarding irrelevant edges, thus better indicating spatial relationships. By coupling the SASA and SAP modules, our proposed SAGT model significantly alleviates spectral variability and tolerates prior noise. Furthermore, data augmentation techniques of random discard and random offset are built, which randomly drop and shift graph nodes to generate more diverse samples during preprocessing. In postprocessing, multiview decision-making integrates results from multiple contextual views to provide more robust predictions. Experimental results on three benchmark datasets consistently demonstrate that SAGT is more effective and reliable than other state-of-the-art methods. To facilitate reproduction, we will release the source code for SAGT at https://github.com/ShuGuoJ/SAGT.git.

This study, conducted in a Shenzhen district, assesses the necessity and cost-effectiveness of Ground Penetrating Radar (GPR) road inspections. The evaluation involves automatic identification of road defects, such as voids, cavities, and loose soil, followed by an analysis of their spatial distribution patterns, clustering effects, density, and correlation with the metro system. The study proposes an optimized strategy for large-scale road inspections based on the spatial distribution characteristics of identified defects, emphasizing the importance of more frequent inspections on vulnerable roads. The findings contribute to the efficient allocation of public funds, minimizing wasteful expenditures, and enhancing road operational safety.

Analyzing road network subsidence and sinkholes is crucial for ensuring urban traffic and people's safety. InSAR technique is a non-contact measurement technique with high spatiotemporal resolution, wide monitoring range, and unaffected by road conditions, which is of great significance for the analysis of deformation hazards of man-made linear infrastructures, such as road networks and high-speed railways. In this study, we adopt 44 Sentinel-1A images from January 2022 to July 2023 to study the deformation of the road network in Longgang District, Shenzhen, China based on PS-InSAR. The road deformation is further analyzed associated with sinkhole information from field investigation. The results show that the deformation rate of the road network is between -38.3 mm/year and 16.9 mm/year, and the correlation coefficient between the top burial depth of the sinkholes and the maximum deformation rate is 0.58.

Thermal images capture temperature information of the environments instead of texture, making it well suitable for obtaining position in dark environments. Many methods have been proposed to handle RGB images, while thermal image-based localization methods are not well studied. To address it, we propose DarkLoc+, a thermal image-based indoor localization method based on the attention model and relative constraints between images under a learning-based localization framework. To be specific, we utilize self-attention to extract reprehensive features from thermal images and exploit relative constraints to enforce the convolutional neural networks (CNNs) to predict global poses. Relative pose loss(RelLoss)and relative regression loss are designed to work with global poses to constrain the network in feature and pose space simultaneously. We evaluate the proposed method on the public thermal images indoor dataset and our own dataset. The experimental results demonstrate that our method can obtain accurate position information.

Ground-based interferometric radar (GBIR) is an innovative tool for monitoring land surface subsidence and urban infrastructure deformation caused by rapid urbanization. However, the interferograms of GBIR are often contaminated by severe atmospheric effects, especially in coastal areas. In this study, we use independent component analysis (ICA) to extract atmospheric effects for the interferograms of GBIR. Analysis of the performance of ICA and traditional surface fitting methods have been carried out. The results suggest that the average improved rate of ICA is 93.05%, which is 69.33% higher than that of surface fitting.

Missing data are critical deficiency in the investigation of displacement measurement in urban Internet of Things system. In the insight of recovering missing displacement data, this article presents a data-driven and high-dimensional gap-imputation method, Tucker decomposition with L2 regularization. Results on the global navigation satellite system (GNSS) time series collected from an intelligent structural health monitoring system show that the recovery accuracy is improved compared with some popular benchmark methods. When the missing rate is 50%, compared with singular spectrum analysis, singular value decomposition, CP optimization algorithm,$k$-nearest neighbors, and Tucker decomposition via alternating least squares, Tucker decomposition with L2 regularization can improve the average mean absolute error by about 4.74, 4.95, 5.82, 2.29, and 5.67 mm for all locations. It can be concluded that the consideration of multiple temporal correlations is necessary for missing data imputation. Compared with matrix decomposition, tensor decomposition can improve the ability for high-dimensional correlations in the GNSS time series.

Airborne laser bathymetry (ALB) systems with digital full-waveform signal collection can obtain corresponding temporal positions from several backscattering surfaces by laser beam irradiation. This information can help describe the multi-elevation structures of the target and explore the echo signal attenuation response in different nonuniform mediums during laser propagation. Therefore, a full-waveform echo signal is quite practical for integrated water-land detection. However, the wavelength used in the ALB system is generally in the visible band range of 470~580 nm, and the received signal is constantly interfered with by many nontarget factors, such as imperfections in the receiving channel or the strong scattering from the transmission medium. The conventional processing method transforms nontarget interference into noise point cloud filtering or classification extraction, enabling the detection of a single surface or regular geometry. The accuracy of the identification and extraction for multi-elevation target surfaces echo signal is always reduced due to the significant noise signal intensity. We proposed a signal component detection method by constructing the echo signal feature functions and the conditional random field (CRF) model based on the full-waveform decomposition. The processing result for actual measurement data verified that the CRF strategy can effectively reduce the uncertainty of target surface detection. Compared with the single-beam echo sounder, the root mean square errors of the elevation deviation underwater were reduced by 3.2 cm and 4.9 cm respectively in the two different experimental areas.

With the development of hyperspectral imaging technology, hyperspectral images (HSIs) have become important when analyzing the class of ground objects. In recent years, benefiting from the massive labeled data, deep learning has achieved a series of breakthroughs in many fields of research. However, labeling HSIs requires sufficient domain knowledge and is time-consuming and laborious. Thus, how to apply deep learning effectively to small labeled samples is an important topic of research in HSI classification. To solve this problem, we propose a semisupervised Siamese network that embeds Siamese network into a semisupervised learning scheme. It integrates an autoencoder module and a Siamese network to, respectively, investigate information in a large amount of unlabeled data and rectify it with a limited labeled sample set, which is called 3DAES. First, the autoencoder method is trained on the massive unlabeled data to learn the refinement representation, creating an unsupervised feature. Second, based on this unsupervised feature, limited labeled samples are used to train a Siamese network to rectify the unsupervised feature to improve feature separability among various classes. Furthermore, by training the Siamese network, a random sampling scheme is used to accelerate training and avoid imbalance among various sample classes. Experiments on three benchmark HSI datasets consistently demonstrate the effectiveness and robustness of the proposed 3DAES approach with limited labeled samples. For study replication, the code developed for this study is available athttps://github.com/ShuGuoJ/3DAES.git.

Due to the detailed spectral information through hundreds of narrow spectral bands provided by hyperspectral image (HSI) data, it can be employed to accurately classify diverse materials of interest, which is one of the core applications of hyperspectral remote sensing technology. In recent years, with the rapid development of deep learning, convolutional neural networks (CNNs) have been successfully applied in many fields, including HSI classification. However, the random gradient descent-based parameter updating scheme is too general and leading to the inefficiency of CNN models. Moreover, the high dimensionality and limited training samples of HSI data also exacerbate the overfitting problem. To tackle these issues, in this article, a novel deep network with multilayer and multibranch architecture, named 3-D Gabor CNN (3DG-CNN), is proposed for HSI classification. More precisely, since the predefined 3-D Gabor filters in multiple scales and orientations could well characterize the internal spatial–spectral structure of HSI data from various perspectives, the 3-D Gabor-modulated kernels (3-D GMKs) are employed to replace the random initialization kernels. Moreover, the specially designed multibranch architecture enables the network to better integrating the scalable property of 3-D Gabor filters; thus, the representative ability and robustness of the extracted features can be greatly improved. Alternatively, the number of network parameters is substantially reduced due to the incorporation of 3-D Gabor modulation, relieving the training complexity and also alleviating the training process from overfitting. Experimental results on four real HSI datasets (including two newly released ones in the literature) have demonstrated that the proposed 3DG-CNN model can achieve better performance than several widely used machine-learning-based and deep-learning-based approaches. For the sake of reproducibility, the codes of the proposed 3DG-CNN model are available athttp://jiasen.tech/papers/.

Bus passenger flow prediction is a critical component of advanced transportation information system for public traffic management, control, and dispatch. With the development of artificial intelligence, many previous studies attempted to apply machine learning models to extract comprehensive correlations from transit networks to improve passenger flow prediction accuracy, given that the variety and volume of traffic data have been easily obtained. The passenger flow on a station is highly affected by various factors such as the previous time step, peak hours or nonpeak hours, and extracting the key features from the data is essential for a passenger flow prediction model. Although the neural networks, k‐nearest neighbor, and some deep learning models have been adopted to mine the temporal correlations of the passenger flow data, the lack of interpretability of the influenced variables is still a big problem. Classical tree‐based models can mine the correlations between variables and rank the importance of each variable. In this study, we presented a method to extract passenger flow of different routes on the station and implemented a XGBoost model to find the contributions of variables to the prediction of passenger flow. Comparing to benchmark models, the proposed model can reach state‐of‐the‐art prediction accuracy and computational efficiency on the real‐world dataset. Moreover, the XGBoost model can interpret the predicted results. It can be seen that period is the most important variable for the passenger flow prediction, and so the management of buses during peak hours should be improved.

Sewer pipe is an essential infrastructure in the city as it undertakes the transportation and circulation of wastewater resources. But sewer pipe it is easy to have faults and cause serious secondary urban accidents, such as road holes and road collapse. Because of the complex underground circumstance, inspecting large-area sewer pipes using closed-circuit television or periscope television is difficult. In this study, we proposed a collaborative sewer pipe inspection approach by using novel low-cost pipe robotic capsules, which capture the images of the pipeline inner walls when floating with the water flow. A set of workers collaboratively drop and salvage capsules to cover a large-area pipe network. The routes of workers and pipe capsules are optimized by a meta-heuristic algorithm integrating local search and simulated annealing. The deep neural network is used to recognize faults from raw captured images. A field experiment in Shenzhen was conducted to evaluate the performance of the proposed approach. The results demonstrate that it outperforms the naive inspection method with a shorter travel distance and less waiting time. It is also effective for inspecting the large-area sewer pipe networks with an overall precision of 0.92. It will help us to eliminate the potential safety risk of the public and promote the level of urban governance.

Although 3-D reconstruction of dynamic road environment by moving cameras has been broadly applied in recognition and navigation systems, this task is still considered challenging, especially under circumstances with moving objects, where the reconstruction precision is strongly harassed by the ghosting problem. To address this issue, in this paper, we propose a novel approach for reconstructing 3-D maps of complete static scenes, based on a combination of an elaborately designed moving-object filtering mechanism and a map repairing and blank refilling procedure, where both plausible color and depth information from stereo image pairs are utilized. In this approach, first, we employ the planarity knowledge into the initial depth map based on the simple linear iterative cluster (SLIC) superpixel segmentation. The dynamic area in the image is determined under the supervision of odometry calculation. After wiping off moving objects, by collaboratively repairing color and depth information, the final 3-D map containing only static scene is obtained. The experimental results on extensive challenging real-world scenarios demonstrate the effectiveness and robustness of our approach.

A 3-D Gabor wavelet provides an effective way to obtain the spectral-spatial-fused features for hyperspectral image, which has shown advantageous performance for material classification and recognition. In this paper, instead of separately employing the Gabor magnitude and phase features, which, respectively, reflect the intensity and variation of surface materials in local area, a cascade superpixel regularized Gabor feature fusion (CSRGFF) approach has been proposed. First, the Gabor filters with particular orientation are utilized to obtain Gabor features (including magnitude and phase) from the original hyperspectral image. Second, a support vector machine (SVM)-based probability representation strategy is developed to fully exploit the decision information in SVM output, and the achieved confidence score can make the following fusion with Gabor phase more effective. Meanwhile, the quadrant bit coding and Hamming distance metric are applied to encode the Gabor phase features and measure sample similarity in sequence. Third, the carefully defined characteristics of two kinds of features are directly combined together without any weighting operation to describe the weight of samples belonging to each class. Finally, a series of superpixel graphs extracted from the raw hyperspectral image with different numbers of superpixels are employed to successively regularize the weighting cube from over-segmentation to under-segmentation, and the classification performance gradually improves with the decrease in the number of superpixels in the regularization procedure. Four widely used real hyperspectral images have been conducted, and the experimental results constantly demonstrate the superiority of our CSRGFF approach over several state-of-the-art methods.

Hyperspectral images (HSIs) has practical applications in many fields. In practical scenarios, machine learning often fails to handle changes between training (source) and testing (target) input distributions due to domain shifts. A big challenge in hyperspectral image classification is the small size of labeled data for classifier learning. We always face the situation that an HSI scene is not labeled all or with very limited number of labeled pixels, but we have sufficient labeled pixels in another HSI scene with similar land cover classes. In this paper, we propose a simple and effective method for domain adaptation called statistical fusion to minimize domain shifts by aligning the second-order and fourth-order statistics of source and target distributions. After two hyperspectral scenes are transformed into the similar property-space, any traditional HSI classification approaches can be used, and experimental results have validated the generalization of the proposed method.

In virtue of the spatial structural characteristic of surface materials, the performance of the hyperspectral image classification can be boosted by incorporating texture information. Normally, the spatial structure can be extracted by predefined operators, including the popular extended multiattribute profiles (EMAPs) and the Gabor filters. Recently, superpixel segmentation, which reflects the homogeneous regularity of objects, has drawn much attention in the field. In this paper, a collaborative representation-based multiscale superpixel fusion (CRMSF) approach has been proposed for the hyperspectral image classification. First, after obtaining the EMAPs from the raw hyperspectral image, a group of predesigned 3-D Gabor wavelet filters is convolved with the EMAP features, and the EMAP-Gabor features can, thus, be achieved. Second, the collaborative representation-based classification (CRC) is employed to fully and efficiently make use of the huge amount of extracted EMAP-Gabor features. Third, multiscale superpixel maps are generated from the EMAP features that are utilized to regularize the classification map obtained by CRC. A heuristic strategy has been specially devised to automatically decide the number of extracted superpixels in multiple scales, which can be perfectly compatible with hyperspectral images having various spatial sizes and spatial resolutions. This is the most important contribution of the developed CRMSF approach. Finally, the classification task is accomplished by fusing the multiple regularized classification maps. The CRMSF approach has been evaluated on four popular hyperspectral image data sets, and the experimental results show the advantages of CRMSF, particularly for a hyperspectral image with high spatial resolution.

Since the spatial distribution of surface materials is usually regular and locally continuous, it is reasonable to utilize the spectral and spatial information for the hyperspectral image classification. In this paper, a spectral-spatial Gabor surface feature (GSF) fusion approach has been proposed for hyperspectral image classification. First, Gabor magnitude pictures (GMPs) are extracted by applying a set of predefined 2-D Gabor filters to hyperspectral images. Second, the GSF has been extended to the spectral-spatial domains to comply with the 3-D structure of hyperspectral imagery, called 3-DGSF, which utilizes the first-order derivative of GMPs. Meanwhile, a classic superpixel segmentation method, called simple linear iterative clustering (SLIC), is adopted to divide the original hyperspectral image into disjoint superpixels. Third, principal component analysis is adopted to reduce the dimensionality of each extracted 3-DGSF feature cube. Next, a support vector machine classifier is applied on each reduced 3-DGSF features, and the majority voting strategy is used to obtain the classification results. Finally, the superpixel map obtained by SLIC is used to regularize the classification map, and thus, the proposed approach is named as S3-DGSF. Extensive experiments on three real hyperspectral data sets have demonstrated the higher performance of the proposed S3-DGSF approach over several state-of-the-art methods in the literature.

Hyperspectral remote sensing imagery provides valuable and rich information to distinguish the characteristics of materials. However, this advantage of hyperspectral imagery often encounters the problem of a limited amount of training samples, which is caused by the difficulty of manually labeling. Fortunately, the spatial distribution of surface objects can be integrated with the spectral signature to improve the discriminative ability. In this paper, a 3-D Gaussian-Gabor feature extraction and selection framework has been proposed for hyperspectral image classification. First, a bank of 3-D Gaussian-Gabor filters are convolved with the concatenated data of both extended multi-attribute profile (EMAP) features and raw hyperspectral data. Second, an improved fast density peak clustering (IFDPC) method is introduced to select the most representative features from each extracted 3-D Gaussian-Gabor feature cube. Finally, the retained features are combined together to accomplish the classification task. The proposed method is thus named as GG-IFDPC. Three real hyperspectral imagery data sets have been utilized, and the experiments demonstrate the advantages of the proposed GG-IFDPC approach over the compared ones.

In recent years, it has been found that the fusion processing of remote sensing data produced by multiple sensors is often effective for material classification. Specifically, the joint use of hyperspectral image (HSI) and Light Detection And Ranging (LiDAR) data for classification has been an active topic of research in remote sensing field. Since hyperspectral and LiDAR data provide complementary information (spectral reflectance, and vertical structure, respectively), one promising and challenging approach is to fuse these data in the information extraction procedure. In this paper, we propose an efficient feature extraction and fusion method based on Gabor wavelet, leading to a fusion of the spectral, spatial and elevation data. The core idea of the proposed fusion approach is stacking elevation and intensity data of LiDAR as additional channels to spectral bands. Our strategies are based on the Gabor feature stack structure, which are natural and effective. The features extracted by Gabor wavelets have proved to be discriminant features when considered for thematic classification in remote sensing applications especially when dealing with hyperspectral images due to their ability to extract joint spatial and spectrum information from HSI. Experimental results on the real hyperspectral image data have shown the better discriminative power of our approach for classification.

As manual labeling is very difficult and time-consuming, the labeled samples used to train a supervised classifier are generally limited, which become one of the biggest challenge for hyperspectral imagery classification. In order to tackle this issue, a recent trend is to exploit the structure information of materials, as which reflects the region homogeneity in the spatial domain and offers an invaluable complement to the spectral information. In this respect, 3-D Gabor wavelets have been introduced to extract joint spectral-spatial features for hyperspectral images. One the one hand, the features extracted by 3-D Gabor wavelets lead to very good performance for classification. On the other hand, its drawbacks, i.e., big number of features and high computational cost, limit its applicability. In this paper, a 3-D Gabor-wavelet-based phase coding and Hamming distance-based matching (3DGPC-HDM) framework is developed for hyperspectral imagery classification. The proposed method, instead of taking into account the large volume of Gabor magnitude features, exploits the Gabor phase features with certain orientations (i.e., the direction parallel to the spectral axis), which are then encoded by a simple quadrant bit coding scheme. After that, a normalized Hamming distance matching (HDM) method is adopted to determine the similarity of two samples, and the nearest neighbor classifier is routinely utilized for pixelwise recognition. Finally, experiments on three real hyperspectral data sets show that the proposed 3DGPC-HDM leads to very good performance. Comparisons with the state-of-the-art methods in the literature, in terms of both classifier complexity and generalization ability from very small training sets, are also included.

Since it is usually difficult and time-consuming to obtain sufficient training samples by manually labeling, feature extraction, which investigates the characteristics of hyperspectral images (HSIs), such as spectral continuity and spatial locality of surface objects, to achieve the most discriminative feature representation, is very important for HSI classification. Meanwhile, due to the spatial regularity of surface materials, it is desirable to improve the classification performance of HSIs from the superpixel viewpoint. In this paper, we propose a novel local binary pattern (LBP)-based superpixel-level decision fusion method for HSI classification. The proposed framework employs uniform LBP (ULBP) to extract local image features, and then, a support vector machine is utilized to formulate the probability description of each pixel belonging to every class. The composite image of the first three components extracted by a principal component analysis from the HSI data is oversegmented into many homogeneous regions by using the entropy rate segmentation method. Then, a region merging process is applied to make the superpixels obtained more homogeneous and agree with the spatial structure of materials more precisely. Finally, a probability-oriented classification strategy is applied to classify each pixel based on superpixel-level guidance. The proposed framework “ULBP-based superpixel-level decision fusion framework” is named ULBP-SPG. Experimental results on two real HSI data sets have demonstrated that the proposed ULBP-SPG framework is more effective and powerful than several state-of-the-art methods.

Due to the 3-D nature of hyperspectral images, as well as the spatial properties (such as regularity and continuity) of land covers, many 3-D feature extraction operators have been designed to fully exploit the joint spatial-spectral information. However, the large amount of obtained features can suffer from the “curse of dimensionality” problem, especially for the small training sample set. Moreover, various spatial-spectral features can represent the characteristics of the hyperspectral image from different aspects. In this paper, a multiple 3-D feature fusion framework (M3DF3) has been proposed for hyperspectral image classification. First, we extend the 2-D Gabor surface feature into 3-D (3DSF) domains to comply with the spatial-spectral structure of the hyperspectral image, which is directly applied on the original hyperspectral image instead of the Gabor features. Second, three 3-D feature extraction methods, including the 3-D morphological profile, the 3-D local binary pattern, and the proposed 3DSF, that, respectively, characterize the hyperspectral image from three different angles, i.e., morphology, local dependence, and shape smoothness, are fused under a multitask sparse representation framework to take full advantage of the multiple 3-D features together. The proposed M3DF3approach was fully tested on three real-world hyperspectral image data, i.e., the widely used Indian Pines, Pavia University, and Houston University. The results show that our method can achieve as high as 68.22%, 79.44%, and 72.84% accuracies, respectively, even when only few samples, i.e., three samples per class, are used for training.

This paper presents a Semantic Attribute assisted video SUMmarization framework (SASUM). Compared with traditional methods, SASUM has several innovative features. Firstly, we use a natural language processing tool to discover a set of keywords from an image and text corpora to form the semantic attributes of visual contents. Secondly, we train a deep convolution neural network to extract visual features as well as predict the semantic attributes of video segments which enables us to represent video contents with visual and semantic features simultaneously. Thirdly, we construct a temporally constrained video segment affinity matrix and use a partially near duplicate image discovery technique to cluster visually and semantically consistent video frames together. These frame clusters can then be condensed to form an informative and compact summary of the video. We will present experimental results to show the effectiveness of the semantic attributes in assisting the visual features in video summarization and our new technique achieves state-of-the-art performance.

Due to the high spectral dimensionality of hyperspectral images as well as the difficult and time-consuming process of collecting sufficient labeled samples in practice, the small sample size scenario is one crucial problem and a challenging issue for hyperspectral image classification. Fortunately, the structure information of materials, reflecting region of homogeneity in the spatial domain, offers an invaluable complement to the spectral information. Assuming some spatial regularity and locality of surface materials, it is reasonable to segment the image into different homogeneous parts in advance, called superpixel, which can be used to improve the classification performance. In this paper, a superpixel-based multitask learning framework has been proposed for hyperspectral image classification. Specifically, a set of 2-D Gabor filters are first applied to hyperspectral images to extract discriminative features. Meanwhile, a superpixel map is generated from the hyperspectral images. Second, a superpixel-based spatial-spectral Schroedinger eigenmaps (S4E) method is adopted to effectively reduce the dimensions of each extracted Gabor cube. Finally, the classification is carried out by a support vector machine (SVM)-based multitask learning framework. The proposed approach is thus termed Gabor S4E and SVM-based multitask learning (GS4E-MTLSVM). A series of experiments is conducted on three real hyperspectral image data sets to demonstrate the effectiveness of the proposed GS4E-MTLSVM approach. The experimental results show that the performance of the proposed GS4E-MTLSVM is better than those of several state-of-the-art methods, while the computational complexity has been greatly reduced, compared with the pixel-based spatial-spectral Schroedinger eigenmaps method.

The local binary pattern (LBP) is a simple and efficient texture descriptor for image processing. Recently, LBP has been introduced for feature extraction of hyperspectral imagery. Specifically, the LBP codes are extracted from the 2-D band images to capture the spatial correlation among neighboring pixels, and then the statistical histogram features from all bands, which could estimate the underlying distribution in local area, are concatenated together for pixel-wise classification. However, since hyperspectral imagery contains rich spectral and spatial information, which is actually a 3-D data cube, the 2-D LBP (2-DLBP) model cannot fully exploit the joint spectral-spatial structure. In this paper, the 2-DLBP has been extended into 3-D LBP (3-DLBP) model through forming a 3-D regular octahedral frame to characterize the spectral-spatial relationship. In order to reflect the local continuous property of hyperspectral data in both the spectral and spatial domains, while ensuring the rotational invariance of the 3-DLBP model, the code patterns of 3-DLBP model have been divided into eight groups (including seven groups of “dense” patterns and one group of “nondense” patterns) based on the consistency of spectral-spatial topology structure. Specifically, the patterns in seven “dense” groups correspond to the microstructures in the 3-D domains (such as spots, edges, and flat areas), which has a high percentage in all the 3-DLBP patterns, while the rest patterns are aggregated and treated as the “nondense” patterns. The proposed method is thus called 3-D dense LBP (3-D2LBP) model. Moreover, instead of taking zero as the hard threshold, a slack variable has been introduced to enable the difference between the central pixel and the neighboring ones varying in a small interval, which could greatly decrease the impact of spectral variability and noise, and the discriminative power of the features has been further boosted. The slack threshold-based 3-D2LBP model is named ST-3-D2LBP. A series of experiments is conducted on three real hyperspectral imageries to demonstrate the effectiveness of the proposed two 3-D2LBP-based methods. The experimental results show that the performance of the proposed ST-3-D2LBP is significantly superior to that of 2-DLBP, which is also better than the 3-D2LBP model and several state-of-the-art hyperspectral classification methods.

Through imaging the same spatial area by hyperspectral sensors at different spectral wavelengths simultaneously, the acquired hyperspectral imagery often contains hundreds of band images, which provide the possibility to accurately analyze and identify a ground object. However, due to the difficulty of obtaining sufficient labeled training samples in practice, the high number of spectral bands unavoidably leads to the problem of a “dimensionality disaster” (also called the Hughes phenomenon), and dimensionality reduction should be applied. Concerning band (or feature) selection, conventional methods choose the representative bands by ranking the bands with defined metrics (such as non-Gaussianity) or by formulating the band selection problem as a clustering procedure. Because of the different but complementary advantages of the two kinds of methods, it can be beneficial to use both methods together to accomplish the band selection task. Recently, a fast density-peak-based clustering (FDPC) algorithm has been proposed. Based on the computation of the local density and the intracluster distance of each point, the product of the two factors is sorted in decreasing order, and cluster centers are recognized as points with anomalously large values; hence, the FDPC algorithm can be considered a ranking-based clustering method. In this paper, the FDPC algorithm has been enhanced to make it suitable for hyperspectral band selection. First, the ranking score of each band is computed by weighting the normalized local density and the intracluster distance rather than equally taking them into account. Second, an exponential-based learning rule is employed to adjust the cutoff threshold for a different number of selected bands, where it is fixed in the FDPC. The proposed approach is thus named the enhanced FDPC (E-FDPC). Furthermore, an effective strategy, which is called the isolated-point-stopping criterion, is developed to automatically determine the appropriate number of bands to be selected. That is, the clustering process will be stopped by the emergence of an isolated point (the only point in one cluster). Experimental results on three real hyperspectral data demonstrate that the bands selected by our E-FDPC approach could achieve higher classification accuracy than the FDPC and other state-of-the-art band selection techniques, whereas the isolated-point-stopping criterion is a reasonable way to determine the preferable number of bands to be selected.

Three-dimensional Gabor wavelets have recently been successfully applied for hyperspectral image classification due to their ability to extract joint spatial and spectrum information. However, the dimension of the extracted Gabor feature is incredibly huge. In this letter, we propose a symmetrical-uncertainty-based and Markov-blanket-based approach to select informative and nonredundant Gabor features for hyperspectral image classification. The extracted Gabor features with large dimension are first ranked by their information contained for classification and then added one by one after investigating the redundancy with already selected features. The proposed approach was fully tested on the widely used Indian Pine site data. The results show that the selected features are much more efficient and can achieve similar performance with previous approach using only hundreds of features.