Anchor-based multi-view clustering has gained increasing attention for its efficiency in approximating similarity structures and scaling to large datasets. To reduce the burden of manual hyper-parameter tuning, recent studies have introduced parameter-free extensions. However, existing methods still face critical challenges: anchors are typically fixed after initialization, limiting adaptability to heterogeneous data; enforcing a shared anchor set across views suppresses view-specific diversity; and heuristic or self-weighted fusion strategies often lack explicit cross-view alignment, resulting in structural inconsistencies. To address these issues, we propose a Parameter-Free Multi-view Clustering framework with Adaptive Anchors for Large-scale Data (FPMCAA). Unlike existing approaches that decouple anchor construction and graph fusion, FPMCAA integrates adaptive anchor learning, anchor graph construction, and explicit cross-view alignment within a unified optimization model. Anchors are iteratively refined to capture complex distributions, while view-specific graphs are aligned toward a consensus structure without sacrificing inherent diversity. The framework avoids manual hyperparameter tuning and achieves linear computational complexity through efficient alternating optimization. Extensive experiments on benchmark datasets demonstrate that FPMCAA consistently outperforms state-of-the-art methods in clustering performance, robustness, and scalability. The source code of FPMCAA is available athttps://github.com/Xuchen2020/FPMCAA.

Active learning can effectively reduce the cost of labeling while enhancing model classification performance. However, prior studies have indicated that imbalanced class distributions adversely impact active learning, leading to diminished model effectiveness. Existing approaches to unbalanced active learning often neglect the multi-class imbalance problem and suffer from low performance and high time consumption. To address these issues, this paper introduces a hybrid active learning with online weighted broad learning system (HAL-OWBLS). Its main advantages include: (1) We optimize the initial labeled instance selection through an approximate query strategy to avoid the cold-start problem and introduce a sample selection strategy based on double uncertainty to enhance the rationality of active learning iterations. (2) A weighted broad learning system (WBLS) is chosen as the classifier, and an improved weighting strategy is adopted for multi-class imbalanced data. (3) We theoretically derive an efficient online updating model for WBLS, which reduces the time cost of active learning iterations by using only newly labeled samples for fast updating. The proposed HAL-OWBLS algorithm has better performance and robustness compared with existing related algorithms on various multi-class imbalanced data sets.

The processing of continuous data streams in non-stationary environments has gained increasing attention. However, supervised online learning is often limited by label availability. Furthermore, it is crucial to develop a stable and high-performance online method in non-stationary environments. To tackle these issues, we propose a dynamic chunk-based active learning framework (DCAL). This framework includes a dynamic dual-stage query strategy and an enhanced active learning model. Specifically, the proposed query strategy, referred to as DyDQS, evaluates sample value comprehensively by considering local density, uncertainty, and dynamic imbalance ratio. This approach selects samples that are both representative and uncertain, while also enhancing the likelihood of selecting minority class samples. Additionally, we introduce an enhanced active learning model, named eBLS-W, which is based on the broad learning system (BLS). We redesign the update rule of BLS and equip it with a kernel mapping to improve its robustness and performance, enabling it to better handle non-stationary environments. The effectiveness of the DyDQS, eBLS-W, and DCAL was validated through experiments on synthetic datasets with drift and real-world datasets. The results demonstrate that our approach outperforms other advanced methods in terms of robustness and accuracy.

Active learning can significantly reduce the cost of labeling instances while improving model performance. However, similar to other traditional algorithms, active learning encounters the problem of class imbalance and delivers sub-optimal performance. Additionally, existing approaches suffer from poor performance and are time-consuming. To address these issues, we propose an Actively Incrementally Weighted Broad Learning System (AI-WBLS). Firstly, we introduce an active learning framework based on the weighted broad learning system, which employs a double uncertainty sample selection strategy to enhance the value and reasonableness of sample selection in each iteration of active learning. To further improve the model's adaptability during the iterative learning process, an adaptive weighting strategy is designed to adaptively modify the penalty weights according to the changes in the sample labels. Finally, an efficient incremental paradigm is developed to update the model with newly labelled samples instead of re-training, resulting in improved performance and efficiency. Extensive comparative experiments confirm that our approach outperforms other imbalanced active learning methods.

Multi-modal emotion recognition (MER) integrates multi-modal signals to help computers comprehensively understand human emotions, which is a crucial technology in human-computer interactions. However, the amount of labeled multi-modal emotion data is small and limits MER performance due to its expensive manual annotations. Meanwhile, semi-supervised learning (SSL) methods improving MER models with enormous unlabeled data suffer from confirmation bias, resulting in biased data distribution. To tackle these challenges, this paper proposes a cyclic data distillation semi-supervised learning (CDD-SSL) for MER tasks. CDD-SSL leverages multiple pre-trained unimodal teacher models and confidence-boosting pseudo-labelling (CBPL) to boost the confidence of multi-modal ensemble outputs and distill reliable and class-representative data from numerous unlabeled data. It then utilizes reliable and less-biased data to train a multi-modal student model and provides feedback to update all unimodal teacher models. CDD-SSL is a cyclic teacher-student framework with a feedback mechanism that gradually mitigates confirmation bias and obtains an effective MER model. Experimental results on four benchmark datasets demonstrate that CDD-SSL achieves superior performance over both the semi-supervised methods and the state-of-the-art fully-supervised models in MER tasks.

Semi-supervised multi-label learning (SSMLL) involves learning a multi-label classifier from a small set of labeled data and a large set of unlabeled data. Label enhancement (LE), accounting for the relative importance of labels, has been effective in improving the performance of supervised multi-label learning models. Nevertheless, generating a robust SSMLL model with LE based on incomplete label information remains challenging. In this paper, we pioneer the idea of applying LE to SSMLL. First, we design a kNN aggregation-based method, aiming to assign pseudo-labels to unlabeled data and perform the LE process by aggregating label information from neighboring instances. Leveraging the topological structure of the feature space is an effective LE approach for training. However, LE, decoupled from the training process, lacks the dynamic feedback of the training model. To improve this, we incorporate a label propagation mechanism that iteratively optimizes the LE process with the guidance of the available label information. Moreover, we consider local label correlations according to local linear embedding to further enhance the generalization ability of the learning model. Extensive experiments demonstrate that the proposed approach can effectively recover latent label information, resulting in significant performance improvement in SSMLL.

Feature mining is a challenging work in the field of multivariate time series (MTS) data mining. Traditional methods suffer from three major issues. 1) Learned shapelets may seriously diverge from original subsequences since learning methods do not restrain the learned ones similar to raw sequences, which reduces interpretability. 2) Existing rule mining methods just generate association rules based on feature combination of different variables without considering temporal relations among features, which could not adequately express the essential characteristics of MTS data. 3) Most deep learning methods only mine global and high-level features of MTS data, which affects interpretability. To address these issues, we propose a temporal association rule mining method based on Generative Adversarial Network (GAN) called TAR-GAN. First, a shapelet mining method based on GAN (SGAN) is advanced to discover dataset-level and sample-level shapelets of all variables in MTS data. Second, a Temporal Graph based Rule Mining method (TGRM) is introduced to discover temporal association rules based on the temporal relationships among shapelets of different variables. Meanwhile, a Fast Convolution-based Similarity Measure methods(FCSM) is introduced to measure the similarity between MTS samples and temporal association rules. Furthermore, an adversarial training strategy is introduced to ensure the effectiveness and stability of generated temporal association rules, which could reflect the essential characteristics of MTS data. Extensive experiments on 12 datasets show the effectiveness and efficiency of our method.

Recently, rule-based classification on multivariate time series (MTS) data has gained lots of attention, which could improve the interpretability of classification. However, state-of-the-art approaches suffer from three major issues. 1) few existing studies consider temporal relations among features in a rule, which could not adequately express the essential characteristics of MTS data. 2) due to the concept drift and time warping of MTS data, traditional methods could not mine essential characteristics of MTS data. 3) existing online learning algorithms could not effectively update shapelet-based temporal association rules of MTS data due to its temporal relationships among features of different variables. To handle these issues, we propose an online learning method for temporal association rule on dynamically collected MTS data (OTARL). First, a new type of rule named temporal association rule is defined and mined to represent temporal relationships among features in a rule. Second, an online learning mechanism with a probability correlation-based evaluation criterion is proposed to realize the online learning of temporal association rules on dynamically collected MTS data. Finally, an ensemble classification approach based on maximum-likelihood estimation is advanced to further enhance the classification performance. We conduct experiments on ten real-world datasets to verify the effectiveness and efficiency of our approach.

Feature selection is a highly regarded research area in the field of data mining, as it significantly enhances the efficiency and performance of high-dimensional data analysis by eliminating redundant and irrelevant features. Despite the ease of data acquisition, labeling data remains a laborious and expensive task. To leverage the abundance of unlabeled data, researchers have proposed various feature selection methods that operate with limited labels, including semi-supervised feature selection and unsupervised feature selection. However, a comprehensive review encompassing a thorough overview of feature selection algorithms with limited labels is lacking. To bridge this gap, this paper conducts a comprehensive exploration of feature selection methods specifically tailored to limited-label scenarios. These methods are systematically classified into two primary categories: semi-supervised and unsupervised feature selection. Additionally, by introducing a novel taxonomy and discussing future challenges, this survey aims to provide researchers with a comprehensive and in-depth understanding of feature selection in limited-label scenarios. Moreover, it aims to offer valuable insights that can guide further research and development in this domain.

Imbalanced data biases the classifier towards the majority class. Accompanied with high-dimensional characteristics, classification performance is further degraded. Existing researches for skewed data mainly involve resampling, cost-sensitive learning, and classifier ensemble. However, these approaches have some limitations: 1) resampling suffers from noisy and redundant features in high-dimensional skewed data; 2) cost-sensitive learning is hard to construct an optimal cost matrix for sample misclassification; 3) ensemble with random feature subspace easily leads to information loss; 4) ensemble with sample subspace on small-size data easily leads to insufficient description of sample space and suffers from negative impacts of high-dimensional data. This paper proposes an improved contraction-expansion subspace ensemble (ICESE) for high-dimensional imbalanced data classification. First, a contraction-expansion subspace optimization (CESO) is designed to perform subspace selection and transformation, which is beneficial for enhancing the discrimination and diversity of subspace. Then, to strengthen classification capabilities, a CESO-based multilayer optimization structure is developed to construct the improved subspace. Finally, to mitigate the effects of skewed data, ICESE performs a resampling scheme on the improved subspace for constructing a rebalanced subset to base classifier. Experimental results on 24 high-dimensional imbalanced data sets demonstrate that our ICESE outperforms different mainstream ensemble systems in terms of F-score and G-mean.

Imbalanced data poses a substantial challenge to conventional classification methods, which often disproportionately favor samples from the majority class. To mitigate this issue, various oversampling techniques have been deployed, but opportunities for optimizing data distributions remain underexplored. By exploiting the ability of metric learning to refine the sample distribution, we propose a novel approach, Imbalance Large Margin Nearest Neighbor (ILMNN). Initially, ILMNN is applied to establish a latent feature space, pulling intra-class samples closer and distancing inter-class samples, thereby amplifying the efficacy of oversampling techniques. Subsequently, we allocate varying weights to samples contingent upon their local distribution and relative class frequency, thereby equalizing contributions from minority and majority class samples. Lastly, we employ Kullback-Leibler (KL) divergence as a safeguard to maintain distributional similarity to the original dataset, mitigating severe intra-class imbalances. Comparative experiments on various class-imbalanced datasets verify that our ILMNN approach yields superior results.

Broad learning system (BLS) is a simple yet efficient learning algorithm that only needs to train a three-layer feedforward neural network. Although various BLS variants have been designed for supervised learning, none have been used for unsupervised learning. This paper proposes BLS-AE, a novel data clustering scheme that seamlessly combines BLS and auto-encoder. Then, graph regularization is introduced into BLS-AE to increase the capability of learning intrinsic structures in data and adaptation to various data simultaneously, which is termed BLSg-AE. Moreover, different concatenation styles of feature and enhancement nodes are investigated for reusing the learned features, followed by designing two special strategies (i.e., pruning optimization and incremental learning) to reduce the parameter scale significantly and improve performance, which is termed xBLSg-AE. To address the performance instability issue caused by random subspace in a single xBLSg-AE, the x-cascade broad learning system graph regularization multi-auto-encoder (xBLSg-MAE) algorithm is proposed. Extensive experiments are conducted on multiple real data sets to demonstrate that the proposed methods are more effective and robust than competing approaches.

Due to the advantages of fast training speed and competitive performance, Broad Learning System (BLS) has been widely used for classification tasks across various domains. However, the random weight generation mechanism in BLS makes the model unstable, and the performance of BLS may be limited when dealing with some complex datasets. On the other hand, the instability of BLS brings diversity to ensemble learning, and ensemble methods can also reduce the variance and bias of the single BLS. Therefore, we propose an ensemble learning algorithm based on BLS, which includes three modules. To improve the stability and generalization ability of BLS, we utilize BLS as the base classifier in an AdaBoost framework first. Taking advantage of the incremental learning mechanism of BLS, we then propose a selective ensemble method to raise the accuracy and diversity of the BLS ensemble method. In addition, based on the former selective Adaboost framework, we suggest a hierarchical ensemble algorithm, which combines sample and feature dimensions to further improve the fitting ability of the ensemble BLS. Extensive experiments have demonstrated that the proposed method performs better than the original BLS and other state-of-the-art models, proving the effectiveness and versatility of our proposed approaches.

Cluster ensemble improves the robustness and stability of clustering performances by utilizing multiple solutions. Although traditional cluster ensemble methods have achieved promising performances, they are not adaptive enough to cope with data sets that have multiple levels of complexities. Besides, these methods may contain noisy and redundancy members which have negative effects. To mitigate the above issues, in this paper, we propose a multi-objective filter refinement scheme (MOFRS). First, we perform various clustering methods on different representations of data to generate diverse solutions. Second, we propose a solution filter to select a proper method and reduce the number of initial partitions for a given data set. Third, four stability indices are designed to split instances into stable and unstable groups. Fourth, objective functions based on diversity and quality are utilized to quantify the goodness of base clustering solutions. Finally, we design an improvement oriented multi-objective evolutionary algorithm to optimize these objective functions. Extensive experimental results conducted on 27 real-world data sets show that MOFRS outperforms most cluster ensemble selection methods, and achieves statistically significant improvements, compared with full ensemble methods.

Ensemble clustering has an advantage in producing a more promising and robust clustering result by combining multiple partitions strategically. The quality of both base partitions and co-association matrix plays an essential role in improving the consensus partition. However, the current ensemble clustering methods have several limitations: 1) The noise in high-dimensional feature space is ignored; 2) The independent base partition generation process does not pay attention to ambiguous samples; 3) The co-association matrix and the weights of base partitions commonly lack of theoretical optimization. In order to address these issues, we propose an adaptive ensemble clustering framework with boosting BLS-based autoencoder (BoostAEC). In the generation step, a boosting BLS-based autoencoder (BoostBLSAE) is designed to generate base partitions sequentially, which learns compressed feature subspaces for ambiguous samples and adaptively evaluates the corresponding weights of reliability. In the integration step, we construct a fuzzy membership function to capture the inter-cluster correlation and explicitly propose a consensus objective function to optimize the unified co-association matrix by considering the weighted base partitions. Extensive experiments on various real-world datasets demonstrate the superior performance of BoostAEC to the state-of-the-art ensemble clustering methods.

High-dimensional small-size data seriously affects the performance of classifiers. By combining classifiers, ensemble learning obtains higher accuracy and more robust predictions. However, these classifier ensemble methods suffer from several limitations: 1) ensemble with sample space suffers from noise and redundant features; 2) constructing sample subspace on small-size data leads to an insufficient description of sample space; 3) ensemble with feature space leads to information loss, which will degrade performance of classifiers. To overcome the above limitations, a new classifier ensemble method based on subspace enhancement (CESE) is proposed for high-dimensional data classification. First, a superior subspace enhancement scheme (SSE) is designed to effectively implement feature selection and transformation for high-dimensional data, followed by generating multiple superior feature subspaces with diversity and discrimination, which enhances the representative ability of features. Second, we develop a mixed space enhancement process (MSE) based on multiscale rotation reconstruction and various subspace enhanced features of SSE. Furthermore, to improve the capacity of our method, we design various feature combination strategies for enhanced features from both SSE and MSE. Comparative results on 33 high-dimensional data sets indicate that our approach CESE outperforms different mainstream integrated system

With effective performance and fast training speed, broad learning system (BLS) has been widely developed in recent years, which provides a new way for network training. However, the randomly generated feature nodes and enhancement nodes in the BLS network may have redundant and inefficient features, which will affect the subsequent classification performance. In response to the above issues, we propose a series of self-encoding networks based on BLS from the perspective of unsupervised feature extraction. These include the single hidden layer autoencoder built on the basis of BLS(BLS-AE), the stacked BLS-based autoencoder (ST-BLS), the sparse BLS-based autoencoder (SP-BLS), and the stacked sparse BLS-based autoencoder(SS-BLS). The proposed BLS-based self-encoding networks retain the advantage of efficient BLS model training, and overcome the time-consuming defect of iterative parameter optimization in traditional self-encoding networks. In addition, the higher-level abstract features of the input data can be learned through the progressive encoding and decoding process. Combining$L_1$regularization to train the parameters can further enhance the robustness of the extracted features. Extensive comparative experiments on real-world data sets demonstrate the superiority of the proposed methods in terms of both effectiveness and efficiency.

Most of the existing classification systems assume that the data used is high-quality labeled. However, the labeling process in real-world may inevitably introduce corruptions into labels which can confuse the performances of classifiers. In this paper, based on Broad Learning System (BLS), we propose a novel label noise tolerant method to classify the pattern with corrupted labels. The standard BLS has shown promising efficiency and accuracy in general classification, but its learning process is prone to be affected by the noisy labels. Here, by detailed probabilistic analysis, we first give the reason for lacks of robustness in standard BLS. Then a maximum likelihood estimation-based objective function is derived for robust classification. In addition, a manifold regularization term is integrated to preserve the local geometry of data, which makes the model to be more robust and flexible to learn the output weights. Given some basic assumptions on the approximation errors, the obtained model can be transformed to a graph regularized reweighted BLS problem. The negative effects of noisy labels in data can be inhibited adaptively by assigning reasonable weights. Theoretical analysis and extensive experiments are provided to demonstrate the robustness and effectiveness of the proposed robust BLS model, especially for the case of large amounts of noisy labels.

Mobile social networks include a large number of social members who forward messages cooperatively. However, spammers post links to viruses and advertisements, or follow a large number of users, which produces many misleading messages in mobile social networks. In this paper, we propose an adaptive social spammer detection (ASSD) model. We build a spammer classifier by using a small number of labeled patterns and some unlabeled patterns. The prediction accuracy is high compared with some conventional supervised learning methods. Moreover, the time and energy required to label the identity of social members are reduced by applying ASSD. Because social spammers frequently change their behavior to deceive the spammer detection model, an incremental learning method is designed to update the spammer detection model adaptively, without retraining. We evaluate ASSD by comparing it with other supervised and semi-supervised machine learning methods using the Social Honeypot Dataset. Experimental results show that the proposed model outperforms the baseline methods in terms of recall and precision. Additionally, ASSD maintains a high detection accuracy by adaptively updating the model with newly generated social media data.

Broad learning system (BLS) is a novel and efficient model, which facilitates representation learning and classification by concatenating feature nodes and enhancement nodes. In spite of the efficient properties, BLS is still suboptimal when facing with imbalance problem. Besides, outliers and noises in imbalanced data remain a challenge for BLS. To address the above issues, in this paper we first propose a weighted BLS, which assigns a weight to each training sample, and adopt a general weighting scheme, which augments the weight of samples from the minority class. To further explore the prior distribution of original data, we design a density based weight generation mechanism to guide the specific weight matrix generation and propose the adaptive weighted broad learning system (AWBLS). This mechanism considers the inter-class and intra-class distance simultaneously in the density calculation. Finally, we propose the incremental weighted ensemble broad learning system (IWEB) by utilizing a progressive mechanism to further improve the stability and robustness of AWBLS. Extensive comparative experiments on 38 real-world data sets verfy that IWEB outperforms most of the imbalance ensemble classification methods.

In this paper, we propose two GAN-based enhanced deep subspace clustering approaches: deep subspace clustering via dual adversarial generative networks (DSC-DAG) and self-supervised deep subspace clustering with adversarial generative networks ($S^2 DSC-AG$). In DSC-DAG, the distributions of both the inputs and corresponding latent representations are learning via adversarial training simultaneously. Besides, there are two kinds of synthetical representations to facilitate the fine-tuning of the encoder module: the combinations of latent representations with certain random combination coefficients and the representations of real-like inputs derived from noise variables. In$S^DSC-AG$, a self-supervised information learning module substitutes for adversarial learning in the latent space, since both of them play the same role in learning discriminative latent representations. We analyze the connections between these methods and demonstrate their equivalences. We conduct extensive experiments on multiple real-world data sets against state-of-the-art subspace clustering methods in terms of accuracy, normalized mutual information and purity. Experimental results demonstrate the effectiveness and superiority of our proposed methods.

Cross-database micro-expression recognition (CDMER) is one of recently emerging and interesting problem in micro-expression analysis. CDMER is more challenging than the conventional micro-expression recognition (MER), because the training and testing samples in CDMER come from different micro-expression databases, resulting in inconsistency of the feature distributions between the training and testing sets. In this paper, we contribute to this topic from three aspects. First, we establish a CDMER experimental evaluation protocol aiming to allow the researchers to conveniently work on this topic and evaluate their proposed methods under the same standard. Second, we conduct benchmark experiments by using NINE state-of-the-art domain adaptation (DA) methods and SIX popular spatiotemporal descriptors for investigating CDMER problem from two different perspectives. Third, we propose a novel DA method called region selective transfer regression (RSTR) to deal with the CDMER task. The overall superior performance of RSTR over the state-of-the-art DA methods demonstrates that taking into consideration the facial local region information used in RSTR contributes to developing effective DA methods for dealing with CDMER problem.

Classifying high-dimensional small-size data is challenging in the field of pattern recognition. Traditional ensemble learning methods have several limitations: 1) sample-space based methods are easily affected by noise and redundant features; 2) feature-space based methods cannot excavate the essential characteristics of features; 3) feature subspaces cause information loss, which leads to a decline in accuracy; 4) most selective ensemble methods only consider the diversity and performance of sub-classifiers and ignore the impact on integration systems. To address the above limitations, we propose an adaptive classifier ensemble learning method (AdaSPEL) based on spatial perception for high-dimensional data. First, we design a local-space perception method for feature transformation, which encourages both high performance and diversity of the ensemble members. Second, we design a cross-space perception method based on the distribution of samples to obtain the cross-space enhanced features to provide a macro analysis for the characteristics of data. Furthermore, an adaptive selective ensemble method based on local and global evaluation mechanisms is proposed, which considers the impact of sub-classifiers on integrated systems. Experimental results on 33 high-dimensional data sets verify that our method outperforms mainstream ensemble learning methods based on feature space and sample space, and neural network-based algorithms.

High-dimensional and large-scale time series processing has aroused considerable research interests during decades. It is difficult for traditional methods to reveal the evolution state in dynamical systems and discover the relationship among variables automatically. In this paper, we propose a unified framework for nonuniform embedding, dynamical system revealing, and time series prediction, termed as Structured Manifold Broad Learning System (SM-BLS). The structured manifold learning is introduced for nonuniform embedding and unsupervised manifold learning simultaneously. Graph embedding and feature selection are both considered to depict the intrinsic structure connections between chaotic time series and its low-dimensional manifold. Compared with traditional methods, the proposed framework could discover potential deterministic evolution information of dynamical systems and make the modeling more interpretable. It provides us a homogeneous way to recover the chaotic attractor from multivariate and heterogeneous time series. Simulation analysis and results show that SM-BLS has advantages in dynamic discovery and feature extraction of large-scale chaotic time series prediction.

This work presents a feature selection method based on proximity relations learning. Each single feature is treated as a binary classifier that predicts for any three objects X, A, and B whether X is close to A or B. The performance of the classifier is a direct measure of feature quality. Any linear combination of feature-based binary classifiers naturally corresponds to feature selection. Thus, the feature selection problem is transformed into an ensemble learning problem of combining many weak classifiers into an optimized strong classifier. We provide a theoretical analysis of the generalization error of our proposed method which validates the effectiveness of our proposed method. Various experiments are conducted on synthetic data, four UCI data sets and 12 microarray data sets, and demonstrate the success of our approach applying to feature selection. A weakness of our algorithm is high time complexity.