The inherent characteristics of high-dimensional feature redundancy of biomedical data lead to the "curse of dimensionality" in bioinformatics, which brings new challenges to feature selection problems. Recently, the two-stage approach combining the filter and wrapper methods has become popular for feature selection tasks. However, these two-stage or previous one-stage algorithms suffer from blindness in the setting of thresholds, and the search methods tend to fall into local optimum solutions. To this end, we propose a three-stage feature selection method that combines ReliefF and Particle swarm optimization as a specific case, called TS-RePSO, including the filter stage, grouping stage, and wrapper stage. Specifically, in the filter stage, ReliefF is utilized to compute the weights of the features and sort them in descending order. In the grouping stage, the ranked features are grouped based on the density equalization strategy so that the weight of groups in all groups is equal. In the wrapper stage, the proposed grouping PSO is employed to search for the grouped features and select them according to the in-group and out-group evaluation strategies. Extensive experiments are conducted on 5 benchmark datasets and 6 real-world datasets, and experiment results show that the proposed method achieves the best performance.

High dimensional and small samples characterize gene expression data and contain a large number of genes unrelated to disease. Feature selection improves the efficiency of disease diagnosis by selecting a small number of important genes. Unfortunately, existing algorithms do not consider the correlation between features, and search algorithms tend to fall into the local optimal solution in the feature search process. To this end, this paper proposes a feature filter and group evolution hybrid feature selection algorithm (FG-HFS) for high-dimensional gene expression data. Unlike existing algorithms, we propose using spectral clustering to group redundant features into a group. Then, we propose a redundant feature filter algorithm. According to the principle of approximate Markov blanket, grouped feature groups are filtered to delete these redundant features. Among them, filtered features are evenly divided by density according to the feature exponential strategy. Most importantly, we propose using the group evolution multi-objective genetic algorithm to search the filtered feature subsets and evaluate the candidate feature subsets according to the in-group and out-group so as to select the feature subsets with the highest accuracy and the least number. Experimental results show that the average accuracy (ACC) and Matthews correlation coefficient (MCC) indexes of the selected feature subsets (FSs) by the FG-HFS algorithm on 5 gene expression datasets are 92.76% and 88.76%, respectively, which are significantly better than the existing algorithms. In addition, the FSs and ACC/FSs indexes of the FG-HFS algorithm are also better than the existing algorithms, which fully proves the superiority of the FG-HFS algorithm. More importantly, the Wilcoxon and Friedman statistical experiments results show that the feature selection effect of FG-HFS algorithm is significantly better than that of existing algorithms, no matter in pairwise comparison or multiple comparison.

Hidayetoluet al.(2019) proposed a novel memory-centric computation system, MemXCT. As a challenge at SC20, we reproduce the computational efficiency of MemXCT on our Azure cloud cluster. Our experiments evaluate the overall performance and the strong scalability with real datasets and verify part of the conclusions in the original article.