Sketch-based person re-identification aims to match hand-drawn sketches with RGB surveillance images, but remains challenging due to severe modality gaps and limited labeled data. To address this, we propose KTCAA, a theoretically inspired framework for few-shot cross-modal generalization. Drawing on generalization bounds, we identify two key factors affecting target risk: (1) domain discrepancy, reflecting the alignment difficulty between source and target distributions; and (2) perturbation invariance, measuring the model’s robustness to modality shifts. Accordingly, we design: (1) Alignment Augmentation (AA), which applies localized sketch-style transformations to simulate target distributions and guide progressive alignment; and (2) Knowledge Transfer Catalyst (KTC), which enhances perturbation invariance by introducing worst-case modality perturbations and enforcing consistency. These modules are jointly optimized within a meta-learning paradigm that transfers alignment knowledge from data-abundant RGB domains to sketch scenarios. Experiments on multiple benchmarks show that KTCAA achieves state-of-the-art performance, particularly under data-scarce conditions.

Accurate and efficient simulations of physical phenomena governed by partial differential equations (PDEs) are important for scientific and engineering progress. While traditional numerical solvers are powerful, they are often computationally expensive. Recently, data-driven methods have emerged as alternatives, but they frequently suffer from error accumulation and limited physical consistency, especially in multiphysics and complex geometries. To address these challenges, we propose PEGNet, a Physics-Embedded Graph Network that incorporates PDE-guided message passing to redesign the graph neural network architecture. By embedding key PDE dynamics like convection, viscosity, and diffusion into distinct message functions, the model naturally integrates physical constraints into its forward propagation, producing more stable and physically consistent solutions. Additionally, a hierarchical architecture is employed to capture multi-scale features, and physical regularization is integrated into the loss function to further enforce adherence to governing physics. We evaluated PEGNet on benchmarks, including custom datasets for respiratory airflow and drug delivery, showing significant improvements in long-term prediction accuracy and physical consistency over existing methods.

With the rise of 3D Gaussian Splatting (3DGS), a variety of digital watermarking techniques, embedding either 1D bitstreams or 2D images, are used for copyright protection. However, the robustness of these watermarking techniques against potential attacks remains underexplored. This paper introduces the first universal black-box attack framework, the Group-based Multi-objective Evolutionary Attack (GMEA), designed to challenge these watermarking systems. We formulate the attack as a large-scale multi-objective optimization problem, balancing watermark removal with visual quality. In a black-box setting, we introduce an indirect objective function that blinds the watermark detector by minimizing the standard deviation of features extracted by a convolutional network, thus rendering the feature maps uninformative. To manage the vast search space of 3DGS models, we employ a group-based optimization strategy to partition the model into multiple, independent sub-optimization problems. Experiments demonstrate that our framework effectively removes both 1D and 2D watermarks from mainstream 3DGS watermarking methods while maintaining high visual fidelity. This work reveals critical vulnerabilities in existing 3DGS copyright protection schemes and calls for the development of more robust watermarking systems.

Multiphysics simulation aims to predict and understand interactions between multiple physical phenomena, aiding in comprehending natural processes and guiding engineering design. The system of Partial Differential Equations (PDEs) is crucial for representing these physical fields, and solving these PDEs is fundamental to such simulations. However, current methods primarily yield numerical outputs, limiting interpretability and generalizability. We introduce T-NNGP, a hybrid genetic programming algorithm that integrates traditional numerical methods with deep learning to derive approximate symbolic expressions for multiple unknown functions within a system of PDEs. T-NNGP initially obtains numerical solutions using traditional methods, then generates candidate symbolic expressions via deep reinforcement learning, and finally optimizes these expressions using genetic programming. Furthermore, a universal decoupling strategy guides the search direction and addresses coupling problems, thereby accelerating the search process. Experimental results on three types of PDEs demonstrate that our method can reliably obtain human-understandable symbolic expressions that fit both the PDEs and the numerical solutions from traditional methods. This work advances multiphysics simulation by enhancing our ability to derive approximate symbolic solutions for PDEs, thereby improving our understanding of complex physical phenomena.

Partial differential equations (PDEs) are fundamental in various scientific and engineering fields. Methods based on symbolic regression to solve PDEs have gained attention due to their inherent interpretability. However, existing symbolic regression methods rely solely on genetic programming (GP) during the search process, which presents opportunities for improvement in both precision and stability. We introduce a novel framework, itemd NetGP, which enhances symbolic regression for PDEs in three key aspects. First, NetGP employs prefix notation arrays to represent symbolic expressions, simplifying the evaluation process. Second, to improve the stability of the evolutionary process, deep reinforcement learning is integrated to generate new individuals. Additionally, a novel operator is proposed to avoid the generation of invalid expressions during crossover and mutation of array-based individuals. Empirical evaluations across five types of PDEs demonstrate that NetGP achieves outstanding accuracy and stability in solving these PDEs. The code can be found at https://github.com/grassdeerdeer/NetGP.

4D content generation aims to create dynamically evolving 3D content that responds to specific input objects such as images or 3D representations. Current approaches typically incorporate physical priors to animate 3D representations, but these methods suffer from significant limitations: they not only require users lacking physics expertise to manually specify material properties but also struggle to effectively handle the generation of multi-material composite objects. To address these challenges, we propose Phys4DGen, a novel 4D generation framework that integrates multi-material composition perception with physical simulation. The framework achieves automated, physically plausible 4D generation through three innovative modules: first, the 3D Material Grouping module partitions heterogeneous material regions on 3D representations' surfaces via semantic segmentation; second, the Internal Physical Structure Discovery module constructs the mechanical structure of object interiors; finally, we distill physical prior knowledge from multimodal large language models to enable rapid and automatic material properties identification for both objects' surfaces and interiors. Experiments on both synthetic and real-world datasets demonstrate that Phys4DGen can generate high-fidelity 4D content with physical realism in open-world scenarios, significantly outperforming state-of-the-art methods.

Bilevel optimization problems (BLOPs) are characterized by an interactive hierarchical structure, where the upper level seeks to optimize its strategy while simultaneously considering the response of the lower level. Evolutionary algorithms are commonly used to solve complex bilevel problems in practical scenarios, but they face significant resource consumption challenges due to the nested structure imposed by the implicit lower-level optimality condition. This challenge becomes even more pronounced as problem dimensions increase. Although recent methods have enhanced bilevel convergence through task-level knowledge sharing, further efficiency improvements are still hindered by redundant lower-level iterations that consume excessive resources while generating unpromising solutions. To overcome this challenge, this article proposes an efficient dynamic resource allocation framework for evolutionary bilevel optimization, named DRC-BLEA. Compared to existing approaches, DRC-BLEA introduces a novel competitive quasi-parallel paradigm, in which multiple lower-level optimization tasks, derived from different upper-level individuals, compete for resources. A continuously updated selection probability is used to prioritize execution opportunities to promising tasks. Additionally, a cooperation mechanism is integrated within the competitive framework to further enhance efficiency and prevent premature convergence. Experimental results compared with chosen state-of-the-art algorithms demonstrate the effectiveness of the proposed method. Specifically, DRC-BLEA achieves competitive accuracy across diverse problem sets and real-world scenarios, while significantly reducing the number of function evaluations and overall running time.

Evolutionary multitasking (EMT) is an emerging research direction within the evolutionary computation community, attempting to concurrently solve multiple optimization tasks by exploiting the underlying synergies between the tasks. Recently, numerous explicit transfer strategies have been developed for enhancing positive transfer among optimization tasks. Nevertheless, most of these methods conduct knowledge transfer by transferring the best solutions from a source task to the target task, while ignoring the proper use of information from the target task in solution selection. As a result, the transferred solutions could not well adapt to the target task, thus limiting the effectiveness of knowledge transfer across tasks. To address this issue, this paper proposes a solution selection method based on the lower confidence bound (LCB) for EMT, which is designed by leveraging task-specific information of both source and target tasks. With the proposed LCB metric, a number of high-quality solutions that could be more helpful for the target task can be selected and transferred to enhance positive transfer in EMT. To verify the effectiveness of the proposed approach, the solution selection method is embedded into several existing EMT algorithms and then evaluated on the single-objective multitasking benchmarks, the multiobjective multitasking benchmark, and a real-world application. The obtained results confirmed the generality and efficacy of the proposed solution selection approach.

In recent years, dynamic multiobjective evolutionary algorithms (DMOEAs) using the prediction strategy have shown promising performance for solving dynamic multiobjective optimization problems (DMOPs), as they can predict environmental changing trends in advance. However, most of them follow a regular change pattern and thus their performance is compromised when solving DMOPs with irregular change patterns (e.g., nonlinear correlations). To alleviate this challenge, this article proposes a DMOEA with a learnable prediction for tackling DMOPs. Specifically, a neural network is designed to effectively capture diverse change patterns of the environment. Based on the change patterns learned, a directional improvement prediction (DIP) is developed to guide the evolutionary search toward promising directions in the decision space. In this way, a superior initial population with good convergence and diversity is predicted by DIP, which can be more effective for solving various DMOPs. Comprehensive empirical studies show that the proposed DIP is effective and the proposed algorithm has some advantages over five competitive DMOEAs when solving three commonly used benchmarks and one real-world problem.

Conducting real-world train crash experiments is the most straightforward and effective method to research the train’s crashworthiness and enhance passive safety protection. As a non-contact measurement method, high-speed camera can efficiently capture the evolving motion patterns of trains under the high-speed states. Traditional data extraction methods rely on expert-based manual annotations, which are susceptible to factors such as illumination changes, scale variance, and shock debris. Inspired by the tremendous success of Deep Neural Networks in the computer vision community, we firstly collect 75 real-world train crash scenes and manually annotated them to form the Crash2024 dataset, enriching the community’s data resources. Moreover, we propose a novel Gradient-guided Joint representation loss with Adaptive neck Detection network (GJADet). At the macro level, we embed the adaptive module into the Path Aggregation Feature Pyramid Network, which combines multiple self-attention mechanisms to achieve scale-awareness, spatial-awareness, and task-awareness, improving the detector’s representation ability and alleviating the dense-small characteristics of the ‘point’ class without significant computational overhead. At the micro level, due to the extreme imbalance of ‘point’ class compared to other classes, we propose a gradient-guided joint representation classification loss to mitigate the long-tailed detection issue. Moreover, the classification and regression are joint representation to maintain consistency between training and inference phase. On the Crash2024, GJADet achieves the performance improvement of 3.5AP and significantly alleviate the accuracy loss problem for rare categories. Our code are open source athttps://github.com/YanJieWen/GJADet-crash-pytorch.

While graph neural networks (GNNs) have become the de facto standard for graph-based node classification, they impose a strong assumption on the availability of sufficient labeled samples. This assumption restricts the classification performance of prevailing GNNs on many real-world applications suffering from low-data regimes. Specifically, features extracted from scarce labeled nodes could not provide sufficient supervision for the unlabeled samples, leading to severe overfitting. We point out that leveraging subgraphs to capture long-range dependencies can augment the node representation, thus alleviating the low-data regime. To this end, we present a novel self-supervised learning (SSL) framework, called multiview subgraph neural networks (Muse), for handling the long-range dependencies. In particular, we propose an information theory-based identification mechanism to identify two types of subgraphs from the views of input space and latent space, respectively. The former is to capture the local structure of the graph, while the latter captures the long-range dependencies among nodes. By fusing these two views of subgraphs, the learned representations can preserve the topological properties of the graph at large, including the local structure and long-range dependencies, thus maximizing their expressiveness. Theoretically, we provide the generalization error bound to show the effectiveness of capturing complementary information from multiview subgraphs. Empirically, we show a proof-of-concept of Muse on canonical node classification problems on graph data.

In recent years, machine learning algorithms, especially deep learning, have shown promising prospects in solving Partial Differential Equations (PDEs). However, as the dimension increases, the relationship and interaction between variables become more complex, and existing methods are difficult to provide fast and interpretable solutions for high-dimensional PDEs. To address this issue, we propose a genetic programming symbolic regression algorithm based on transfer learning and automatic differentiation to solve PDEs. This method uses genetic programming to search for a mathematically understandable expression and combines automatic differentiation to determine whether the search result satisfies the PDE and boundary conditions to be solved. To overcome the problem of slow solution speed caused by large search space, we propose a transfer learning mechanism that transfers the structure of one-dimensional PDE analytical solution to the form of high-dimensional PDE solution. We tested three representative types of PDEs, and the results showed that our proposed method can obtain reliable and human-understandable real solutions or algebraic equivalent solutions of PDEs, and the convergence speed is better than the compared methods. Code of this project is at https://github.com/grassdeerdeer/HD-TLGP.

A plethora of fair graph neural networks (GNNs) have been proposed to promote algorithmic fairness for high-stake real-life contexts. Meanwhile, explainability is generally proposed to help machine learning practitioners debug models by providing human-understandable explanations. However, seldom work on explainability is made to generate explanations for fairness diagnosis in GNNs. From the explainability perspective, this paper explores the problem of what subgraph patterns cause the biased behavior of GNNs, and what actions could practitioners take to rectify the bias? By answering the two questions, this paper aims to produce compact, diagnostic, and actionable explanations that are responsible for discriminatory behavior. Specifically, we formulate the problem of generating diagnostic and actionable explanations as a multi-objective combinatorial optimization problem. To solve the problem, a dedicated multi-objective evolutionary algorithm is presented to ensure GNNs' explainability and fairness in one go. In particular, an influenced nodes-based gradient approximation is developed to boost the computation efficiency of the evolutionary algorithm. We provide a theoretical analysis to illustrate the effectiveness of the proposed framework. Extensive experiments have been conducted to demonstrate the superiority of the proposed method in terms of classification performance, fairness, and interpretability.

Neural operators are a class of neural networks to learn mappings between infinite-dimensional function spaces, and recent studies have shown that using neural operators to solve partial differential equations is a promising direction. However, the latest neural operator-based algorithms still leave space for increasing the running speed of algorithms while maintaining accuracy. In this work, we propose a new neural operator by using a neural network to "imitate" the process of the Fourier Transform to solve partial differential equations, called the Imitative Fourier Neural Operator (IFNO). The advantage of this method is to use the property of Fourier Transform to transform the partial differential equation into an algebraic equation, which reduces the fitting difficulty of the neural network and improves the training speed. We compare the proposed algorithm with several state-of-the-art designs on different benchmark instances. The experimental results confirm the effectiveness and performance of the proposed method for solving partial differential equations.

Person Re-identification (re-ID) in computer vision aims to recognize and track individuals across different cameras. While previous research has mainly focused on challenges like pose variations and lighting changes, the impact of extreme capture conditions is often not adequately addressed. These extreme conditions, including varied lighting, camera styles, angles, and image distortions, can significantly affect data distribution and re-ID accuracy.Current research typically improves model generalization under normal shooting conditions through data augmentation techniques such as adjusting brightness and contrast. However, these methods pay less attention to the robustness of models under extreme shooting conditions. To tackle this, we propose a multi-mode synchronization learning (MMSL) strategy . This approach involves dividing images into grids, randomly selecting grid blocks, and applying data augmentation methods like contrast and brightness adjustments. This process introduces diverse transformations without altering the original image structure, helping the model adapt to extreme variations. This method improves the model’s generalization under extreme conditions and enables learning diverse features, thus better addressing the challenges in re-ID. Extensive experiments on a simulated test set under extreme conditions have demonstrated the effectiveness of our method. This approach is crucial for enhancing model robustness and adaptability in real-world scenarios, supporting the future development of person re-identification technology.

In the contemporary of deep learning, where models often grapple with the challenge of simultaneously achieving robustness against adversarial attacks and strong generalization capabilities, this study introduces an innovative Local Feature Masking (LFM) strategy aimed at fortifying the performance of Convolutional Neural Networks (CNNs) on both fronts. During the training phase, we strategically incorporate random feature masking in the shallow layers of CNNs, effectively alleviating overfitting issues, thereby enhancing the model’s generalization ability and bolstering its resilience to adversarial attacks. LFM compels the network to adapt by leveraging remaining features to compensate for the absence of certain semantic features, nurturing a more elastic feature learning mechanism. The efficacy of LFM is substantiated through a series of quantitative and qualitative assessments, collectively showcasing a consistent and significant improvement in CNN’s generalization ability and resistance against adversarial attacks—a phenomenon not observed in current and prior methodologies. The seamless integration of LFM into established CNN frameworks underscores its potential to advance both generalization and adversarial robustness within the deep learning paradigm. Through comprehensive experiments, including robust person re-identification baseline generalization experiments and adversarial attack experiments, we demonstrate the substantial enhancements offered by LFM in addressing the aforementioned challenges. This contribution represents a noteworthy stride in advancing robust neural network architectures.

Studying adversarial attacks on artificial intelligence (AI) systems helps discover model shortcomings, enabling the construction of a more robust system. Most existing adversarial attack methods only concentrate on single-task single-model or single-task cross-model scenarios, overlooking the multi-task characteristic of artificial intelligence systems. As a result, most of the existing attacks do not pose a practical threat to a comprehensive and collaborative AI system. However, implementing cross-task attacks is highly demanding and challenging due to the difficulty in obtaining the real labels of different tasks for the same picture and harmonizing the loss functions across different tasks. To address this issue, we propose a self-supervised Cross-Task Attack framework (CTA), which utilizes co-attention and anti-attention maps to generate cross-task adversarial perturbation. Specifically, the co-attention map reflects the area to which different visual task models pay attention, while the anti-attention map reflects the area that different visual task models neglect. CTA generates cross-task perturbations by shifting the attention area of samples away from the co-attention map and closer to the anti-attention map. We conduct extensive experiments on multiple vision tasks and the experimental results confirm the effectiveness of the proposed design for adversarial attacks.

In recent years, there has been significant research focusing on addressing security concerns in single-modal person re-identification (ReID) systems that are based on RGB images. However, the safety of cross-modality scenarios, which are more commonly encountered in practical applications involving images captured by infrared cameras, has not received adequate attention. The main challenge in cross-modality ReID lies in effectively dealing with visual differences between different modalities. For instance, infrared images are typically grayscale, unlike visible images that contain color information. Existing attack methods have primarily focused on the characteristics of the visible image modality, overlooking the features of other modalities and the variations in data distribution among different modalities. This oversight can potentially undermine the effectiveness of these methods in image retrieval across diverse modalities. This study represents the first exploration into the security of cross-modality ReID models and proposes a universal perturbation attack specifically designed for cross-modality ReID. This attack optimizes perturbations by leveraging gradients from diverse modality data, thereby disrupting the discriminator and reinforcing the differences between modalities. We conducted experiments on three widely used cross-modality datasets, namely RegDB, SYSU, and LLCM. The results not only demonstrate the effectiveness of our method but also provide insights for future improvements in the robustness of cross-modality ReID systems.

While image-to-text models have demonstrated significant advancements in various vision-language tasks, they remain susceptible to adversarial attacks. Existing white-box attacks on image-to-text models require access to the architecture, gradients, and parameters of the target model, resulting in low practicality. Although the recently proposed gray-box attacks have improved practicality, they suffer from semantic loss during the training process, which limits their targeted attack performance. To advance adversarial attacks of image-to-text models, this paper focuses on a challenging scenario: decision-based black-box targeted attacks where the attackers only have access to the final output text and aim to perform targeted attacks. Specifically, we formulate the decision-based black-box targeted attack as a large-scale optimization problem. To efficiently solve the optimization problem, a three-stage process \textit{Ask, Attend, Attack}, called \textit{AAA}, is proposed to coordinate with the solver. \textit{Ask} guides attackers to create target texts that satisfy the specific semantics. \textit{Attend} identifies the crucial regions of the image for attacking, thus reducing the search space for the subsequent \textit{Attack}. \textit{Attack} uses an evolutionary algorithm to attack the crucial regions, where the attacks are semantically related to the target texts of \textit{Ask}, thus achieving targeted attacks without semantic loss. Experimental results on transformer-based and CNN+RNN-based image-to-text models confirmed the effectiveness of our proposed \textit{AAA}.

The large-scale multiobjective optimization problem (LSMOP) is characterized by simultaneously optimizing multiple conflicting objectives and involving hundreds of decision variables. Many real-world applications in engineering can be modeled as LSMOPs; simultaneously, engineering applications require insensitivity in performance. This requirement typically means that the algorithm should not only produce good results in terms of performance for every run but also the performance of multiple runs should not fluctuate too much. However, existing large-scale multiobjective optimization algorithms often focus on improving algorithm performance, but pay little attention to improving the insensitivity characteristic of algorithms. This directly leads to substantial limitations when solving practical problems. In this work, we propose an evolutionary algorithm called large-scale multiobjective optimization algorithm via Monte Carlo tree search, which is based on the Monte Carlo tree search and aims to improve the performance and insensitivity of solving LSMOPs. The proposed method samples decision variables to construct new nodes on the Monte Carlo tree for optimization and evaluation, and it selects nodes with good evaluations for further searches in order to reduce the performance sensitivity caused by large-scale decision variables. We propose two metrics to measure the sensitivity of the algorithm and compare the proposed algorithm with several state-of-the-art designs on different benchmark functions and metrics. The experimental results confirm the effectiveness and performance insensitivity of the proposed design for solving LSMOPs.

Network representation learning, also known as network embedding, aims to learn the low-dimensional representations of vertices while capturing and preserving the network structure. For real-world networks, the edges that represent some important relationships between the vertices of a network may be missed and may result in degenerated performance. The existing methods usually treat missing edges as negative samples, thereby ignoring the true connections between two vertices in a network. To capture the true network structure effectively, we propose a novel network representation learning method called WalkGAN, where random walk scheme and generative adversarial networks (GAN) are incorporated into a network embedding framework. Specifically, WalkGAN leverages GAN to generate the synthetic sequences of the vertices that sufficiently simulate random walk on a network and further learn vertex representations from these vertex sequences. Thus, the unobserved links between the vertices are inferred with high probability instead of treating them as nonexistence. Experimental results on the benchmark network datasets demonstrate that WalkGAN achieves significant performance improvements for vertex classification, link prediction, and visualization tasks.

Information theoretical-based methods have attracted a great attention in recent years and gained promising results for multilabel feature selection (MLFS). Nevertheless, most of the existing methods consider a heuristic way to the grid search of important features, and they may also suffer from the issue of fully utilizing labeling information. Thus, they are probable to deliver a suboptimal result with heavy computational burden. In this article, we propose a general optimization framework global relevance and redundancy optimization (GRRO) to solve the learning problem. The main technical contribution in GRRO is a formulation for MLFS while feature relevance, label relevance (i.e., label correlation), and feature redundancy are taken into account, which can avoid repetitive entropy calculations to obtain a global optimal solution efficiently. To further improve the efficiency, we extend GRRO to filter out inessential labels and features, thus facilitating fast MLFS. We call the extension as GRROfast, in which the key insights are twofold: 1) promising labels and related relevant features are investigated to reduce ineffective calculations in terms of features, even labels and 2) the framework of GRRO is reconstructed to generate the optimal result with an ensemble. Moreover, our proposed algorithms have an excellent mechanism for exploiting the inherent properties of multilabel data; specifically, we provide a formulation to enhance the proposal with label-specific features. Extensive experiments clearly reveal the effectiveness and efficiency of our proposed algorithms.

This article suggests a new dynamic multiobjective evolutionary algorithm (DMOEA) with Knowledge Transfer and Maintenance, called KTM-DMOEA, which aims to alleviate the negative transfer and enhance the optimization efficiency. Two strategies, i.e., knowledge transfer prediction (KTP) and knowledge maintenance sampling (KMS), are proposed to excavate useful knowledge from historical environments. Particularly, KTP is a discriminative predictor designed to reduce the feature and distribution divergences across distinct environments, which classifies high-quality solutions from a large number of randomly generated solutions in new environment. Moreover, KMS is a generative predictor by modeling the distribution of elitist solutions in last environment, which can sample superior solutions in new environment according to the dynamic change trends. In this way, the advantages of KTP and KMS strategies are combined to produce a superior initial population in new environment, which help to alleviate the negative transfer and resultantly enhance the overall performance of KTM-DMOEA. When compared to several recently reported DMOEAs, the experimental results validate the advantages of KTM-DMOEA in tackling most cases of benchmark and real-world problems.

Graph meta-learning has become a preferable paradigm for graph-based node classification with long-tail distribution, owing to its capability of capturing the intrinsic manifold of support and query nodes. Despite the remarkable success, graph meta-learning suffers from severe performance degradation when training on graph data with structural noise. In this work, we observe that the structural noise may impair the smoothness of the intrinsic manifold supporting the support and query nodes, leading to the poor transferable priori of the meta-learner. To address the issue, we propose a new approach for graph meta-learning that is robust against structural noise, called Proxy subgraph-based Manifold Calibration method (Pro-MC). Concretely, a subgraph generator is designed to generate proxy subgraphs that can calibrate the smoothness of the manifold. The proxy subgraph compromises two types of subgraphs with two biases, thus preventing the manifold from being rugged and straightforward. By doing so, our proposed meta-learner can obtain generalizable and transferable prior knowledge. In addition, we provide a theoretical analysis to illustrate the effectiveness of Pro-MC. Experimental results have demonstrated that our approach can achieve state-of-the-art performance under various structural noises.

One of the major distinguishing features of Continual Learning(Cl)is that training tasks will change over time, so how to adjust the model to learn different tasks is a challenge. One of the promising solutions is to use stored historical task data to help the model retain old knowledge in the training process for new tasks. However, most existing methods do not take into account that there may be noisy labels in the training data, which will aggravate the forgetting of the old task. In this paper, we propose a replay-based method to solve the continual learning with noisy labels. We first filter the data through the consistency of labels and their feature distribution in the feature space and add it to the replay buffer for the model training. We use supervised contrastive learning to train the model. In order to avoid the loss of other data information, we use the distribution of samples in the feature space to add a pseudo label. To verify the effectiveness of our algorithm, we conducted experiments on four datasets, including three artificial noise datasets MINST, cifar10, cifar100, and a real-world noise dataset Webvision, our method can achieve the best results. The experimental results show that the way we filter data and the way we update buffer data have a very important impact on the performance of the model.

Visible-infrared person re-identification(VI-ReID) aims to match the person images captured by visible and infrared cameras and suffers from severe cross-modality discrepancy and intra-modality variations. Existing approaches mainly use convolution neural network (CNN)-based architectures to extract pedestrian features, which fail to capture the long-range dependencies within an image. In addition, previous works usually attempt to bridge the modality gap by using adversarial learning to generate style-consistent images or designing different feature-level metric learning constraints. However, few works consider the cross-modality disparity from the perspective of assessing overall distance distribution discrepancy. To address these problems, we design a pure Transformer-based Visible-Infrared (TransVI) network with a conventional two-stream structure, which can explicitly capture modality-specific representations and learn multi-modality sharable knowledge. TransVI can efficiently address the lack of global dependency in CNN-based architectures due to the multi-head self-attention modules in the transformer, which allows us to capture the long-range dependencies of pedestrian images. Furthermore, we introduce the Cross-Modality Dissimilarity-based Maximum Mean Discrepancy (CMD-MMD) constraint to handle the cross-modality discrepancy at the distance distribution level. Specifically, CMD-MMD leverages intra-modality distribution separability to guide inter-modality distribution separability learning, aligning pair-wise distance distributions of intra- and inter-modality for within-class and between-class, respectively. In this way, the distance distributions of intra- and inter-modality become more similar, significantly mitigating the cross-modality discrepancy and learning more modality invariant representations. Extensive experimental results on two public VI-ReID datasets confirm that our proposed framework can achieve state-of-the-art performance.

The key task in dynamic multiobjective optimization problems (DMOPs) is to find Pareto-optima closer to the true one as soon as possible once a new environment occurs. Previous dynamic multiobjective evolutionary algorithms (DMOEAs) normally focus on DMOPs with regular environmental changes, but neglect widespread random one, limiting their applications in real-world fields. To address this issue, a knowledge guided transfer strategy (KTS)-based DMOEA is proposed in this article. First, knowledge described as a two-tuple is extracted under each historical environment and preserved to a knowledge pool. Redundant knowledge is recognized and adaptively removed so as to guarantee the diversity of the pool. Second, a knowledge matching strategy is developed to re-evaluate the representative of each stored knowledge under a new environment, with the purpose of finding the most valuable one to promote positive knowledge transfer. Third, an improved knowledge transfer mechanism based on subspace alignment is introduced. By integrating it with the knowledge reuse mechanism, a hybrid transfer strategy is constructed to adaptively select the most suitable one in terms of the similarity degree of selected knowledge on the current environment, and then generate a new initial population. Experiments on 20 benchmark problems demonstrate that the KTS outperforms five state-of-the-art algorithms, achieving good versatility in solving DMOPs with both regular and random changes.

Recently, evolutionary multitasking (EMT) has been successfully used in the field of high-dimensional classification. However, the generation of multiple tasks in the existing EMT-based feature selection (FS) methods is relatively simple, using only the Relief-${F}$method to collect related features with similar importance into one task, which cannot provide more diversified tasks for knowledge transfer. Thus, this article devises a new EMT algorithm for FS in high-dimensional classification, which first adopts different filtering methods to produce multiple tasks and then modifies a competitive swarm optimizer (CSO) to efficiently solve these related tasks via knowledge transfer. First, a diversified multiple task generation method is designed based on multiple filtering methods, which generates several relevant low-dimensional FS tasks by eliminating irrelevant features. In this way, useful knowledge for solving simple and relevant tasks can be transferred to simplify and speed up the solution of the original high-dimensional FS task. Then, a CSO is modified to simultaneously solve these relevant FS tasks by transferring useful knowledge among them. Numerous empirical results demonstrate that the proposed EMT-based FS method can obtain a better feature subset than several state-of-the-art FS methods on 18 high-dimensional datasets.

Class imbalance is a common issue in the community of machine learning and data mining. The class-imbalance distribution can make most classical classification algorithms neglect the significance of the minority class and tend toward the majority class. In this article, we propose a label enhancement method to solve the class-imbalance problem in a graph manner, which estimates the numerical label and trains the inductive model simultaneously. It gives a new perspective on the class-imbalance learning based on the numerical label rather than the original logical label. We also present an iterative optimization algorithm and analyze the computation complexity and its convergence. To demonstrate the superiority of the proposed method, several single-label and multilabel datasets are applied in the experiments. The experimental results show that the proposed method achieves a promising performance and outperforms some state-of-the-art single-label and multilabel class-imbalance learning methods.

Large-scale multiobjective optimization problems (LSMOPs) are characterized as optimization problems involving hundreds or even thousands of decision variables and multiple conflicting objectives. To solve LSMOPs, some algorithms designed a variety of strategies to track Pareto-optimal solutions (POSs) by assuming that the distribution of POSs follows a low-dimensional manifold. However, traditional genetic operators for solving LSMOPs have some deficiencies in dealing with the manifold, which often results in poor diversity, local optima, and inefficient searches. In this work, a generative adversarial network (GAN)-based manifold interpolation framework is proposed to learn the manifold and generate high-quality solutions on the manifold, thereby improving the optimization performance of evolutionary algorithms. We compare the proposed approach with several state-of-the-art algorithms on various large-scale multiobjective benchmark functions. The experimental results demonstrate that significant improvements have been achieved by the proposed framework in solving LSMOPs.

Large-scale multiobjective optimization problems (LSMOPs) refer to optimization problems with multiple con-flicting optimization objectives and hundreds or even thousands of decision variables. A key point in solving LSMOPs is how to balance exploration and exploitation so that the algorithm can search in a huge decision space efficiently. Large-scale multi-objective evolutionary algorithms consider the balance between exploration and exploitation from the individual's perspective. However, these algorithms ignore the significance of tackling this issue from the perspective of decision variables, which makes the algorithm lack the ability to search from different dimensions and limits the performance of the algorithm. In this paper, we propose a large-scale multiobjective optimization algorithm based on the attention mechanism, called (LMOAM). The attention mechanism will assign a unique weight to each decision variable, and LMOAM will use this weight to strike a balance between exploration and exploitation from the decision variable level. Nine different sets of LSMOP benchmarks are conducted to verify the algorithm proposed in this paper, and the experimental results validate the effectiveness of our design.

The performance of traditional multiobj ective evolutionary algorithms (MOEAs) often deteriorates rapidly when using them to solve large-scale multiobjective optimization problems (LMOPs). To effectively handle LMOPs, we propose a large-scale MOEA via self-guided problem transformation. In the proposed optimizer, the original large-scale search space is transferred to a lower-dimensional weighted space by the guidance of solutions themselves, aiming to effectively search in the weighted space for speeding up the convergence of the population. Specifically, the variables of the target LMOP are adaptively and randomly divided into multiple equal groups, and then solutions are self-guided to construct the small-scale weighted space correspondingly to these variable groups. In this way, each solution is projected as a self-guided vector with multiple weight variables, and then new weight vectors can be generated by searching in the weighted space. Next, new offspring is produced by inversely mapping the newly generated weight vectors to the original search space of this LMOP. Finally, the proposed optimizer is tested on two different LMOP test suites by comparing them with five competitive large-scale MOEAs. Experimental results show some advantages of the proposed algorithm in solving the considered benchmarks.

For dynamic multiobjective optimization problems (DMOPs), it is challenging to track the varying Pareto-optimal front. Most traditional approaches estimate the Pareto-optimal sets in the decision space. However, the obtained solutions do not necessarily satisfy the desired properties of decision makers in the objective space. Inverse model-based algorithms have a great potential to solve such problems. Nonetheless, the existing ones have low precision for handling DMOPs with nonlinear correlations between the objective and decision vectors, which greatly limits the application of the inverse models. In this article, an inverse Gaussian process (IGP)-based prediction approach for solving DMOPs is proposed. Unlike most traditional approaches, this approach exploits the IGP to construct a predictor that maps the historical optimal solutions from the objective space to the decision space. A sampling mechanism is developed for generating sample points in the objective space. Then, the IGP-based predictor is employed to generate an effective initial population by using these sample points. The proposed method by introducing IGP can obtain solutions with better diversity and convergence in the objective space, which is more responsive to the demand of decision makers than the traditional methods. It also has better performance than other inverse model-based methods in solving nonlinear DMOPs. To investigate the performance of the proposed approach, experiments have been conducted on 23 benchmark problems and a real-world raw ore allocation problem in mineral processing. The experimental results demonstrate that the proposed algorithm can significantly improve the dynamic optimization performance and has certain practical significance for solving real-world DMOPs.

In multilabel learning, each training example is represented by a single instance, which is relevant to multiple class labels simultaneously. Generally, all relevant labels are considered to be available for labeled data. However, instances with a full label set are difficult to obtain in real-world applications, thus leading to the weakly multilabel learning problem, that is, relevant labels of training data are partially known and many relevant labels are missing, and even abundant training data are associated with an empty label set. To address the problem, we propose a new multilabel method to learn from weakly labeled data. To be specific, an optimization framework is constructed based on the manifold regularized sparse model, in which the correlations among labels and feature structure are considered to model global and local label correlations, thereby achieving discriminative feature analysis for mapping training data to ground-truth label space. Moreover, the proposed method has an excellent mechanism to conduct semisupervised multilabel learning by exploiting training data with the predicted label set of the unlabeled. Experiments on various real-world tasks reveal that the proposed method outperforms some state-of-the-art methods.

Dynamic multiobjective optimization problems (DMOPs) aim to optimize multiple (often conflicting) objectives that are changing over time. Recently, there are a number of promising algorithms proposed based on transfer learning methods to solve DMOPs. However, it is very challenging to reduce the negative effect in transfer learning and find more effective transferred solutions. To fill this research gap, this article proposes a clustering-based transfer (CBT) learning method to solve DMOPs. When the environment changes, two novel operations (clustering-based selection (CBS) and CBT) are used to guide knowledge transfer. Specifically, CBS aims to find a population with nondominated solutions and dominated solutions as the training data for the new environment. Then, CBT further collects the previous Pareto-optimal solutions and some noise solutions as the training data for the previous environment. Two training data sets from different environments are, respectively, divided into multiple clusters and transfer learning is conducted on two similar clusters with high probability to reduce the negative effect, which can train an accurate prediction model to identify the promising solutions for the new environment. Empirical studies have been conducted on 14 benchmark DMOPs and one real-life path planning problem of unmanned air/ground vehicles, which validate the effectiveness of our proposed method. Especially, our method can significantly reduce negative transfer on 12 out of 14 cases when compared with direct transfer learning.

Real-world multiobjective optimization problems usually involve conflicting objectives that change over time, which requires the optimization algorithms to quickly track the Pareto-optimal front (POF) when the environment changes. In recent years, evolutionary algorithms based on prediction models have been considered promising. However, most existing approaches only make predictions based on the linear correlation between a finite number of optimal solutions in two or three previous environments. These incomplete information extraction strategies may lead to low prediction accuracy in some instances. In this article, an incremental support vector machine (ISVM)-based dynamic multiobjective evolutionary algorithm, in short called ISVM-DMOEA, is proposed. We treat the solving of dynamic multiobjective optimization problems (DMOPs) as an online learning process, using the continuously obtained optimal solution to update an ISVM without discarding the solution information at earlier time. ISVM is then used to filter random solutions and generate an initial population for the next moment. To overcome the obstacle of insufficient training samples, a synthetic minority oversampling strategy is implemented before the training of ISVM. The advantage of this approach is that the nonlinear correlation between solutions can be explored online by ISVM, and the information contained in all historical optimal solutions can be exploited to a greater extent. The experimental results and comparison with the chosen state-of-the-art algorithms demonstrate that the proposed algorithm can effectively tackle DMOPs.

Dynamic multiobjective optimization problem (DMOP) denotes the multiobjective optimization problem which varies over time. As changes in DMOP may exist some patterns that are predictable, to solve DMOP, a number of research efforts have been made to develop evolutionary search with prediction approaches to estimate the changes of the problem. A common practice of existing prediction approaches is to predict the change of Pareto-optimal solutions (POS) based on the historical solutions obtained in the decision space. However, the change of a DMOP may occur in both decision and objective spaces. Prediction only in the decision space thus may not be able to give the proper estimation of the problem change. Taking this cue, in this article, we propose an evolutionary search with multiview prediction for solving DMOP. In contrast to existing prediction methods, the proposed approach conducts prediction from the views of both decision and objective spaces. To estimate dynamic changes in DMOP, a kernelized autoencoding model is derived to perform the multiview prediction in a reproducing kernel Hilbert space (RKHS), which holds a closed-form solution. To examine the performance of the proposed method, comprehensive empirical studies on the commonly used DMOP benchmarks, as well as a real-world case study on the movie recommendation problem, are presented. The obtained experimental results verified the efficacy of the proposed method for solving both benchmark and real-world DMOPs.

Dynamic multiobjective optimization problems (DMOPs) are characterized by optimization functions that change over time in varying environments. The DMOP is challenging because it requires the varying Pareto-optimal sets (POSs) to be tracked quickly and accurately during the optimization process. In recent years, transfer learning has been proven to be one of the effective means to solve dynamic multiobjective optimization. However, the negative transfer will lead the search of finding the POS to a wrong direction, which greatly reduces the efficiency of solving optimization problems. Minimizing the occurrence of negative transfer is thus critical for the use of transfer learning in solving DMOPs. In this article, we propose a new individual-based transfer learning method, called an individual transfer-based dynamic multiobjective evolutionary algorithm (IT-DMOEA), for solving DMOPs. Unlike existing approaches, it uses a presearch strategy to filter out some high-quality individuals with better diversity so that it can avoid negative transfer caused by individual aggregation. On this basis, an individual-based transfer learning technique is applied to accelerate the construction of an initial population. The merit of the IT-DMOEA method is that it combines different strategies in maintaining the advantages of transfer learning methods as well as avoiding the occurrence of negative transfer; thereby greatly improving the quality of solutions and convergence speed. The experimental results show that the proposed IT-DMOEA approach can considerably improve the quality of solutions and convergence speed compared to several state-of-the-art algorithms based on different benchmark problems.

Many real-world optimization problems involve multiple objectives, constraints, and parameters that may change over time. These problems are often called dynamic multiobjective optimization problems (DMOPs). The difficulty in solving DMOPs is the need to track the changing Pareto-optimal front efficiently and accurately. It is known that transfer learning (TL)-based methods have the advantage of reusing experiences obtained from past computational processes to improve the quality of current solutions. However, existing TL-based methods are generally computationally intensive and thus time consuming. This article proposes a new memory-driven manifold TL-based evolutionary algorithm for dynamic multiobjective optimization (MMTL-DMOEA). The method combines the mechanism of memory to preserve the best individuals from the past with the feature of manifold TL to predict the optimal individuals at the new instance during the evolution. The elites of these individuals obtained from both past experience and future prediction will then constitute as the initial population in the optimization process. This strategy significantly improves the quality of solutions at the initial stage and reduces the computational cost required in existing methods. Different benchmark problems are used to validate the proposed algorithm and the simulation results are compared with state-of-the-art dynamic multiobjective optimization algorithms (DMOAs). The results show that our approach is capable of improving the computational speed by two orders of magnitude while achieving a better quality of solutions than existing methods.

Tissue P systems with promoters provide nondeterministic parallel bioinspired devices that evolve by the interchange of objects between regions, determined by the existence of some special objects called promoters. However, in cellular biology, the movement of molecules across a membrane is transported from high to low concentration. Inspired by this biological fact, in this article, an interesting type of tissue P systems, called monodirectional tissue P systems with promoters, where communication happens between two regions only in one direction, is considered. Results show that finite sets of numbers are produced by such P systems with one cell, using any length of symport rules or with any number of cells, using a maximal length 1 of symport rules, and working in the maximally parallel mode. Monodirectional tissue P systems are Turing universal with two cells, a maximal length 2, and at most one promoter for each symport rule, and working in the maximally parallel mode or with three cells, a maximal length 1, and at most one promoter for each symport rule, and working in the flat maximally parallel mode. We also prove that monodirectional tissue P systems with two cells, a maximal length 1, and at most one promoter for each symport rule (under certain restrictive conditions) working in the flat maximally parallel mode characterizes regular sets of natural numbers. Besides, the computational efficiency of monodirectional tissue P systems with promoters is analyzed when cell division rules are incorporated. Different uniform solutions to the Boolean satisfiability problem (SAT problem) are provided. These results show that with the restrictive condition of "monodirectionality," monodirectional tissue P systems with promoters are still computationally powerful. With the powerful computational power, developing membrane algorithms for monodirectional tissue P systems with promoters is potentially exploitable.

Dynamic multiobjective optimization problems (DMOPs) are optimization problems with multiple conflicting optimization objectives, and these objectives change over time. Transfer learning-based approaches have been proven to be promising; however, a slow solving speed is one of the main obstacles preventing such methods from solving real-world problems. One of the reasons for the slow running speed is that low-quality individuals occupy a large amount of computing resources, and these individuals may lead to negative transfer. Combining high-quality individuals, such as knee points, with transfer learning is a feasible solution to this problem. However, the problem with this idea is that the number of high-quality individuals is often very small, so it is difficult to acquire substantial improvements using conventional transfer learning methods. In this article, we propose a knee point-based transfer learning method, called KT-DMOEA, for solving DMOPs. In the proposed method, a trend prediction model (TPM) is developed for producing the estimated knee points. Then, an imbalance transfer learning method is proposed to generate a high-quality initial population by using these estimated knee points. The advantage of this approach is that the seamless integration of a small number of high-quality individuals and the imbalance transfer learning technique can greatly improve the computational efficiency while maintaining the quality of the solution. The experimental results and performance comparisons with some chosen state-of-the-art algorithms demonstrate that the proposed design is capable of significantly improving the performance of dynamic optimization.

When dynamic multi-objective optimization evolutionary algorithms (DMOEA) are used to solve real world problems, these are not only required to be able to find the Pareto-Optimal Set (POS) quickly, but also the results obtained can be easily used by decision makers. The classic DMOEAs have much room for improvement in both aspects. Recently, the transfer learning based DMOEAs have been proved that these methods can significantly improve the quality of the solution, but there are still too many individuals in the POS obtained by these algorithms. The resulting problems are twofold: this not only consumes a lot of computing resources to those solutions that will not be used, but also makes it more difficult for decision makers to choose. In this paper, we proposed a dynamic multiobjective optimization evolutionary algorithm which combines knee solutions with transfer learning method, and the feature of the proposed method is that it only outputs a very small number of solutions, which can greatly improve the efficiency of decisionmaking. The proposed algorithm divides the whole decision space into different subspaces, and find a local knee solutions in each subspace, then a transfer learning framework, Tr-DMOEA, is used to predict the knee solutions of the optimization problem at the next moment by using the local knee solutions and a global knee solution. The experimental results show the effectiveness of our design.

Optical character rcecognition (OCR) is a process of converting images of typed, handwritten or printed text into machine-encoded one. In recent years, the methods represented by deep learning have greatly improved the performance of OCR systems, but the main challenges of such systems are 1) to accurately perform text detection in complex scenes and 2) to identify and set the optimal parameters to optimize the performance of the system. In this paper, we propose an OCR method based on Neural Architecture Search technique, called AutOCR. The characteristic of the proposed method is the automatic design of text detection framework using an evolutionary computation neural architecture search method. This design can not only accurately recognize the text in a complex environment, but also avoid the process of experts participating in parameter adjustment. We compared it with different methods, and the experimental results proved the effectiveness of our method.

Information theoretical based methods have attracted a great attention in recent years, and gained promising results to deal with multi-label data with high dimensionality. However, most of the existing methods are either directly transformed from heuristic single-label feature selection methods or inefficient in exploiting labeling information. Thus, they may not be able to get an optimal feature selection result shared by multiple labels. In this paper, we propose a general global optimization framework, in which feature relevance, label relevance (i.e., label correlation), and feature redundancy are taken into account, thus facilitating multi-label feature selection. Moreover, the proposed method has an excellent mechanism for utilizing inherent properties of multi-label learning. Specially, we provide a formulation to extend the proposed method with label-specific features. Empirical studies on twenty multi-label data sets reveal the effectiveness and efficiency of the proposed method. Our implementation of the proposed method is available online at: https://jiazhang-ml.pub/GRRO-master.zip.

Community detection in complex networks is significant to social network analysis. Most of the algorithms take advantage of single-objective optimization methods, which may not be effective for complex networks. Compared with single-objective algorithms, multiobjective evolutionary algorithms can avoid local optimization. However, multiobjective evolutionary algorithms often encounter problems of excessive search space and low efficiency. To solve these issues, this study introduces network embedding into the multiobjective particle swarm algorithm and maps nodes into a low-latitude space, thereby effectively reducing the search space while increasing search efficiency via a consensus propagation strategy. Experimental results demonstrate that a novel effective algorithm based on multiobjective particle swarm optimization (NE-PSO) performs effectively and has competitive performance in comparison with state-of-the-art approaches on synthetic and real-world networks, especially the large-scale ones.

Dynamic multiobjective optimization requires the robust tracking of varying Pareto-optimal solutions (POS) in a changing environment. When a change is detected in the environment, prediction mechanisms estimate the POS by utilizing information from previous populations to accelerate search toward the true POS. To achieve a robust prediction of POS, a mixture-of-experts-based ensemble framework is proposed. Unlike existing approaches, the framework utilizes multiple prediction mechanisms to improve the overall prediction. A gating network is applied to manage switching among the various predictors based on performance of the predictors at different time intervals of the optimization process. The efficacy of the proposed framework is validated through experimental studies based on 13 dynamic multiobjective benchmark optimization problems. The simulation results show that the proposed framework improves the dynamic optimization performance significantly, particularly for: 1) problems with distinct dynamic POS in decision space over time and 2) problems with highly nonlinear decision variable linkages.

The main feature of the Dynamic Multi-objective Optimization Problems (DMOPs) is that optimization objective functions will change with times or environments. One of the promising approaches for solving the DMOPs is reusing the obtained Pareto optimal set (POS) to train prediction models via machine learning approaches. In this paper, we train an Incremental Support Vector Machine (ISVM) classifier with the past POS, and then the solutions of the DMOP we want to solve at the next moment are filtered through the trained ISVM classifier. A high-quality initial population will be generated by the ISVM classifier, and a variety of different types of population-based dynamic multi-objective optimization algorithms can benefit from the population. To verify this idea, we incorporate the proposed approach into three evolutionary algorithms, the multi-objective particle swarm optimization(MOPSO), Nondominated Sorting Genetic Algorithm II (NSGA-II), and the Regularity Model-based multi-objective estimation of distribution algorithm(RE-MEDA). We employ experiments to test these algorithms, and experimental results show the effectiveness.

Customized commuter bus (CCB) is a kind of innovative public transit service launched starting in 2013 in many cities all over the world. It is designed to meet the direct travel demands of commuters who have similar origin and destination locations during their long-distance commuting trips at peak hours. To identify the origin and destination distribution of potential CCB passengers, this paper proposes a pair wise density-based spatial clustering algorithm. With the proposed algorithm, the method to extract the potential CCB passengers from regular bus passengers based on the bus smart card data is introduced. Meanwhile, the discovered hot locations of potential CCB passengers can be regarded as the candidate locations of CCB stops and can be used to set candidate CCB lines. Finally, the demand survey data collected from the actual registered CCB passengers are applied to verify the accuracy and feasibility of the clustering results obtained by the proposed algorithm. The related findings could guide bus operators to design CCB lines and allocate vehicle capacities on different lines.

A many-objective problems (MaOP) refer to the optimization problem involving more than three objectives. Particle swarm optimization (PSO) is one of the potential heuristic methods suited for solving MaOPs. The personal best selection strategy, the global best selection strategy, and the archive maintenance strategy are the three key components in the design of a Many-Objective Particle Swarm Optimization (MaOPSO). The personal best and global best selection strategies determine the direction where particles will fly. The archive maintenance strategy has an important impact on convergence and diversity of its algorithm. In MaOPs, the high dimensionality in the objective space decreases the probability of a solution to be dominated by the other solutions in the population. Thus, it becomes more difficult for PSO to select the good leaders from so many non-dominated solutions. In this paper, a virtual Inverted Generational Distance indicator is proposed to evaluate the comprehensive quality of a solution in the external archive according to a constructed virtual Pareto front (vPF). Accordingly, a new indicator-based MaOPSO using vPF (MaOPSO/vPF) is developed to improve the convergence and diversity of the approximate Pareto front. Experimental results on the MaF test suites demonstrate that the proposed MaOPSO/vPF performs better than some selected competing Multi-objective Optimization Evolutionary Algorithms.

Electroencephalogram (EEG) based brain-computer interfaces allow users to communicate with the external environment by means of their EEG signals, without relying on the brain’s usual output pathways such as muscles. A popular application for EEGs is the EEG-based speller, which translates EEG signals into intentions to spell particular words, thus benefiting those suffering from severe disabilities, such as amyotrophic lateral sclerosis. Although the EEG-based English speller (EEGES) has been widely studied in recent years, few studies have focused on the EEG-based Chinese speller (EEGCS). The EEGCS is more difficult to develop than the EEGES, because the English alphabet contains only 26 letters. By contrast, Chinese contains more than 11 000 logographic characters. The goal of this paper is to survey the literature on EEGCS systems. First, the taxonomy of current EEGCS systems is discussed to get the gist of the paper. Then, a common framework unifying the current EEGCS and EEGES systems is proposed, in which the concept of EEG-based choice acts as a core component. In addition, a variety of current EEGCS systems are investigated and discussed to highlight the advances, current problems, and future directions for EEGCS.

One of the major distinguishing features of the dynamic multiobjective optimization problems (DMOPs) is that optimization objectives will change over time, thus tracking the varying Pareto-optimal front becomes a challenge. One of the promising solutions is reusing “experiences” to construct a prediction model via statistical machine learning approaches. However, most existing methods neglect the nonindependent and identically distributed nature of data to construct the prediction model. In this paper, we propose an algorithmic framework, called transfer learning-based dynamic multiobjective evolutionary algorithm (EA), which integrates transfer learning and population-based EAs to solve the DMOPs. This approach exploits the transfer learning technique as a tool to generate an effective initial population pool via reusing past experience to speed up the evolutionary process, and at the same time any population-based multiobjective algorithms can benefit from this integration without any extensive modifications. To verify this idea, we incorporate the proposed approach into the development of three well-known EAs, nondominated sorting genetic algorithm II, multiobjective particle swarm optimization, and the regularity model-based multiobjective estimation of distribution algorithm. We employ 12 benchmark functions to test these algorithms as well as compare them with some chosen state-of-the-art designs. The experimental results confirm the effectiveness of the proposed design for DMOPs.

Domain adaptation learning (DAL) investigates how to perform a task across different domains. In this paper, we present a kernelized local-global approach to solve domain adaptation problems. The basic idea of the proposed method is to consider the global and local information regarding the domains (e.g., maximum mean discrepancy and intraclass distance) and to convert the domain adaptation problem into a bi-object optimization problem via the kernel method. A solution for the optimization problem will help us identify a latent space in which the distributions of the different domains will be close to each other in the global sense, and the local properties of the labeled source samples will be preserved. Therefore, classic classification algorithms can be used to recognize unlabeled target domain data, which has a significant difference on the source samples. Based on the analysis, we validate the proposed algorithm using four different sources of data: synthetic, textual, object, and facial image. The experimental results indicate that the proposed method provides a reasonable means to improve DAL algorithms.

Software defect prediction generally builds models from intra-project data.Lack of training data at the early stage of software testing limits the efficiency of prediction in practice.Thereby researchers proposed cross-project defect prediction using the data from other projects.Most previous efforts assumed the cross-project defect data have the same metrics set which means the metrics used and size of metrics set are same in the data of projects.However, in real scenarios, this assumption may not hold.In addition, software defect datasets have the class imbalance problem increasing the difficulty for the learner to predict defects.In this paper, we advance canonical correlation analysis for deriving a joint feature space for associating crossproject data and propose a novel support vector machine algorithm which incorporates the correlation transfer information into classifier design for cross-project prediction.Moreover, we take different misclassification costs into consideration to make the classification inclining to classify a module as a defective one, alleviating the impact of imbalanced data.Experiments on public heterogeneous datasets from different projects show that our method is more effective, compared to state-of-the-art methods.

Cross-project defect prediction trains a prediction model using historical data from source projects and applies the model to target projects. Most previous efforts assumed the cross-project data have the same metrics set, which means the metrics used and the size of metrics set are the same. However, this assumption may not hold in practical scenarios. In addition, software defect datasets have the class-imbalance problem which increases the difficulty for the learner to predict defects. In this paper, we advance canonical correlation analysis by deriving a joint feature space for associating cross-project data. We also propose a novel support vector machine algorithm which incorporates the correlation transfer information into classifier design for cross-project prediction. Moreover, we take different misclassification costs into consideration to make the classification inclining to classify a module as a defective one, alleviating the impact of imbalanced data. The experimental results show that our method is more effective compared to state-of-the-art methods.

The paper presents an approach to applying a classifier ensemble to identify human body gestures, so as to control a robot to write Chinese characters. Robotic handwriting ability requires complicated robotic control algorithms. In particular, the Chinese handwriting needs to consider the relative positions of a character's strokes. This approach derives the font information from human gestures by using a motion sensing input device. Five elementary strokes are used to form Chinese characters, and each elementary stroke is assigned to a type of human gestures. Then, a classifier ensemble is applied to identify each gesture so as to recognize the characters that gestured by the human demonstrator. The classier ensemble's size is reduced by feature selection techniques and harmony search algorithm, thereby achieving higher accuracy and smaller ensemble size. The inverse kinematics algorithm converts each stroke's trajectory to the robot's motor values that are executed by a robotic arm to draw the entire character. Experimental analysis shows that the proposed approach can allow a human to naturally and conveniently control the robot in order to write many Chinese characters.

The Deep Spatio-Temporal Inference Network (DeSTIN) is a deep learning architecture which combines un-supervised learning and Bayesian inference. The original version of DeSTIN incorporates k-means clustering inside each processing node. Here we propose to replace k-means with a more sophisticated algorithm, online EM (Expectation Maximization), and show that this improves DeSTIN's performance on image classification and restoration tasks.

The ability of pointing is recognised as an essential skill of a robot in its communication and social interaction. This paper introduces a developmental learning approach to robotic pointing, by exploiting the interactions between a human and a robot. The approach is inspired through observing the process of human infant development. It works by first applying a reinforcement learning algorithm to guide the robot to create attempt movements towards a salient object that is out of the robot’s initial reachable space. Through such movements, a human demonstrator is able to understand the robot desires to touch the target and consequently, to assist the robot to eventually reach the object successfully. The human–robot interaction helps establish the understanding of pointing gestures in the perception of both the human and the robot. From this, the robot can collect the successful pointing gestures in an effort to learn how to interact with humans. Developmental constraints are utilised to drive the entire learning procedure. The work is supported by experimental evaluation, demonstrating that the proposed approach can lead the robot to gradually gain the desirable pointing ability. It also allows that the resulting robot system exhibits similar developmental progress and features as with human infants.

Robotic hand-eye coordination plays an important role in dealing with real time environment; and the learning procedure of this skill affects the fundamental framework of robotic cognition. This paper introduces a novel developmental approach to hand-eye coordination in an autonomous robotic system. Existing work employs neural network models to map visual perception to hand. In the approach, a computational structure and a cross-modal link mechanism are applied to simulate brain cortices; and a movement pattern inspired by infant behaviors is designed to help robot learn to build its hand-eye coordination. This work is supported by experimental evaluation, which shows that the learning algorithm provides a fast and incremental learning of behavioral competence.

Attribute reducts can discover previously unknown, non-trivial and useful abstractions from the data in large databases. However, many methods for finding attribute reducts from large data sets always meet a difficult problem of combination explosion. To overcome the problem and find some attribute reducts with high efficiency, the algorithm CARHS was proposed. The basic idea of CARHS is: 1) transform the problem into an equivalent one that searches paths, from which attribute reducts can be easily derived, from a graph; 2) employ high efficient heuristic rules during the course of depth-first search on the graph. By means of the heuristic rules, those paths that would not derive attribute reducts could be blocked as early as possible, furthermore, for those paths that would derive the same attribute reduct, only one of them could complete the course of search, and the others could be blocked as early as possible. Thus some attribute reducts could be found by CARHS with high efficiency even when dealing with huge data sets. The transformation of the problem, novel concepts, the heuristic search rules, and the algorithm CARHS were illustrated in detail by some examples. At last, The experiment on three classic UCI data sets showed the effect of the heuristic search rules and the efficiency of the algorithm CARHS.