The discriminant ability of features plays a central role in classification tasks. Deep learning (DL) utilizes back-propagation to yield discriminant features with an end-to-end depth structure, which lacks interpretability. A new learning paradigm, Green Learning (GL), has been proposed to address the weaknesses of DL, including high carbon footprints, large model sizes, and mathematical opaqueness. Following this idea, a statistics-based feature generation (SFG) method is proposed to boost system performance further. SFG consists of two modules: 1) feature subset selection and 2) discriminant feature generation via linear combination. In the first module, SFG traces the splitting features along individual tree paths within auxiliary XGBoost classifiers, which form the desired feature subsets for each binary label subspace. In the second module, SFG determines the weights of features in each subspace by formulating a least-square normal equation supervised by its corresponding binary sub-labels. SFG enables the adaptive assessment of feature importance at global and various local scales. Besides, it reduces the computational requirement by working in low-dimensional feature sub-spaces. Extensive experiments are conducted on classical image classification tasks to demonstrate the effectiveness and efficiency of SFG.

Teams of embodied AI-enabled agents are critical for applications in extreme and highly dynamic environments. Developing robust controllers for such agents requires a deep understanding of the challenges encountered when attempting to coordinate and synchronize their individual perception-cognition-communication-action (PCCA) loops for team-wide mission objectives. We introduce a framework to explore the coordination of the PCCA loops across multiple agents in a new simulated physical environment designed to explore collaboration in each PCCA stage. This environment tasks teams of agents with the correct disposal of dangerous objects in an area and forces careful coordination of sensing, communication, movement, and manipulation actions by providing spatially-bounded communication, incorporating situations that require concerted effort by groups of agents, and introducing uncertainty into agents’ sensing capabilities. We provide a set of heuristic controllers, an offline oracle model, and an initial exploration of a Reward Machine-based controller that learns its policies from training. Together these approaches serve to provide insights into the complexity of the multi-agent PCCA loop coordination problem. The multiagent PCCA simulation environment, which supports AI and human-controlled agents, and the code for various agent controllers are available at https://github.com/nesl/AI-Collab.

AI algorithms at the edge demand smaller model sizes and lower computational complexity. To achieve these objectives, we adopt a green learning (GL) paradigm rather than the deep learning paradigm. GL has three modules: 1) unsupervised representation learning, 2) supervised feature learning, and 3) supervised decision learning. We focus on the second module in this work. In particular, we derive new discriminant features from proper linear combinations of input features, denoted by x, obtained in the first module. They are called complementary and raw features, respectively. Along this line, we present a novel supervised learning method to generate highly discriminant complementary features based on the least-squares normal transform (LNT). LNT consists of two steps. First, we convert a C-class classification problem to a binary classification problem. The two classes are assigned with 0 and 1, respectively. Next, we formulate a least-squares regression problem from the N-dimensional (N-D) feature space to the 1-D output space, and solve the least-squares normal equation to obtain one N-D normal vector, denoted by a1. Since one normal vector is yielded by one binary split, we can obtain M normal vectors with M splits. Then, Ax is called an LNT of x, where transform matrix A$\in R^{M\times N}$ by stacking $\mathrm{a}_{J}^{T}$, j=1,, M, and the LNT, Ax, can generate M new features. The newly generated complementary features are shown to be more discriminant than the raw features. Experiments show that the classification performance can be improved by these new features.