Approximate Message Passing (AMP) is an efficient iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions, such as sparse systems. In AMP, a so-called Onsager term is added to keep estimation errors approximately Gaussian. Orthogonal AMP (OAMP) does not require this Onsager term, relying instead on an orthogonalization procedure to keep the current errors uncorrelated with (i.e., orthogonal to) past errors. In this paper, we show the generality and significance of the orthogonality in ensuring that errors are “asymptotically independently and identically distributed Gaussian” (AIIDG). This AIIDG property, which is essential for the attractive performance of OAMP, holds for separable functions. We present a simple and versatile procedure to establish the orthogonality through Gram-Schmidt (GS) orthogonalization, which is applicable to any prototype. We show that different AMP-type algorithms, such as expectation propagation (EP), turbo, AMP and OAMP, can be unified under the orthogonal principle. The simplicity and generality of OAMP provide efficient solutions for estimation problems beyond the classical linear models. As an example, we study the optimization of OAMP via the GS model and GS orthogonalization. More related applications will be discussed in a companion paper where new algorithms are developed for problems with multiple constraints and multiple measurement variables.

We address the joint device activity detection and channel estimation (JACE) problem in a massive MIMO connectivity scenario in which a large number of mobile devices are connected to a base station (BS), while only a small portion are active at any given time. The main objective is to provide an efficient transmission and detection scheme with both spatial and temporal correlations. We formulate JACE as a multiple measurement vector (MMV) problem with correlated entries in the vectors to be estimated. We propose an MMV form of the orthogonal approximate message passing algorithm (OAMP-MMV). We derive a group Gram-Schmidt orthogonalization (GGSO) procedure for the realization of OAMP-MMV. We outline a state evolution (SE) procedure for OAMP-MMV and examine its accuracy using numerical results. We also compare OAMP-MMV with existing alternatives, including AMP-MMV and GTurbo-MMV. We show that OAMP-MMV outperforms AMP-MMV when pilot sequences are generated using Hadamard pilot matrices. Such a pilot design is attractive due to the low-cost signal processing technique using the fast Hadamard transform (FHT). We also show that OAMP-MMV outperforms GTurbo-MMV in correlated channels.

Approximate message passing (AMP) is an iterative signal recovery algorithm for compressed sensing (CS) applications. In this letter, we present an integral-based orthogonal AMP (IB-OAMP) technique that avoids the requirements of AMP (and also the original form of OAMP) on differentiable and separable denoisers. The orthogonality in IB-OAMP can be established using a Monte Carlo method similar to the training stage in a machine-learning algorithm. These features make IB-OAMP attractive to be used in conjunction with some well-studied denoising algorithms.