The quotient of two multivariate Gaussian densities can be written as an unnormalized Gaussian density, which has been applied in some recently developed multiple-model fixed-interval smoothing algorithms. However, this expression is invalid if instead of being positive definite, the covariance of the unnormalized Gaussian density is indefinite (i.e., it has both positive and negative eigenvalues) or undefined (i.e., computing it requires inverting a singular matrix). This paper considers approximating the quotient of two Gaussian densities in this case using two different approaches to mitigate the caused numerical problems. The first approach directly replaces the indefinite covariance of the unnormalized Gaussian density with a positive definite matrix nearest to it. The second approach computes the approximation through solving, using the natural gradient, an optimization problem with a Kullback-Leibler divergence-based cost function. This paper illustrates the application of the theoretical results by incorporating them into an existing smoothing method for jump Markov systems and utilizing the obtained smoothers to track a maneuvering target.

Click-through rate (CTR) prediction is a critical problem in web search, recommendation systems and online advertisement displaying. Learning good feature interactions is essential to reflect user's preferences to items. Many CTR prediction models based on deep learning have been proposed, but researchers usually only pay attention to whether state-of-the-art performance is achieved, and ignore whether the entire framework is reasonable. In this work, we use the discrete choice model in economics to redefine the CTR prediction problem, and propose a general neural network framework built on self-attention mechanism. It is found that most existing CTR prediction models align with our proposed general framework. We also examine the expressive power and model complexity of our proposed framework, along with potential extensions to some existing models. And finally we demonstrate and verify our insights through some experimental results on public datasets.

The Schmidt-Kalman filter (SKF) achieves filtering consistency in the presence of biases in system dynamic and measurement models through accounting for their impacts when updating the state estimate and covariance. However, the performance of the SKF may break down when the measurements are subject to non-Gaussian and heavy-tail noise. To address this, we impose the Wishart prior distribution on the precision matrix of measurement noise, such that the measurement likelihood now has heavier tails than the Gaussian distribution to deal with the potential occurrence of outliers. Variational inference is invoked to establish analytically tractable methods for computing the posterior of the system state, system biases, and the measurement noise precision matrix. The principle of the SKF considers the effect of system biases but does not actively estimate them when two variants of outlier-robust SKFs are incorporated. We evaluate their performance in terms of estimation accuracy and filtering consistency using simulations and real-world data. Promising results are obtained.