According to the Gauss-Markov Theorem, a ordinary least squares estimator is BLUE if the noise entering a system is uncorrelated with zero mean and is homoscedastic (has a constant finite variance). I am aware that a Kalman Filter applied to a system with additive noise of known mean and variance but non-gaussian distribution is BLUE. Does this imply that the noise has to be homoscedastic ? Or does the KF have a trick up its sleeve ?

  • $\begingroup$ It is the best filter in the sense of minimizing the MSE; However, it is not necessarily unbiased. $\endgroup$ – Dovid Apr 23 '18 at 14:47
  • $\begingroup$ This is contrast to BLUE, which is by definition unbiased. $\endgroup$ – Dovid Apr 23 '18 at 14:49

Kalman filter is the best linear estimator regardless of stationarity or Gaussianity. Also in the Gaussian case it does not require stationarity (unlike Wiener filter). In the linear Gaussian case Kalman filter is also a MMSE estimator or the conditional mean.


If you look at the statement of the discrete-time Kalman filtering problem in Anderson & Moore (RIP), you'll notice something:

enter image description here

The covariances $R_k$ and $Q_k$ are time-varying.

Moreover, later in Chapter 3, they go on to prove the best linear estimator property for the Kalman filter in Theorem 2.1, and the proof does not appear to require the noise to be stationary.

Now: the question will be whether the Gaussianity assumption can be dropped... but I've not read through it. Most of the standard KF equations state assume Gaussianity; as does this one.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.