According to the Gauss-Markov Theorem, a ordinary least squares estimator is BLUE if the noise entering a system is uncorrelated with zero mean and is homoscedastic (has a constant finite variance). I am aware that a Kalman Filter applied to a system with additive noise of known mean and variance but non-gaussian distribution is BLUE. Does this imply that the noise has to be homoscedastic ? Or does the KF have a trick up its sleeve ?
-
$\begingroup$ It is the best filter in the sense of minimizing the MSE; However, it is not necessarily unbiased. $\endgroup$– DovidCommented Apr 23, 2018 at 14:47
-
$\begingroup$ This is contrast to BLUE, which is by definition unbiased. $\endgroup$– DovidCommented Apr 23, 2018 at 14:49
2 Answers
Kalman filter is the best linear estimator regardless of stationarity or Gaussianity. Also in the Gaussian case it does not require stationarity (unlike Wiener filter). In the linear Gaussian case Kalman filter is also a MMSE estimator or the conditional mean.
If you look at the statement of the discrete-time Kalman filtering problem in Anderson & Moore (RIP), you'll notice something:
The covariances $R_k$ and $Q_k$ are time-varying.
Moreover, later in Chapter 3, they go on to prove the best linear estimator property for the Kalman filter in Theorem 2.1, and the proof does not appear to require the noise to be stationary.
Now: the question will be whether the Gaussianity assumption can be dropped... but I've not read through it. Most of the standard KF equations state assume Gaussianity; as does this one.