0
$\begingroup$

For a sample mean unbiased estimator, which achieves the CRLB, I plotted the variance and compared it to the theoretical CRLB. The plot below shows what I got. I have small number of samples to calculate this variance.

enter image description here

The black line is the theoretical bound and the red line is the variance calculated using 10 samples.

Why is the calculation lower than CRLB? If CRLB gives the lowest possible value, should it not mean that the red line should always be on or above the black one, even considering low sample size and numerical errors? An insightful answer will be welcome.

Improve this question
$\endgroup$
12
  • $\begingroup$ "I plotted the variance": how did you do that? where are these values coming from? $\endgroup$ – Marcus Müller Jan 9 at 16:47
  • $\begingroup$ @Marcus Muller...basically the way I plotted the variance is: 1. add white gaussian noise to a constant $N_1$ times, so $N_1$ realizations of the white gaussian noise with a fixed value of $\sigma^2$. 2. Chopped it up into 10 pieces. Calculated the sample mean estimate (10 values of the estimate). 3. Calculated the variance of these values. 4 .Repeated this for $N_2$ different $\sigma^2$ values. $\endgroup$ – Zero Jan 9 at 17:07
  • $\begingroup$ you mean, you made a statement about a variance of less than $10^{-10}$ by doing 10 runs? I have bad news for you. How large is $N_1$? $\endgroup$ – Marcus Müller Jan 9 at 17:43
  • 1
    $\begingroup$ Empirical variance isn't the same as theoretical, obviously for finite trials it could be less in some runs. $\endgroup$ – FourierFlux Jan 9 at 18:07
  • 2
    $\begingroup$ @Zero think about that. If your error was always on the same side of the curve, how can that estimator be unbiased anymore? $\endgroup$ – Marcus Müller Jan 9 at 20:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.