Skip to main content
reference editing
Source Link
Gilles
  • 3.4k
  • 3
  • 23
  • 29

In the book, Fundamentals of Statistical Signal Processing - Estimation TheoryFundamentals of Statistical Processing, Volume I: Estimation Theory by S. M. Kay,Steven M. Kay on page 19, it say that the mean square error of an estimator, $\hat{\theta}$, given the true value, $\theta$, is defined as

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) \end{align} where $b(\theta) = E[\hat{\theta}] - \theta$ is the bias.

But if I write it out, it doesn't come out to be the same

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= E \left[ \left( \hat{\theta} - E[\hat{\theta}] \right)^2 + \left( E[\hat{\theta}] - \theta \right)^2 + 2 \left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) + 2 E \left[\left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right] \end{align}

What am I missing here?

In the book, Fundamentals of Statistical Signal Processing - Estimation Theory by S. M. Kay, on page 19, it say that the mean square error of an estimator, $\hat{\theta}$, given the true value, $\theta$, is defined as

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) \end{align} where $b(\theta) = E[\hat{\theta}] - \theta$ is the bias.

But if I write it out, it doesn't come out to be the same

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= E \left[ \left( \hat{\theta} - E[\hat{\theta}] \right)^2 + \left( E[\hat{\theta}] - \theta \right)^2 + 2 \left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) + 2 E \left[\left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right] \end{align}

What am I missing here?

In the book Fundamentals of Statistical Processing, Volume I: Estimation Theory by Steven M. Kay on page 19, it say that the mean square error of an estimator, $\hat{\theta}$, given the true value, $\theta$, is defined as

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) \end{align} where $b(\theta) = E[\hat{\theta}] - \theta$ is the bias.

But if I write it out, it doesn't come out to be the same

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= E \left[ \left( \hat{\theta} - E[\hat{\theta}] \right)^2 + \left( E[\hat{\theta}] - \theta \right)^2 + 2 \left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) + 2 E \left[\left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right] \end{align}

What am I missing here?

added details about the book
Source Link
Zero
  • 207
  • 2
  • 8

In the book, Fundamentals of Statistical Signal Processing - Estimation Theory by S. M. Kay, on page 19, it say that the mean square error of an estimator, $\hat{\theta}$, given the true value, $\theta$, is defined as

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) \end{align} where $b(\theta) = E[\hat{\theta}] - \theta$ is the bias.

But if I write it out, it doesn't come out to be the same

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= E \left[ \left( \hat{\theta} - E[\hat{\theta}] \right)^2 + \left( E[\hat{\theta}] - \theta \right)^2 + 2 \left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) + 2 E \left[\left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right] \end{align}

What am I missing here?

In the book, Fundamentals of Statistical Signal Processing by S. M. Kay, on page 19, it say that the mean square error of an estimator, $\hat{\theta}$, given the true value, $\theta$, is defined as

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) \end{align} where $b(\theta) = E[\hat{\theta}] - \theta$ is the bias.

But if I write it out, it doesn't come out to be the same

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= E \left[ \left( \hat{\theta} - E[\hat{\theta}] \right)^2 + \left( E[\hat{\theta}] - \theta \right)^2 + 2 \left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) + 2 E \left[\left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right] \end{align}

What am I missing here?

In the book, Fundamentals of Statistical Signal Processing - Estimation Theory by S. M. Kay, on page 19, it say that the mean square error of an estimator, $\hat{\theta}$, given the true value, $\theta$, is defined as

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) \end{align} where $b(\theta) = E[\hat{\theta}] - \theta$ is the bias.

But if I write it out, it doesn't come out to be the same

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= E \left[ \left( \hat{\theta} - E[\hat{\theta}] \right)^2 + \left( E[\hat{\theta}] - \theta \right)^2 + 2 \left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) + 2 E \left[\left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right] \end{align}

What am I missing here?

Source Link
Zero
  • 207
  • 2
  • 8

MSE of an estimator

In the book, Fundamentals of Statistical Signal Processing by S. M. Kay, on page 19, it say that the mean square error of an estimator, $\hat{\theta}$, given the true value, $\theta$, is defined as

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) \end{align} where $b(\theta) = E[\hat{\theta}] - \theta$ is the bias.

But if I write it out, it doesn't come out to be the same

\begin{align} \text{mse}(\hat{\theta}) &= E[(\hat{\theta} - \theta)^2] \\ &= E \left[ \left[\left( \hat{\theta} - E[\hat{\theta}] \right) + \left( E[\hat{\theta}] - \theta \right) \right]^2 \right]\\ &= E \left[ \left( \hat{\theta} - E[\hat{\theta}] \right)^2 + \left( E[\hat{\theta}] - \theta \right)^2 + 2 \left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right]\\ &= \text{var}(\hat{\theta}) + b^2(\theta) + 2 E \left[\left( \hat{\theta} - E[\hat{\theta}] \right) \left( E[\hat{\theta}] - \theta \right) \right] \end{align}

What am I missing here?