# Tag Info

## Hot answers tagged estimators

8

Instead of exact polynomial fitting, you could use a least-squares fit, which will find the polynomial of specified order that minimizes the total squared error between the fit and the measured $(x_i,y_i)$ pairs. This can help to mitigate the effects of noise on the fit. Given measurements $y_i$ of a function $y = f(x)$ at domain values $x_i$ ($i = 0, 1, \... 6 Ignore noise for now. Given$n+1$points$(x_i,y_i)$where the$x_i$are distinct numbers, you can, as you say, fit a polynomial$f(x)$of degree at most$n$through these points. Lagrange interpolation, for example, is a standard method for this. But, it is believed that the points are actually on a curve$y=g(x)$where$g(x)is not necessarily a ... 6 Given measurements \begin{align} Z_1 &= x + N_1\\ Z_2 &= x + N_2 \end{align} whereN_1$and$N_2$are independent zero-mean Gaussian random variables with variances$\sigma_1^2$and$\sigma_2^2$respectively, it can be shown that the minimum-mean-square-error (MMSE) estimate of$x$in terms of$Z_1$and$Z_2$is a linear function of$Z_1$and$...

4

Generally, the frequency estimation problem decouples from the amplitude + phase estimation problem. As I said in the comments, you could just do: $$\hat{A} = \left|\sum_{n=0}^{N-1} x_n e^{-j 2\pi\hat{f} n} \right|$$ where $\hat{f}$ is your frequency estimate. Regarding your issues: because the number of points isn't high enough to hit the right ...

4

Expanding on my comment, $\{\phi(\tau)\}$ is a non-stationary nonGaussian random process, and I doubt that there is any simple answer (or even a rather complicated one) for the probability density function of the random variable $\phi(\tau)$ for an arbitrary value of $\tau$. But, the (time-varying) mean function of the process is easy to calculate. We have ...

3

A PRN sequence is a Pseudo-Random Noise sequence, often generated by using an Linear Feedback Shift Register (LFSR) with the feedback taps done by using a primitive irreducible polynomial in GF{2}, which is the Golois Field of 2 elements. When a primitive and irreducible polynomial in GF{2} is used, the LFSR will produce a "maximum length sequence", meaning ...

3

I do not know the answer to your question, but perhaps this paper can help. I realize that you are not using single bit random waveforms, but the formulation on the distribution they calculated is fairly through. "Probability distribution of the crosscorrelation function of finite-duration single-bit random waveforms" Abstract The detection errors of a ...

3

I can only propose a crude starting point based on a more modest work I did. My goal was to determine the bleaching coefficient of a fluorophore when submitted to varying illumination intensity over time. I had the theoretical law for the bleaching over time as a function of intensity (depending on unknown parameters), the amount of fluorophore over time, ...

2

Digital Hilbert transform is tricky to do since an ideal Hilbert transformer requires an FIR filter with an impulse response from -infinity to +infinity. Obviously that can't be done, so numerical problems are unavoidable. They tend to be worst at low frequencies so my guess is you'd see a smaller error at, say, 100 Hz. Andrew Duncan's paper "The Analytic ...

2

The basic idea behind maximum entropy models is that you want to make the least assumption about the data. This is considered equivalent to retaining as much unpredictability as possible, as quantified by entropy. For more information I refer you to this Wikipedia article. Information and unpredictability are closely related. If you think of the signal as a ...

2

An approach that might be worthwhile investigating is some sort of on-line method. Because of the highly non-linear nature of your signal model, the standard Kalman filter is out, but an Extended Kalman filter (or, perhaps, a particle filter) might be worth looking at. The idea is that you set up your signal model state to be: $$x_t = \left[ \alpha\ \... 2 I'm not sure what's you model is. Let's say it is something like:$$ y = H x + n  Now, using the Least Squares model is optimal (In the MSE sense) when $n$ is AWGN (It is the linear optimal estimator if the noise is white). So unless the noise in your model is colored, no gain by filtering the data before applying the Least Squares method. Now, what ...

1

In the case $a$ is a random variable (r.v.) we distinguish between two types of unbiased: (hereinafter I'm switching to $\theta$ and $\hat{\theta}$ instead of $a$ and $\hat{a}$ respectively): Unbiased in the strong sense: given by $E\left \{ \left ( \hat{\theta} - \theta \right )| \theta\right \} = 0, \quad \forall \theta$. Most often tha n not it is hard ...

1

Fristly, check my answer again, I edited it because the first paragraph wasn´t extrictly right, I hope you notice the difference. (1) YES, in the example of the sample mean, its variance it is also the CRLB, so if N goes to infinity, the CRLB tends to zero. It means that if you want fewer deviation from the expectation of the estimator, you nedd larger ...

1

You may want an estimator with minimun variance because each time you calculate it, it is likely to be closer to its expectation, and in the case that the estimator is unbiased, closer to the true parameter. An estimator is inconsisten if increasing the number of samples of the dataset to calculate it doesn't reduces its variance. The sample mean estimator ...

1

You could simply run your signal through some sort of high pass filter or shelf and compare the energy before and after the filter. If the ratio is high, you have a lot of high frequencies in your signal and should probably do less smoothing. If the ratio is low, there are not a lot of high frequencies and you can do more aggressive smoothing. The ...

1

Use the Cholesky decomposition of $M$ as a change of coordinates. $tr(ABC) = tr(CAB)$ - trace is invariant under cyclic permutations, and $tr(scalar)=scalar)$. Thus, $tr(M E[ x x^T]) = tr(E[M x x^T]) = E[tr(M x x^T) ] = E[tr( x^T M x ) ] = E[x^T M x]$. Now, replace $x$ with $\hat{x}-x$.

Only top voted, non community-wiki answers of a minimum length are eligible