Questions tagged [stochastic]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
6
votes
2answers
773 views

Why is $A\cos(2\pi f_ct)$ a non-stationary process?

I am studying analog communication and having Communication system - Simon Hykin as one of the reference. There is a question Consider the sinusoidal process$$X(t) = A\cos(2\pi f_ct)$$where the ...
5
votes
1answer
3k views

Understanding of Random Process, Random Variable and Probability Density Function

I just wanted to confirm my understanding of a Random Process, Random Variable and the its Probability density Function. Here is the way that I looked a Random Process/Random Variable: If we ...
5
votes
1answer
3k views

Understanding Ergodicity and Ensemble Averaging

Literature says that a stationary signal is ergodic, if its ensemble average = time averages. Should it be the statistics computed by time averaging = statistics computed by ensemble averaging?The way ...
5
votes
3answers
2k views

Power Spectral Density of Brownian Motion despite non-stationary

Note: I originally asked this on Physics Stack Exchange but haven't attracted any interest there so I'm asking here where it may be more relevant. A white noise process, $\xi(t)$ with delta ...
5
votes
1answer
80 views

Is there any computational method to prove whether a series is stationary or not?

I have a discrete series $x[n]$. It is extracted from real life and I do not have probability distribution of each value $x[n]$. Is there any computational method to prove whether the series is ...
4
votes
2answers
2k views

What's the meaning of ergodicity? [duplicate]

I just read the topic about Ergodicity but I have ambiguity about its meaning (by intuition). What does mean: (for mean) Statistical average = Time average. Could you please explain it in detail. ...
4
votes
2answers
64 views

Intuition about independent signals

Given is this Wiener filter: From this we take \begin{equation} x[k]-a x[k-1]=v[k] \end{equation} $v(k)$ is assumed to be a white gaussian noise. In the textbook it is then stated that The ...
4
votes
2answers
67 views

Moving from deterministic signals to stochastic signals in s-domain (Power Spectral Density)

Assume we have the following system (coming from control systems theory, hence in s-domain) $ Y(s) = H_A (s) \cdot A(s) - H_B (s) \cdot B(s) $ I now wish to consider $a(t)$ and $b(t)$ as white noise ...
4
votes
2answers
588 views

What does the frequency axis of a Power Spectral Density mean?

I have never really understood what the frequency axis meant when we plot the Power Spectral Density(PSD). Does it correspond to frequency as we get after we take the Fourier Transform of a time ...
4
votes
1answer
55 views

Stochastic Methods for Image Deconvolution Problem

If we convolve an image with a point spread function and from the resulting image to find the input image, can we use any stochastic approaches? I feel like we will not be able to. A single image ...
3
votes
1answer
440 views

explanation of correlation of stationary stochastic processes

I have some doubts about correlation in stationary stochastic processes. I know that the expectation of a random variable is $$E(x)=\int_{-\infty}^{+\infty} a f_x(...
3
votes
1answer
416 views

Higher-order moment of output of LTI system

Assume a very simple LTI system. Assume $x$ is white Gaussian i.i.d. with variance $\sigma^2$. The output variance is straightforward to obtain. For example, for a continuous-time system: $$\mbox{...
3
votes
1answer
4k views

Deterministic / Non-deterministic Stochastic Process

Problem 6.1-6 of Probability, Random Variables, and Random Signal Principles, 4th Edition by Peebles asks If a process is defined by $X(t) = A$, where $A$ is a continuous random variable uniformly ...
3
votes
1answer
888 views

Average Power Spectral Density of PAM signals

I am reading through the PAM transmission scheme and about the power spectral density of the signals. Given that the Average Power Spectral Density of PAM Signals is: $$ \Phi_{ss}(f)=\Phi_{aa}\left(e^...
3
votes
1answer
854 views

Mean Square Continuity of Random Process

Show that a stochastic process $X(t)$ is mean square continuous if and only if its autocorrelation function $R_X(t_1,t_2)$ is continous $\Rightarrow$ Proof: We have $E[(X(t)-X(t_0))^2]=R_X(t,t)-R_X(...
3
votes
2answers
145 views

If noise is your signal, what is your noise?

Consider the following contrived situation. Imagine a Gaussian white noise process $x[t]$, with bandwidth $Δf$, with PSD equal to some quantity $A$ which you would like to measure. So the way to ...
2
votes
2answers
1k views

Understanding the definition of mean/autocorrelation

I was studying about the definitions of mean, expected value and autocorrelation. I wanted to verify my understanding the evaluation of mean, expected value and autocorrelation. At the same time to ...
2
votes
1answer
217 views

Processes: Orthogonal, Uncorrelated, Statistically Independent

How are they all related? You can define them as: Orthogonal Processes: $E[XY] = 0$ Uncorrelated Processes: $E[XY] = E[(X - \mu_x)(Y - \mu_y)] = 0$ Statistically Independent Processes: $E[XY] = E[X] \...
2
votes
1answer
949 views

What is an “innovation filter”?

I'm a math postgrad student working through a paper on eigenvalue decompositions of matrices of FIR filters (used for stuff like total decorrelation, convolutive mixing, MIMO). Towards the beginning, ...
2
votes
2answers
287 views

Band-limited random signal with arbitrary distribution?

I'd like to generate a random discrete-time signal that is band-limited to some bandwidth B (by means of a digital filter, ie in MATLAB). The catch is that I'd like this signal to have an arbitrary ...
2
votes
1answer
924 views

Covariance matrix, Q, for a Kalman filter given the stochastic differential equation for the state of the system?

Given that I have a stochastic differential equation describing the motion of my system like so: $$ \ddot{x}(t) + \Omega_0^2x(t) - C\dfrac{dW(t)}{dt} = 0$$ Where $\Omega_0$ and $C$ are constants. I ...
2
votes
1answer
236 views

Super basic questions on statistical process

Before starting: I am really a beginner in statistical process in time. I mainly do quantum information and while learning aspect of quantum noise I realized that I am actually too weak on basics of ...
2
votes
1answer
208 views

Second moment ergodicity of gaussian random process

How can I prove that a WSS Gaussian stochastic process with mean 0 is mean-square ergodic in the second moment if and only if: $$\lim_{n \to \infty} \frac{1}{n}\sum_{k=0}^n r_{xx}^2(k) = 0$$ When $...
2
votes
0answers
27 views

Signifance of statistical information in a signal

I am learning control engineering for some time and I work with a lot of transfer functions and frequency domain design. Reading from textbook, to me everything seems deterministic. Whenever I come ...
2
votes
0answers
32 views

Is it safe to call this WSSUS channel a Gaussian process?

BACKGROUND: Equation (3.6) of Wireless Communications by Goldsmith gives the baseband impulse response of a time-varying channel as: $$ c(\tau,t) = \sum_{n=0}^{N(t)}\alpha_n(t)e^{-j\phi_n(t)}\delta(\...
1
vote
2answers
14k views

generating white gaussian noise in matlab using two different functions

I want to know the difference between the two Gaussian noises generated below? Which one is white and how can i make the other one white? y=wgn(1,10000,0) and <...
1
vote
2answers
114 views

How to find the output mean and autocorrelation of a non-linear system

I need help with this question. I am sure this is the right StackExchange forum for this type of question. Consider a nonlinear device such that the output is $Y(t) = aX^2(t)$, where the input X(t) ...
1
vote
1answer
137 views

Relationship between the autocorrelations of X(t) and X(nt)

Defining: $X(t)$ WSS random process with autocorrelation function $R_{X}(\tau) = \mathbb{E}[X(t)X(t+\tau)]$. $Y[n] = X(nT)$ (sampling of $X$ at a rate $\frac1T$) with autocorrelation function $R_Y(\...
1
vote
2answers
151 views

Physical meaning of average values of random signals

This question might be a bit stupid, anyway, i'll risk it, since i want to get better understanding of this subject. Let's consider random signal x(t), and let's say that we know that it is ergodic ...
1
vote
1answer
85 views

Null autocorrelation function and stationary

I can show that a process $X(t)$ is Wide Sense stationary (WSS) by showing that $E[X(t)]$ is constant and that its autocorrelation function is in function of $\tau=t_1-t_2$, that is, $R_X(t+\tau,t)=...
1
vote
1answer
257 views

Doubt about wide sense stationary random process

I have white Gaussian noise $F[n]$ with zero mean and autocorrelation $R_F[n_1,n_2]=\delta[n_1-n_2]$. If now I consider the random process defined as $$X[n]=u[n]e^{-kn}F[n]$$ Is $X[n]$ a wide-ense ...
1
vote
1answer
254 views

Response of Linear System to Stochastic Process

Somehow I am getting the variance{u(n)} equal to '0' !! This is the case when I take the coefficient 'a' as real. As it is not mentioned in the question I need to find the solution to this question ...
1
vote
1answer
2k views

Autocorrelation and Power Spectral Density (Discrete)

The Autocorrelation, $\phi_{aa}[\kappa]$, of a discrete time random process, $a[k]$, is defined as: $$ \phi_{aa}[\kappa] = \mathrm{E}\left\{ a[k+\kappa]a^*[k] \right\} $$ Taking its fourier ...
1
vote
1answer
203 views

Understanding of Random Process/Random Variable

At a simpler level to my previous question, I wanted to confirm my understanding on Random Process based on Random Variables using an example. So, I took this example: If we consider a dice, which ...
1
vote
1answer
37 views

How Could One Accelerate the Convergence of the Least Mean Squares (LMS) Filter?

How can the convergence of an LMS filter be accelerated? Can we do better than the vanilla algorithm?
1
vote
2answers
230 views

expected value of two LTI output signals multiplied (cross correlation)

I have an input signal x (assumed to be iid Gaussian with $\mu=0$, $\sigma^2$) which is fed into two linear systems: $y_1 = h_1 * x$ $y_2 = h_2 * x$ Now I would like to calculate $\mathbb{E}[y_1 y_2]...
1
vote
2answers
795 views

What is the difference between the PSD of a deterministic and stochastic signal?

I am learning about stochastic processes and I don't get one thing: What is the advantage of calculating the PSD of a signal using the Wiener-Khinchin theorem $\Phi(\omega) =\mathcal{F}\{R_{xx}\}$ ...
1
vote
1answer
43 views

Find coefficients of optimal Wiener filter of length 2

I need to find the coefficients (impulse response) of a FIR Wiener filter with length equal to 2. I have a gaussian white noise signal that is generated using the Standard Normal Distribution (mean = ...
1
vote
3answers
106 views

Noise added to a Random Process

if we have a discrete random process \begin{equation} x\left(n\right)\:=\:0.2x\left(n-1\right)+w\left(n\right)+w\left(n-1\right) \end{equation} where $ w\left(n\right)$ is a noise with a mean $ m_w=0....
1
vote
1answer
29 views

different between MVG and joint MVG?

Distribution for "joint multi-variate gaussian distribution" (joint MVG): $$f_{X}(x) = \frac{1}{(2\pi)^{n/2}\prod \limits_{i=0}^{n}\sigma_i} ~~\text{exp}\bigg[-\frac{1}{2} \sum \limits_{i=1}^...
1
vote
1answer
63 views

Steady state variance of a stochastic differential equation - relation between the frequency and time domains

Consider a stochastic differential equation: $$ dx(t) = a x(t)dt + b y(t)dt \quad (1) $$ where $y(t)$ is a stochastic process satisfying $\langle y(t)y(t')\rangle = \delta(t-t')$. We will assume that ...
1
vote
1answer
33 views

Why the requirement of the GCD of the lengths of all circuits in the graph being one?

I am reading A Mathematical Theory of Communication. The second requirement of an ergodic process confuses me (emphasis mine): All the examples of artificial languages given above are ergodic. This ...
1
vote
1answer
70 views

How do I find variance from the PSD of a stochastic process?

I have a time series that consists of noise and a signal, shown here windowed and Wiener filtered: and the PSD of just the noise (used in filtering): I want to find the variance of the noise using ...
1
vote
1answer
134 views

Autocorrelation for Stationary Signals

I'm having trouble grasping the autocorrelation function for stationary signals, both strict stationary and WSS. First for strict sense, we have $$\forall(\tau,t_1, \ldots, t_n) \in \mathbb{R} \land ...
1
vote
0answers
39 views

Auto-correlation of absolute squared stochastic process

Consider the stochastic process $a(t) \in \mathbb{C}$. Its autocorrelation function is given as $$ \phi_{aa}(\tau)=\left(a(t)\star a(t)\right)(\tau)=\int_{-\infty}^{\infty}a^*(t)\cdot a(t+\tau) \...
1
vote
0answers
111 views

Is the output of function of two ergodic processes ergodic?

Let $\{\xi_k\}_{k\in \mathbf{Z}}$ and $\{\epsilon_k\}_{k\in \mathbf{Z}}$ be two independent zero-mean Gaussian processes (i.i.d.). Is the output of the function $f$ such that $y = f(\dots,\xi_{k-1},\...
1
vote
1answer
197 views

Output of lowpass filter with damped sine wave input

The random process $$Y(t)=\cos(\omega_0t)\cos(\omega_0t+\pi N(t))$$where $N(t)$ is a Poisson process of parameter $\lambda$ enters a lowpass filter with transfer function $$H(j\omega) = \left\{ \...
1
vote
0answers
1k views

Fourier transforms of random processes

In the Wikipedia article on Brownian noise, the Fourier transform of Brownian noise is determined. How is that Fourier transform defined? It seems it is a non-random quantity there, so it is not ...
0
votes
3answers
315 views

What really means stochastic in field of signal processing

I met two definitions of word stochastic, the first one (cited from wikipedia Stochastic) The word stochastic is an adjective in English that describes something that was randomly determined The ...
0
votes
1answer
238 views

LTI filtering for wide-sense stationary process

Why is it that if $U[n]$ is wide-sense stationary and it is convolved with $h[n]$ to produce $W[n]$, the autocorrelation becomes $R_{WW}[n] = R_{UU}[n]*h[n]*h[-n]$? I know that in general $R_{WW}[n_{...