Questions tagged [stochastic]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
6
votes
2answers
620 views

Why is $A\cos(2\pi f_ct)$ a non-stationary process?

I am studying analog communication and having Communication system - Simon Hykin as one of the reference. There is a question Consider the sinusoidal process$$X(t) = A\cos(2\pi f_ct)$$where the ...
5
votes
1answer
3k views

Understanding of Random Process, Random Variable and Probability Density Function

I just wanted to confirm my understanding of a Random Process, Random Variable and the its Probability density Function. Here is the way that I looked a Random Process/Random Variable: If we ...
5
votes
1answer
78 views

Is there any computational method to prove whether a series is stationary or not?

I have a discrete series $x[n]$. It is extracted from real life and I do not have probability distribution of each value $x[n]$. Is there any computational method to prove whether the series is ...
4
votes
2answers
64 views

Intuition about independent signals

Given is this Wiener filter: From this we take \begin{equation} x[k]-a x[k-1]=v[k] \end{equation} $v(k)$ is assumed to be a white gaussian noise. In the textbook it is then stated that The ...
4
votes
2answers
54 views

Moving from deterministic signals to stochastic signals in s-domain (Power Spectral Density)

Assume we have the following system (coming from control systems theory, hence in s-domain) $ Y(s) = H_A (s) \cdot A(s) - H_B (s) \cdot B(s) $ I now wish to consider $a(t)$ and $b(t)$ as white noise ...
4
votes
1answer
3k views

Understanding Ergodicity and Ensemble Averaging

Literature says that a stationary signal is ergodic, if its ensemble average = time averages. Should it be the statistics computed by time averaging = statistics computed by ensemble averaging?The way ...
3
votes
2answers
2k views

What's the meaning of ergodicity? [duplicate]

I just read the topic about Ergodicity but I have ambiguity about its meaning (by intuition). What does mean: (for mean) Statistical average = Time average. Could you please explain it in detail. ...
3
votes
1answer
396 views

explanation of correlation of stationary stochastic processes

I have some doubts about correlation in stationary stochastic processes. I know that the expectation of a random variable is $$E(x)=\int_{-\infty}^{+\infty} a f_x(...
3
votes
1answer
263 views

Higher-order moment of output of LTI system

Assume a very simple LTI system. Assume $x$ is white Gaussian i.i.d. with variance $\sigma^2$. The output variance is straightforward to obtain. For example, for a continuous-time system: $$\mbox{...
3
votes
1answer
3k views

Deterministic / Non-deterministic Stochastic Process

Problem 6.1-6 of Probability, Random Variables, and Random Signal Principles, 4th Edition by Peebles asks If a process is defined by $X(t) = A$, where $A$ is a continuous random variable uniformly ...
3
votes
1answer
790 views

Average Power Spectral Density of PAM signals

I am reading through the PAM transmission scheme and about the power spectral density of the signals. Given that the Average Power Spectral Density of PAM Signals is: $$ \Phi_{ss}(f)=\Phi_{aa}\left(e^...
3
votes
1answer
650 views

Mean Square Continuity of Random Process

Show that a stochastic process $X(t)$ is mean square continuous if and only if its autocorrelation function $R_X(t_1,t_2)$ is continous $\Rightarrow$ Proof: We have $E[(X(t)-X(t_0))^2]=R_X(t,t)-R_X(...
3
votes
1answer
1k views

Power Spectral Density of Brownian Motion despite non-stationary

Note: I originally asked this on Physics Stack Exchange but haven't attracted any interest there so I'm asking here where it may be more relevant. A white noise process, $\xi(t)$ with delta ...
3
votes
2answers
140 views

If noise is your signal, what is your noise?

Consider the following contrived situation. Imagine a Gaussian white noise process $x[t]$, with bandwidth $Δf$, with PSD equal to some quantity $A$ which you would like to measure. So the way to ...
2
votes
1answer
127 views

Processes: Orthogonal, Uncorrelated, Statistically Independent

How are they all related? You can define them as: Orthogonal Processes: $E[XY] = 0$ Uncorrelated Processes: $E[XY] = E[(X - \mu_x)(Y - \mu_y)] = 0$ Statistically Independent Processes: $E[XY] = E[X] \...
2
votes
1answer
771 views

What is an “innovation filter”?

I'm a math postgrad student working through a paper on eigenvalue decompositions of matrices of FIR filters (used for stuff like total decorrelation, convolutive mixing, MIMO). Towards the beginning, ...
2
votes
2answers
242 views

Band-limited random signal with arbitrary distribution?

I'd like to generate a random discrete-time signal that is band-limited to some bandwidth B (by means of a digital filter, ie in MATLAB). The catch is that I'd like this signal to have an arbitrary ...
2
votes
1answer
841 views

Covariance matrix, Q, for a Kalman filter given the stochastic differential equation for the state of the system?

Given that I have a stochastic differential equation describing the motion of my system like so: $$ \ddot{x}(t) + \Omega_0^2x(t) - C\dfrac{dW(t)}{dt} = 0$$ Where $\Omega_0$ and $C$ are constants. I ...
2
votes
2answers
504 views

What does the frequency axis of a Power Spectral Density mean?

I have never really understood what the frequency axis meant when we plot the Power Spectral Density(PSD). Does it correspond to frequency as we get after we take the Fourier Transform of a time ...
2
votes
1answer
227 views

Super basic questions on statistical process

Before starting: I am really a beginner in statistical process in time. I mainly do quantum information and while learning aspect of quantum noise I realized that I am actually too weak on basics of ...
2
votes
1answer
169 views

Second moment ergodicity of gaussian random process

How can I prove that a WSS Gaussian stochastic process with mean 0 is mean-square ergodic in the second moment if and only if: $$\lim_{n \to \infty} \frac{1}{n}\sum_{k=0}^n r_{xx}^2(k) = 0$$ When $...
2
votes
0answers
26 views

Signifance of statistical information in a signal

I am learning control engineering for some time and I work with a lot of transfer functions and frequency domain design. Reading from textbook, to me everything seems deterministic. Whenever I come ...
2
votes
0answers
31 views

Is it safe to call this WSSUS channel a Gaussian process?

BACKGROUND: Equation (3.6) of Wireless Communications by Goldsmith gives the baseband impulse response of a time-varying channel as: $$ c(\tau,t) = \sum_{n=0}^{N(t)}\alpha_n(t)e^{-j\phi_n(t)}\delta(\...
1
vote
2answers
1k views

Understanding the definition of mean/autocorrelation

I was studying about the definitions of mean, expected value and autocorrelation. I wanted to verify my understanding the evaluation of mean, expected value and autocorrelation. At the same time to ...
1
vote
1answer
106 views

Relationship between the autocorrelations of X(t) and X(nt)

Defining: $X(t)$ WSS random process with autocorrelation function $R_{X}(\tau) = \mathbb{E}[X(t)X(t+\tau)]$. $Y[n] = X(nT)$ (sampling of $X$ at a rate $\frac1T$) with autocorrelation function $R_Y(\...
1
vote
2answers
14k views

generating white gaussian noise in matlab using two different functions

I want to know the difference between the two Gaussian noises generated below? Which one is white and how can i make the other one white? y=wgn(1,10000,0) and <...
1
vote
1answer
64 views

Null autocorrelation function and stationary

I can show that a process $X(t)$ is Wide Sense stationary (WSS) by showing that $E[X(t)]$ is constant and that its autocorrelation function is in function of $\tau=t_1-t_2$, that is, $R_X(t+\tau,t)=...
1
vote
1answer
212 views

Doubt about wide sense stationary random process

I have white Gaussian noise $F[n]$ with zero mean and autocorrelation $R_F[n_1,n_2]=\delta[n_1-n_2]$. If now I consider the random process defined as $$X[n]=u[n]e^{-kn}F[n]$$ Is $X[n]$ a wide-ense ...
1
vote
1answer
206 views

Response of Linear System to Stochastic Process

Somehow I am getting the variance{u(n)} equal to '0' !! This is the case when I take the coefficient 'a' as real. As it is not mentioned in the question I need to find the solution to this question ...
1
vote
1answer
1k views

Autocorrelation and Power Spectral Density (Discrete)

The Autocorrelation, $\phi_{aa}[\kappa]$, of a discrete time random process, $a[k]$, is defined as: $$ \phi_{aa}[\kappa] = \mathrm{E}\left\{ a[k+\kappa]a^*[k] \right\} $$ Taking its fourier ...
1
vote
1answer
191 views

Understanding of Random Process/Random Variable

At a simpler level to my previous question, I wanted to confirm my understanding on Random Process based on Random Variables using an example. So, I took this example: If we consider a dice, which ...
1
vote
2answers
117 views

Physical meaning of average values of random signals

This question might be a bit stupid, anyway, i'll risk it, since i want to get better understanding of this subject. Let's consider random signal x(t), and let's say that we know that it is ergodic ...
1
vote
2answers
693 views

What is the difference between the PSD of a deterministic and stochastic signal?

I am learning about stochastic processes and I don't get one thing: What is the advantage of calculating the PSD of a signal using the Wiener-Khinchin theorem $\Phi(\omega) =\mathcal{F}\{R_{xx}\}$ ...
1
vote
3answers
102 views

Noise added to a Random Process

if we have a discrete random process \begin{equation} x\left(n\right)\:=\:0.2x\left(n-1\right)+w\left(n\right)+w\left(n-1\right) \end{equation} where $ w\left(n\right)$ is a noise with a mean $ m_w=0....
1
vote
1answer
29 views

different between MVG and joint MVG?

Distribution for "joint multi-variate gaussian distribution" (joint MVG): $$f_{X}(x) = \frac{1}{(2\pi)^{n/2}\prod \limits_{i=0}^{n}\sigma_i} ~~\text{exp}\bigg[-\frac{1}{2} \sum \limits_{i=1}^...
1
vote
1answer
53 views

Steady state variance of a stochastic differential equation - relation between the frequency and time domains

Consider a stochastic differential equation: $$ dx(t) = a x(t)dt + b y(t)dt \quad (1) $$ where $y(t)$ is a stochastic process satisfying $\langle y(t)y(t')\rangle = \delta(t-t')$. We will assume that ...
1
vote
1answer
27 views

Why the requirement of the GCD of the lengths of all circuits in the graph being one?

I am reading A Mathematical Theory of Communication. The second requirement of an ergodic process confuses me (emphasis mine): All the examples of artificial languages given above are ergodic. This ...
1
vote
1answer
41 views

How do I find variance from the PSD of a stochastic process?

I have a time series that consists of noise and a signal, shown here windowed and Wiener filtered: and the PSD of just the noise (used in filtering): I want to find the variance of the noise using ...
1
vote
1answer
91 views

Autocorrelation for Stationary Signals

I'm having trouble grasping the autocorrelation function for stationary signals, both strict stationary and WSS. First for strict sense, we have $$\forall(\tau,t_1, \ldots, t_n) \in \mathbb{R} \land ...
1
vote
0answers
35 views

Auto-correlation of absolute squared stochastic process

Consider the stochastic process $a(t) \in \mathbb{C}$. Its autocorrelation function is given as $$ \phi_{aa}(\tau)=\left(a(t)\star a(t)\right)(\tau)=\int_{-\infty}^{\infty}a^*(t)\cdot a(t+\tau) \...
1
vote
0answers
95 views

Is the output of function of two ergodic processes ergodic?

Let $\{\xi_k\}_{k\in \mathbf{Z}}$ and $\{\epsilon_k\}_{k\in \mathbf{Z}}$ be two independent zero-mean Gaussian processes (i.i.d.). Is the output of the function $f$ such that $y = f(\dots,\xi_{k-1},\...
1
vote
1answer
182 views

Output of lowpass filter with damped sine wave input

The random process $$Y(t)=\cos(\omega_0t)\cos(\omega_0t+\pi N(t))$$where $N(t)$ is a Poisson process of parameter $\lambda$ enters a lowpass filter with transfer function $$H(j\omega) = \left\{ \...
1
vote
0answers
1k views

Fourier transforms of random processes

In the Wikipedia article on Brownian noise, the Fourier transform of Brownian noise is determined. How is that Fourier transform defined? It seems it is a non-random quantity there, so it is not ...
0
votes
3answers
306 views

What really means stochastic in field of signal processing

I met two definitions of word stochastic, the first one (cited from wikipedia Stochastic) The word stochastic is an adjective in English that describes something that was randomly determined The ...
0
votes
1answer
227 views

LTI filtering for wide-sense stationary process

Why is it that if $U[n]$ is wide-sense stationary and it is convolved with $h[n]$ to produce $W[n]$, the autocorrelation becomes $R_{WW}[n] = R_{UU}[n]*h[n]*h[-n]$? I know that in general $R_{WW}[n_{...
0
votes
2answers
78 views

Stochastic approximation algorithm

The goal is to find the FIR filter coefficients $\mathbf{h} = [5;3]$ with the help of the adaptive FIR filter $\mathbf{w}$ of order $p = 2$. I have implemented the Stochastic approximation algorithm ...
0
votes
1answer
212 views

Ergodicity of joint process

If we have two processes and both of them are ergodic. Does this mean that the joint proces is ergodic? Or other way around? If we have the dynamics for both components of the joint process what are ...
0
votes
2answers
76 views

When deriving the power spectral density of stochastic processes, why does taking an expectation allow the $T\rightarrow\infty$ limit to be taken?

I am following the arguments presented in the paper AN-255 Power Spectra Estimation, from Texas Instruments, to learn how to derive the power spectral density for a stationary stochastic process, and ...
0
votes
1answer
71 views

When a stochastic process would be a beneficial model in terms of noise

Let's say we have an image/signal with some noise in it. When would it be beneficial to model the signal as an outcome of a stochastic process? More specifically: How significant would noise have to ...
0
votes
2answers
581 views

Ornstein Uhlenbeck with drift

The Ornstein-Uhlenbeck (OU) process $dX_t = -\frac{1}{\mu} X_t + \sqrt{\frac{2\sigma^2}{\mu}} dW_t $ generates coloured noise with autocorrelation function $R(t) = \langle X_t,X_{t'}\rangle = \...