1
$\begingroup$

If a random process is first order stationary, its mean is constant. However, if a random process has a constant mean say $3$ and an autocorrelation equal to $9 + 15e^{|-\tau|}$. The process is clearly wide sense stationary. Is the process first order stationary?

$\endgroup$
  • $\begingroup$ What is your understanding of the term "first-order stationary"? Be as specific as you can. $\endgroup$ – Dilip Sarwate Mar 28 '17 at 23:07
  • $\begingroup$ @Dilip By first-order stationarity, I mean the first order density function is independent of absolute time. $\endgroup$ – Ehsa Mar 29 '17 at 2:42
5
$\begingroup$

In the usual sense of the term, first-order stationarity means that the first-order distribution of all the random variables is the same: each $X_t$ has the same CDF, and so the same pdf (or pmf) too if the random variables are continuous (or discrete). If the random variables have a mean, then they all have the same mean. But, a sequence of independent identically distributed Cauchy random variables is a first-order stationary process (as well as a strictly stationary process for that matter) but it cannot be said to have constant mean because none of the variables have a mean at all.

Since your response to my query on the problem statement is that your definition of first-order stationarity is the standard one, then the answer to the question in the title of your question, viz.

If the mean of a random process is constant, does it imply that the process is first-order stationary?

is NO, and an example of a process that has constant mean but is not first-order stationary is a sequence of constant-mean random variables whose variances depend on time.

The answer to the question in the text, viz.

Is a WSS process necessarily first-order stationary?

ia also NO. Consider the random process $\{X(t)\colon X(t)= \cos (t + \Theta), -\infty < t < \infty\}$ where $\Theta$ takes on four equally likely values $0, \pi/2, \pi$ and $3\pi/2$ and so $X(t)$ takes on four equally likely values $\cos(t)$, $\cos(t+\frac{\pi}{2}) = -\sin(t)$, $\cos(t+\pi) = -\cos(t)$, and $\cos(t+\frac{3\pi}{2}) = \sin(t)$. It is easy to see that in general $X(t)$ and $X(s)$ have different distributions and so the process is not first-order stationary. On the other hand, $E[X(t)] = 0$ for all $t$ while \begin{align} E[X(t)X(s)]&= \left.\left.\frac 14\right[2\cos(t)\cos(s) + 2\cos(t+\pi/2)\cos(s+\pi/2)\right]\\ &= \left.\left.\frac 12\right[\cos(t)\cos(s) + \sin(t)\sin(s)\right]\\ &= \frac 12 \cos(t-s) \end{align} and so the process is wide sense stationary, but its first-order distribution does depend the choice of $t$ and so the process is not first-order stationary.


Note: the above proof uses a very commonly accepted definition of wide sense stationarity as found in numerous books, online resources, Wikipedia etc, viz. a random process $\{X(t)\}$ is called a wide sense stationary (WSS) process if

  1. $E[X(t)]$ is a constant, and
  2. $R_{X}(t,s) = E[X(t)X(s)]$ depends only on the difference $t-s$ of the two arguments and not on the individual arguments $t$ and $s$.
$\endgroup$
  • $\begingroup$ Ok I've checked all of the (engineering) books in my library on stochastic processes and it seems that the definition of WSS random process agrees with your statement; a process with a constant mean and lag dependent ACF... I've deleted my answer. $\endgroup$ – Fat32 Apr 27 '17 at 22:38
  • $\begingroup$ @Dilip Sarwate "but its first-order distribution does depend the choice of t and so the process is not first-order stationary" Is that a typo? Doesn't it depend only on the difference t−s ? $\endgroup$ – VMMF Feb 7 '18 at 21:26
  • $\begingroup$ @VMMF There is no typo. The first-order distribution tells us the values that the random variable $X(t)$ takes on, and these are $\pm \cos t$ and $\pm \sin t$, very obviously different for different choices of $t$. On the other hand, the autocorrelation function $R_X(t-s) = E[X(t)X(s)]$ is a function of $t-s$ which is why the process that I give as an example is wide-sense stationary but not first-order stationary. $\endgroup$ – Dilip Sarwate Feb 7 '18 at 22:04
  • $\begingroup$ @Dilip Sarwate So as the phase takes 4 different distribution values the first-order density function is not independent of time origin, hence the process is not first-order stationary even though the conditions for wide sense stationarity are present? $\endgroup$ – VMMF Feb 7 '18 at 22:55
  • $\begingroup$ @VMMF You got it! $\endgroup$ – Dilip Sarwate Feb 7 '18 at 23:04

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.