I just read the topic about Ergodicity but I have ambiguity about its meaning (by intuition). What does mean: (for mean) Statistical average = Time average. Could you please explain it in detail. Thanks.


If you sample a random process for a specific t, you will get one realization of a random variable. For another t, you get another realization of that random variable. This random variable has its statistics which is almost impossible to learn in real world because not all sample paths are observable. See the brown rectangle in the figure below.

That becomes possible in ergodic processes. An ergodic process is the one where the time average of a sample path is the same as the statistical mean. See the purple line in the figure below, which was the observed sample path such as a particular realization of noise in a communications receiver.

enter image description here

  • $\begingroup$ Ignore the y-axis ticks. I quickly drew the figure in Matlab and forgot to remove that. $\endgroup$ – Qasim Chaudhari Nov 3 '16 at 10:08
  • $\begingroup$ Thanks. What you mean by "the time average of a sample path"? It means it should be any sample path? $\endgroup$ – Amin Nov 3 '16 at 12:19
  • 2
    $\begingroup$ @Stephen Yes, the time average of any sample path -- if the process is ergodic, all sample paths have the same statistics, so it doesn't matter which particular one you look at. $\endgroup$ – MBaz Nov 3 '16 at 13:04
  • $\begingroup$ @MBaz, Thanks for your nice comment. Is it possible to extend your comment with an example of simple Ergodic process? $\endgroup$ – Amin Nov 3 '16 at 13:17
  • $\begingroup$ @Stephen dsp.stackexchange.com/questions/34976/… $\endgroup$ – MBaz Nov 3 '16 at 16:25

An eternal well-balanced dice has 1/6 probability for each facet $f$, each time. This uniform probability law yields a mean expectation of 3.5: $\sum_{f=1}^{6} \frac{1}{6}\times f$.

Each time you cast the dice, you get this expectation. Of course, for each throw you'll only get an integer 1, 2, 3, 4, 5, or 6, never a decimal like 3.5. So there is an apparent mismatch between what you can expect (in probability) and what you get (actually). A mismatch that relates the (theoretical) probability space and the (real) time space.

The hypothesis of ergodicity may reconcile the two aspects: it tells you that, averaging over a sufficient number of trials in time, you can get the same results as if you were capable of throwing an infinity of dice at the same time.

But remember that it is an hypothesis on processes, and that non-ergodic phenomena exist.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.