I was reading a paper about finding optimal morlet wavelet function for CWT, and they were minimizing Shannon entropy.
what is Shannon entropy and it uses?
(specially on continuous wavelet transform)
$\begingroup$
$\endgroup$
-
3$\begingroup$ Entropy (information theory), introduced by Claude Shannon. $\endgroup$ – Jason R Dec 6 '13 at 1:56
$\begingroup$
$\endgroup$
Shannon entropy is a way of measuring the degree of unexpectedness or unpredictability of a random variable. For example rolling a die has higher entropy than flipping a coin because the die has more possible outcomes making it harder to predict. Same goes for a biased coin versus a fair coin.
-
$\begingroup$ For signals, it also helps quantifying the amount of information present in the signal, so that if there's only a small amount you know you can describe the signal with limited data. $\endgroup$ – Florian Castellane Dec 6 '13 at 5:50
-
$\begingroup$ check my other question about shannon entropy here plz dsp.stackexchange.com/questions/13055/… @Aaron $\endgroup$ – SAH Dec 6 '13 at 14:16
-
