All Questions
Tagged with information-theory reference-request
5 questions
0
votes
1
answer
38
views
Is there some literature to understand finite state ISI channel?
I am trying to understand channels with memory, where the state of the channel gives the past input information. I want to delve further into capacity for channels with ISI. I came across a ...
- 181
0
votes
1
answer
335
views
Shannon's entropy for non-equiprobable symbols
I am trying to understand the concept of Shannon's entropy and deciding the codelength. In first case, b is an array of 5 symbols. The symbol set is $\{1,2,...,8\}$....
- 631
3
votes
2
answers
672
views
What is the entropy for these cases?
This question stems from an article,
"Entropy estimation of symbol sequences" download link
where the abstract mentions the need for using symbols in information theory.
Random chains of ...
- 616
2
votes
1
answer
1k
views
What is Shannon's source entropy
Suppose that ${X_n; Y_n}$ is a random process with a discrete alphabet, that is, taking on values in a discrete set for $n$ data length. They correspond to the input and output of a communication ...
- 277
8
votes
1
answer
210
views
Issues related to entropy
I have long been faced with the confusion regarding entropy and would be obliged if the following are answered in less technical jargon. Following the link Different kinds of entropy raises the ...
- 277