I hope this question is appropriate for this site.

I came across this passage in The Three Body Problem, a novel by Liu Cixin:

The professor had put up two pictures: One was the famous Song Dynasty painting Along the River During the Qingming Festival, full of fine, rich details; the other was a photograph of the sky on a sunny day, the deep blue expanse broken only by a wisp of a cloud ... The photograph's information content - its entropy- exceeded the painting's by one or two orders of magnitude

Representative pictures:

Is this true? How does one explain this counterintuitive phenomenon?

• Is there more context in the book? Jun 9, 2017 at 19:13
• @endolith no, unfortunately not.
Jun 9, 2017 at 19:22
• I wish entropy was the only measure of the content. But no. RGB Images are created for humans to look at, both paintings and photographs. So look at it yourself. Which one do you think is more informative and rich? Your choice is correct, regardless the computer measures we invent. Jun 9, 2017 at 19:32
• @TolgaBirdal Fair enough, but I would still be interested to understand why the computers are getting it wrong in this case.
Jun 9, 2017 at 19:41
• Great SciFi novel by the way Apr 28, 2020 at 14:08

It depends how you define the term "information" or "entropy".

The conventional definition of entropy of an image is to think the image as a two-dimensional matrix of pixels and $$H = - \sum_k p_k \log_2(p_k),$$ where $$p_k$$ is the probability, which is calculated from histogram, associated with gray level $$k$$.

This kind of entropy is correct if we ignore the correlation between pixels. For example the two images have the same entropy by this definition.

It is not true if the correlation between pixels is considered. For example if the color first pixel in top-left has probability $$p_k$$, the next pixel surely has the same color and its color does not have the same probability $$p_k$$.

We human being, with you as an example, use this kind of correlation to perceive the images. This kind of correlation are called "details" and, therefore, we/you expect that rich-detail images should have more information/entropy than simple ones. This is the reason why you have found it counter-intuitive.

PS:

I tried calculating the entropy of the two images you have posted, but they are not different "by one or two orders of magnitude" !!!!

"Along the River During the Qingming Festival" entropy about 7

They must not be the same files of the professor.

• Thanks, I think this is the answer I was looking for. Of course the images I uploaded were meant to be representative only, I have no idea of what the fictional professor actually showed to the class :D