What is information? As is established, Shannon set out to solve a specific problem, namely, the transmission of information through electronic media, and everyone acknowledges that his work was fundamental to the success of information technology. No question. But to then claim that he has ‘defined information’ in any general sense, or that this has profound philosophical ramifications is what I’m questioning. It seems like hand-waving to me.
I got Paul Davies’ recent book on it, The Demon in the Machine. It’s a fascinating book and I’ve always liked that author. But it too contains a lot of breathless gesturing in the direction of ‘hey, this is something really PROFOUND’ in my opinion. — Wayfarer
I believe I got you. My intuition also concurs. Shannon's definition was tailored to address specific technological issues; don't ask me for details.
You and others who're of the same view are asking a deeper, metaphysical question: what is information...
really?
We could keep Shannon's unit to measure information (bit) if it doesn't require us to endorse a metaphysical position that doesn't jibe with our gut feelings.
I'm not entirely sure about this but our instincts that all is not right in re the Shannon definition of information is still very vague/nebulous. I for one am as of now unable to home in on where exactly dear ol' Shannon trips up.
I would've loved to dig a little deeper but alas my math is a bit too rusty to complete the task as it were.
Let's keep it simple. Information as I understand it is just
answers to questions.
1. What?
2. Where?
3. When?
4. How?
5. Who?
6. Which?
7. Whose?
8. Why?
An 8-dimensional universe in which information is a particular point described by 8 pieces of information (1 to 8 vide supra).
As you are aware all of the 8 questions above can be reduced to a proposition like so:
9. What is it? = It is an apple OR It is a dog OR...
In my humble opinion, Shannon's theory seems to fit right in - how many yes/no questions do we need an answer to to zero in on the correct answer to question 9? These yes/no answers basically eliminate the possibilities (vide the "OR" in question 9) by halving the possibility space at each step (I was told it bears some resemblance to the game 20 questions).
Basically, if you're familiar with logic, Shannon's notion of information is closely tied to the natural deduction rule called
disjunctive syllogism (vide infra)
10. P or Q
11. Not P
Ergo,
12. Q
Please note that this in no way is an official position espoused by philosophers or information theorists. Just how my brain understands it. G'day mate!