Information Theory, Inference and Learning AlgorithmsBook
by David MacKay
Who uses, recommends or left Information Theory, Inference and Learning Algorithms, in their own words: each a verbatim quote with a link to where it was said.
Co-founder and chief science officer of Hugging Face; writes about open models and where he thinks the field is wrong.
loved
"Information Theory, Inference and Learning Algorithms" by David MacKay (http://www.inference.org.uk/mackay/itila/book.html) is a little gem that explain propabilities and Information theory so clearly it's almost unbelievable.
A reading list he posted, linked from his homepage bio; he repeats this same recommendation in his 2024 update below in the list.
Mathematician and creator of the 3Blue1Brown YouTube channel and the Manim animation library.
recommendedaffiliate link
Information theory has a way of shaping the way you view many things in math, computer science, physics, and beyond. It's one of those fields that takes ideas that you wouldn't think of as being quantifiable or rigorous and makes them so.
His Book recommendations page, introduced as "a small list of textbooks I've thoroughly enjoyed at some time in the past, with the added condition that each one stands out in some way from the surrounding body of math texts". The cover images link to Amazon through amzn.to short links that resolve to URLs carrying the affiliate tag 3b1b04-20.
Every entry is a verbatim quote and a link to the public post it came from. Nothing is paraphrased. If it is not on record somewhere public, it is not here.
The verdict is what they actually said: loved and liked are explicit; recommended means they told others to get it; uses means they only say they use it; read is a book on their public shelf with no verdict; mixed and disliked are kept too.
A dashed affiliate link, sponsored or their own label means the post disclosed a relationship. It is shown, never hidden.
The shading behind a date shows how dated a recommendation is for its kind of thing.
The shading behind a date shows how dated a recommendation is, for its kind of thing. Fully green is recent. It drains a quarter at a time as the post gets older, and is empty once it reads as dated.
What counts as old depends on the thing. A laptop praised four years ago has been replaced twice; a book loved twenty years ago is probably still loved. The shading is gone after about:
Hardware, services4 years
Software5 years
Podcasts, courses, other8 years
Books25 years
Stripes mean the post carries no date and the date shown is an estimate. No date at all, no shading.