rcmnd

Neel Nanda

Runs the mechanistic interpretability team at Google DeepMind; formerly at Anthropic.

Also onkorrents, what they believeppll, where they publishwiqqi, who they are

8 things

Think Python 2eBook Allen B. Downey

loved

If you prefer a more traditional textbook, Think Python 2e is excellent and also available freely online.

From Neel Nanda's (co-authored with Jess Smith) 'A Barebones Guide to Mechanistic Interpretability Prerequisites' on his own site.

2022-10-24·neelnanda.io ↗

fast.aiCourse

liked

fast.ai is a good intro, but a fair bit more effort than is necessary.

2022-10-24·neelnanda.io ↗

Deep Learning for Alignment syllabusCourse Jacob Hilton

liked

Jacob Hilton’s Deep learning for Alignment syllabus - this is a lot more content than you strictly need, but is well put together and likely a good use of time to go through at least some of!

2022-10-24·neelnanda.io ↗

einopsSoftware

recommended

I highly, highly recommend learning how to use einops (a library to nicely do any reasonable manipulation of a single tensor) and einsum (a built in torch function implementing Einstein Summation notation, to do arbitrary tensor multiplication)

2022-10-24·neelnanda.io ↗

Every entry is a verbatim quote and a link to the public post it came from. Nothing is paraphrased. If it is not on record somewhere public, it is not here.

The verdict is what they actually said: loved and liked are explicit; recommended means they told others to get it; uses means they only say they use it; read is a book on their public shelf with no verdict; mixed and disliked are kept too.

A dashed affiliate link, sponsored or their own label means the post disclosed a relationship. It is shown, never hidden.

The shading behind a date shows how dated a recommendation is for its kind of thing.

The shading behind a date shows how dated a recommendation is, for its kind of thing. Fully green is recent. It drains a quarter at a time as the post gets older, and is empty once it reads as dated.

What counts as old depends on the thing. A laptop praised four years ago has been replaced twice; a book loved twenty years ago is probably still loved. The shading is gone after about:

Stripes mean the post carries no date and the date shown is an estimate. No date at all, no shading.