Ryan
ryanbloom.xyz
Ryan
@ryanbloom.xyz
Pinned
Ryan @ryanbloom.xyz · Apr 8
I made a video! It introduces superposition in neural networks, and shows how to construct weight matrices for superposition in a simple autoencoder.

Watch it here: youtu.be/q1aB91-6tx8
How do AI models store so much information?
Neural networks use a trick called superposition to store more concepts than they have neurons. This video introduces superposition and shows how to implemen...
youtu.be
The hardest part of coding with LLMs is resisting wishful thinking about their capabilities. It's so tempting to just type a simple prompt and sit back to watch; it's also rewarding sometimes, like a slot machine. But it's a pretty ineffective workflow. For now.
August 1, 2025 at 4:24 AM
Agency is mostly just curiosity about the best way to do something
June 3, 2025 at 3:52 PM
When reward hacking gets in the way of AI progress
April 20, 2025 at 12:39 AM
I made a video! It introduces superposition in neural networks, and shows how to construct weight matrices for superposition in a simple autoencoder.

Watch it here: youtu.be/q1aB91-6tx8
How do AI models store so much information?
Neural networks use a trick called superposition to store more concepts than they have neurons. This video introduces superposition and shows how to implemen...
youtu.be
April 8, 2025 at 12:29 AM
that feeling of dread when o3-mini botches an edit for the third time and you have to actually read your codebase
February 23, 2025 at 5:27 PM
Just updated my homepage for the first time since “What (if any) are the limits of large deep learning models?” was an interesting question
February 1, 2025 at 9:12 PM
How Far Does the Hedonic Treadmill Go? ryanbloom.xyz/posts/how-fa...
February 26, 2024 at 2:35 AM