I'm rejoining GDM in NYC this week, looking forward to catching up with folks :)

More than anything, the R1 model and paper make me wonder how far along we'd be if everyone was still clamoring to shout their best ideas from the rooftops. I know it's naïve to think we could sustain open research of the kind we saw up to 2020 indefinitely, but still...

I wrote up some thoughts having worked on generative music over the past year.

I talk a bit about where tech is now, how it's being used, and where it might go.

pxgy.substack.com/p/thoughts-o...

First book of the year and it was a doozy. I think I have a soft spot for aerospace engineering--I liked this almost as much as 'Carrying the Fire'.

Trying out NNX having previously switched from Haiku to Linen.

Something something fool me once, something something I'll probably just get fooled again.

I like the Bayesian framing of reward-based post-training (i.e. reward-maximization with a KL penalty).

(Figure from 'RL with KL penalties is better viewed as Bayesian inference', link below along with other useful references)

If there was a product that combined unlimited Advanced Voice + Sonnet 3.6 + arbitrary document context for reference, I’d probably pay $1000 per month. 24/7 yapping

Electronic devices that don’t run out of battery, who is building this

I like posts on Twitter and then I come here to see if the person has posted the same thing so I can like it all over again