Translation: You have no new messages.

GPT now has ads. 💀

They are voluntary... for now.

Every single part of this website is solid gold. 😂 Thank you!

In reality, all environments are only partially observable, so this is the only regime in which RL should be evaluated.

I just realized that all these hyped-up “AI scientist” concepts all concentrate on the idea of *discovery*—new algorithms, new materials, new products—without exception. Not a one of them focus on *understanding*—arguably the larger role of a scientist! 🧐

Been studying Mixture of Experts recently. It's baffling to learn that typically different tokens are routed to *different* experts. How can you be an "expert" at a particular word?? I suspect this name lends us very poor intuition for what these models actually do!

(shows 2 tokens and 4 "experts")

Don't know which pub you're referencing (having a hard time finding on my phone), but he also discusses this in his "Studying Artificial Life With Cellular Automata". I.e., molecules are parallel so alife should be too. (Later mentions why traditional computers are not so parallel, even w many CPU.)

That process for making a decision? THAT'S the free will! That's just you. Deciding.

Yeah I think I got a pretty good one... #bsky_builds_bots

Post your cookies. (Better late than never.)

Sutton's Bitter Lesson is that simple algorithms win *IF* they can scale. But the whole point is we don't all agree on what will scale.

WHY SO EFFECTIVE?
MORE IN PAPER!

A new foundational infrastructure is needed to achieve the Internet as the participatory, self-organized collective we initially dreamed it would be... rather than the centralized, uncustomizable, ad-choked Internet we've ended up with.

Look, I do machine learning, but I'm not happy about it.

The technology we could have vs. the technology we got.