Turns out I was right on the nose. I didn’t see his talk (even posted this hours before I saw it popped up), but it’s not hard to see based on the rate of enhancements over the past 24 months.

It seems like there’s credence to the idea that LLMs are at a point where we will see less significant gains on base models alone:

- Amazon’s stats at re:invent were underwhelming compared to most existing models.
- OpenAI’s o1 appears to just be an agent arch applying a critic.

Good to be on BS (are we calling it that)? Guess I should update my profile image...