1. Pretraining is dead. The internet has run out of data.
2. What's next? Agents, synthetic data, inference-time compute
3. What's next long term? Superintelligence, reasoning, understanding, self-awareness, and we can't predict what's gonna happen.
1. Pretraining is dead. The internet has run out of data.
2. What's next? Agents, synthetic data, inference-time compute
3. What's next long term? Superintelligence, reasoning, understanding, self-awareness, and we can't predict what's gonna happen.