LightNews LightNews
guilima-dfbr.bsky.social
@guilima-dfbr.bsky.social
29 followers 78 following 0 posts
Posts Replies Media Videos
Reposted
simonwillison.net
Workaccount2 on Hacker News just coined the term "context rot" to describe the thing where the quality of an LLM conversation drops as the context fills up with accumulated distractions and dead ends news.ycombinator.com/item?id=4430...
Comment by Workaccount2, 9 hours ago: They poison their own context. Maybe you can call it context rot, where as context grows and especially if it grows with lots of distractions and dead ends, the output quality falls off rapidly. Even with good context the rot will start to become apparent around 100k tokens (with Gemini 2.5). They really need to figure out a way to delete or "forget" prior context, so the user or even the model can go back and prune poisonous tokens. Right now I work around it by regularly making summaries of instances, and then spinning up a new instance with fresh context and feed in the summary of the previous instance.
June 18, 2025 at 11:22 PM