"Summarize this" "summarize that", the world would be a better place if people stopped giving in to FOMO and bothered to actually read stuff. LLMs, whilst useful, have unfortunately become an enabler for lazy people to bullshit their way around actually understanding things.

Doctor says, 'Dont worry, parser design is simple. Great programmer Kate Compton has written the parser you seek’

We created SuperBPE🚀, a *superword* tokenizer that includes tokens spanning multiple words.

When pretraining at 8B scale, SuperBPE models consistently outperform the BPE baseline on 30 downstream tasks (+8% MMLU), while also being 27% more efficient at inference time.🧵

Accurate in South America too.

The most unpatriotic members of any society are the far right. They will always align with foreign interests against the interests of their own nations. They will always undermine national institutions and national values in pursuit of their own interests. When they pose as patriots, they lie.

A universe in motion seen from the International Space Station during a night pass over Earth (view fullscreen).

we should really be more careful in distinguishing "an LLM" from "systems that wrap an LLM" (tricky, because chat is already a wrapper system, so its a blurry line, but it exists). and also there, one can distinguish differenf kinds of wrapping systems.

Entire-life crisis

Threading the thin line of writing specific enough search queries for math notation in LaTeX without getting nsfw search results.