Gopal The Fifth
t3rmin4t0r.bsky.social
Gopal The Fifth
@t3rmin4t0r.bsky.social
Likes sleep, books and debugging.

Almost never finishes drafts on https://notmysock.org/blog/
We can't see each token on its way out, but if I play this out in my head, I can see it generating ['</', 'output', ...] and jumping to '_list'.
April 7, 2025 at 6:25 PM
Turns out that to an LLM, it tokenizes

as ['']

which looks too much like the tokens for closing ['']

You can see this in - platform.openai.com/tokenizer

It mixes up the two adjacent tag closings into one.

Changing the tag names fixes it
April 7, 2025 at 6:23 PM
Also the drafts and the entire blog text is actually maintained in a Subversion repo, which I keep planning to migrate to git but never have.

The txt -> html is driven by a Makefile pattern which now works on BSD make (no GNU make magic).

Fixing this is a whole yak shaving exercise.
February 27, 2025 at 6:51 AM
Probably the tap cartridge in the bathroom which gets slapped down by kids.
January 14, 2025 at 5:55 AM