Are you fitting the grammar in the prompt and asking to generate that?
How often does it generate invalid code?
@grantslatton.bsky.social has some changes to llama.cpp to force it to generate valid syntax by forcing it to sample from tokens that abide to the grammar
Are you fitting the grammar in the prompt and asking to generate that?
How often does it generate invalid code?
@grantslatton.bsky.social has some changes to llama.cpp to force it to generate valid syntax by forcing it to sample from tokens that abide to the grammar
captures my frustration with Economics well. It pretends to produce outcomes (a la An Engine, not a Camera) but it only succeeds when its thin Map matches the Territory (which is very rare)
captures my frustration with Economics well. It pretends to produce outcomes (a la An Engine, not a Camera) but it only succeeds when its thin Map matches the Territory (which is very rare)