But how a model represent knowledge is still an area of research, I accept that they do not represent it in a way we could fully understand 😀 Different models have different numbers of dimensions, layers and nodes... some nodes we can say what they do, and some nodes we can remove...

I like to seperate the question about how a model "represent knowledge" from training, and how you generate output during inference.
I think it is pretty easy to understand that a model could generate different outputs, based on different generation strategies (huggingface.co/docs/transfo...)

But navigating over longer distances may put you into the higher risk-zon...

I got this summary of one of my conversation with Claude

Have you check out "Monty" form Numenta?
(code just released)
www.numenta.com/thousand-bra...