Puzzled about the emergence of intelligence.
Physics. ML. Photonics. Software. Electronics.
📔 inigoliz.dev
- Just keep moving -
- Context results from cyclic excitation patterns in the brain net.
- Context results from temporary (and vanishing) changes to the structure of the network (neuron plasticity/synaptic plasticity).
A combination is also an option.
- Context results from cyclic excitation patterns in the brain net.
- Context results from temporary (and vanishing) changes to the structure of the network (neuron plasticity/synaptic plasticity).
A combination is also an option.
In LLMs, since the computing is separate from the memory, context doesn't effectively change the weights of the network.
However, in our brain, there's no separate bank of memory (afaik).
In LLMs, since the computing is separate from the memory, context doesn't effectively change the weights of the network.
However, in our brain, there's no separate bank of memory (afaik).
What if:
Day of operation -> Context window accumulates information
Sleeping -> Context window distils into learning, and window cleans.
There is, ofc, some sort of learning happening as the day goes on as well.
What if:
Day of operation -> Context window accumulates information
Sleeping -> Context window distils into learning, and window cleans.
There is, ofc, some sort of learning happening as the day goes on as well.
NCI project page: peterfmichael.com/nci (2/2)
NCI project page: peterfmichael.com/nci (2/2)