By @avaskham.bsky.social
#neuroskyence
www.thetransmitter.org/social-behav...
authors.elsevier.com/a/1kfup3Q9h2...
authors.elsevier.com/a/1kfup3Q9h2...
🗓️Wed 12 Feb 2025
⏰2-3pm GMT
Talk title: Neural architectures: what are they good for anyway?
"We introduce a modern Hopfield network with continuous states and a corresponding update rule. (...)
The new update rule is equivalent to the attention mechanism used in transformers. "
arxiv.org/abs/2008.02217
"We introduce a modern Hopfield network with continuous states and a corresponding update rule. (...)
The new update rule is equivalent to the attention mechanism used in transformers. "
arxiv.org/abs/2008.02217
biorxiv.org/cgi/content/...
biorxiv.org/cgi/content/...
It found:
- No change in productivity
- No change in burnout levels
- A 41% increase in the bug rate!??
Aren't you thrilled we're burning the world to power these AI models?
expectation: calm/quietness
reality: crow infights at dawn above your room
expectation: calm/quietness
reality: crow infights at dawn above your room