Ben Ruben
@benjaminsruben.bsky.social
PhD student advised by Cengiz Pehlevan @ Harvard Biophysics studying neural networks with biological constraints.
Reposted by Ben Ruben
Great to see this one finally out in PNAS! Asymptotic theory of in-context learning by linear attention www.pnas.org/doi/10.1073/... Many thanks to my amazing co-authors Yue Lu, Mary Letey, Jacob Zavatone-Veth @jzv.bsky.social and Anindita Maiti!
Asymptotic theory of in-context learning by linear attention | PNAS
Transformers have a remarkable ability to learn and execute tasks based on examples
provided within the input itself, without explicit prior traini...
www.pnas.org
July 11, 2025 at 7:33 AM
Great to see this one finally out in PNAS! Asymptotic theory of in-context learning by linear attention www.pnas.org/doi/10.1073/... Many thanks to my amazing co-authors Yue Lu, Mary Letey, Jacob Zavatone-Veth @jzv.bsky.social and Anindita Maiti!