Koyena Pal
@koyena.bsky.social
CS Ph.D. Candidate @ Northeastern | Interpretability + Data Science | BS/MS @ Brown
koyenapal.github.io
koyenapal.github.io
Reposted by Koyena Pal
How can a language model find the veggies in a menu?
New pre-print where we investigate the internal mechanisms of LLMs when filtering on a list of options.
Spoiler: turns out LLMs use strategies surprisingly similar to functional programming (think "filter" from python)! 🧵
New pre-print where we investigate the internal mechanisms of LLMs when filtering on a list of options.
Spoiler: turns out LLMs use strategies surprisingly similar to functional programming (think "filter" from python)! 🧵
November 4, 2025 at 5:48 PM
How can a language model find the veggies in a menu?
New pre-print where we investigate the internal mechanisms of LLMs when filtering on a list of options.
Spoiler: turns out LLMs use strategies surprisingly similar to functional programming (think "filter" from python)! 🧵
New pre-print where we investigate the internal mechanisms of LLMs when filtering on a list of options.
Spoiler: turns out LLMs use strategies surprisingly similar to functional programming (think "filter" from python)! 🧵
Reposted by Koyena Pal
What's the right unit of analysis for understanding LLM internals? We explore in our mech interp survey (a major update from our 2024 ms).
We’ve added more recent work and more immediately actionable directions for future work. Now published in Computational Linguistics!
We’ve added more recent work and more immediately actionable directions for future work. Now published in Computational Linguistics!
October 1, 2025 at 2:03 PM
What's the right unit of analysis for understanding LLM internals? We explore in our mech interp survey (a major update from our 2024 ms).
We’ve added more recent work and more immediately actionable directions for future work. Now published in Computational Linguistics!
We’ve added more recent work and more immediately actionable directions for future work. Now published in Computational Linguistics!
🚨 Registration is live! 🚨
The New England Mechanistic Interpretability (NEMI) Workshop is happening Aug 22nd 2025 at Northeastern University!
A chance for the mech interp community to nerd out on how models really work 🧠🤖
🌐 Info: nemiconf.github.io/summer25/
📝 Register: forms.gle/v4kJCweE3UUH...
The New England Mechanistic Interpretability (NEMI) Workshop is happening Aug 22nd 2025 at Northeastern University!
A chance for the mech interp community to nerd out on how models really work 🧠🤖
🌐 Info: nemiconf.github.io/summer25/
📝 Register: forms.gle/v4kJCweE3UUH...
June 30, 2025 at 10:55 PM
🚨 Registration is live! 🚨
The New England Mechanistic Interpretability (NEMI) Workshop is happening Aug 22nd 2025 at Northeastern University!
A chance for the mech interp community to nerd out on how models really work 🧠🤖
🌐 Info: nemiconf.github.io/summer25/
📝 Register: forms.gle/v4kJCweE3UUH...
The New England Mechanistic Interpretability (NEMI) Workshop is happening Aug 22nd 2025 at Northeastern University!
A chance for the mech interp community to nerd out on how models really work 🧠🤖
🌐 Info: nemiconf.github.io/summer25/
📝 Register: forms.gle/v4kJCweE3UUH...
Reposted by Koyena Pal
[📄] Are LLMs mindless token-shifters, or do they build meaningful representations of language? We study how LLMs copy text in-context, and physically separate out two types of induction heads: token heads, which copy literal tokens, and concept heads, which copy word meanings.
April 7, 2025 at 1:54 PM
[📄] Are LLMs mindless token-shifters, or do they build meaningful representations of language? We study how LLMs copy text in-context, and physically separate out two types of induction heads: token heads, which copy literal tokens, and concept heads, which copy word meanings.
🚀 How would you know what model to use? 🤗
With millions of models emerging rapidly, how do we verify, track, and find the right one?
We survey and formalize Model Lakes 🌊🤖 — a framework to structure, navigate, and make sense of this landscape.
Website: lakes.baulab.info
#AI #Database
🧵1/5
With millions of models emerging rapidly, how do we verify, track, and find the right one?
We survey and formalize Model Lakes 🌊🤖 — a framework to structure, navigate, and make sense of this landscape.
Website: lakes.baulab.info
#AI #Database
🧵1/5
March 5, 2025 at 6:28 PM
🚀 How would you know what model to use? 🤗
With millions of models emerging rapidly, how do we verify, track, and find the right one?
We survey and formalize Model Lakes 🌊🤖 — a framework to structure, navigate, and make sense of this landscape.
Website: lakes.baulab.info
#AI #Database
🧵1/5
With millions of models emerging rapidly, how do we verify, track, and find the right one?
We survey and formalize Model Lakes 🌊🤖 — a framework to structure, navigate, and make sense of this landscape.
Website: lakes.baulab.info
#AI #Database
🧵1/5
Reposted by Koyena Pal
PhD Applicants: remember that the Northeastern Computer Science PhD application deadline is Dec 15.
It's a terrific time to do a PhD, with so many interesting things happening in AI.
Apply here:
www.khoury.northeastern.edu/apply/phd-ap...
It's a terrific time to do a PhD, with so many interesting things happening in AI.
Apply here:
www.khoury.northeastern.edu/apply/phd-ap...
PhD Apply - Khoury College of Computer Sciences
www.khoury.northeastern.edu
December 7, 2024 at 10:31 AM
PhD Applicants: remember that the Northeastern Computer Science PhD application deadline is Dec 15.
It's a terrific time to do a PhD, with so many interesting things happening in AI.
Apply here:
www.khoury.northeastern.edu/apply/phd-ap...
It's a terrific time to do a PhD, with so many interesting things happening in AI.
Apply here:
www.khoury.northeastern.edu/apply/phd-ap...
Reposted by Koyena Pal
More big news! Applications are open for the NDIF Summer Engineering Fellowship—an opportunity to work on cutting-edge AI research infrastructure this summer in Boston! 🚀
December 10, 2024 at 9:59 PM
More big news! Applications are open for the NDIF Summer Engineering Fellowship—an opportunity to work on cutting-edge AI research infrastructure this summer in Boston! 🚀