NDIF Team
@ndif-team.bsky.social
The National Deep Inference Fabric, an NSF-funded computational infrastructure to enable research on large-scale Artificial Intelligence.
🔗 NDIF: https://ndif.us
🧰 NNsight API: https://nnsight.net
😸 GitHub: https://github.com/ndif-team/nnsight
🔗 NDIF: https://ndif.us
🧰 NNsight API: https://nnsight.net
😸 GitHub: https://github.com/ndif-team/nnsight
Reposted by NDIF Team
What does an LLM do when it translates from Italian "amore" to Spanish "amor" or French "amour"?
That's easy! (you might think) Because surely it knows: amore, amor, amour are all based on the same Latin word. It can just drop the "e", or add a "u".
That's easy! (you might think) Because surely it knows: amore, amor, amour are all based on the same Latin word. It can just drop the "e", or add a "u".
October 11, 2025 at 12:02 PM
What does an LLM do when it translates from Italian "amore" to Spanish "amor" or French "amour"?
That's easy! (you might think) Because surely it knows: amore, amor, amour are all based on the same Latin word. It can just drop the "e", or add a "u".
That's easy! (you might think) Because surely it knows: amore, amor, amour are all based on the same Latin word. It can just drop the "e", or add a "u".
Reposted by NDIF Team
Making model internals accessible to domain experts in low-code interfaces will unlock the next step in making interpretability useful across a variety of domains. Very excited about the NDIF Workbench! 💡
Ever wished you could explore what's happening inside a 405B parameter model without writing any code? Workbench, our AI interpretability interface, is now live for public beta at workbench.ndif.us!
October 10, 2025 at 5:53 PM
Making model internals accessible to domain experts in low-code interfaces will unlock the next step in making interpretability useful across a variety of domains. Very excited about the NDIF Workbench! 💡
Ever wished you could explore what's happening inside a 405B parameter model without writing any code? Workbench, our AI interpretability interface, is now live for public beta at workbench.ndif.us!
October 10, 2025 at 5:35 PM
Ever wished you could explore what's happening inside a 405B parameter model without writing any code? Workbench, our AI interpretability interface, is now live for public beta at workbench.ndif.us!
New YouTube video posted! @wendlerc.bsky.social presents his work using SAEs for diffusion text-to-image models. The authors find interpretable SAE features and demonstrate how these features can alter generated images.
Watch here: youtu.be/43NnaqGjArA
Watch here: youtu.be/43NnaqGjArA
Interpreting SDXL Turbo Using Sparse Autoencoders with Chris Wendler
In this talk, Chris Wendler presents his recent work on using sparse autoencoders for diffusion models. In this work, they train SAEs on SDXL Turbo, finding ...
www.youtube.com
October 3, 2025 at 6:45 PM
New YouTube video posted! @wendlerc.bsky.social presents his work using SAEs for diffusion text-to-image models. The authors find interpretable SAE features and demonstrate how these features can alter generated images.
Watch here: youtu.be/43NnaqGjArA
Watch here: youtu.be/43NnaqGjArA
Reminder that today is the deadline to apply for our hot-swapping program! Be the first to test out many new models remotely on NDIF and submit your application today!
More details: ndif.us/hotswap.html
Application link: forms.gle/KHVkYxybmK12...
More details: ndif.us/hotswap.html
Application link: forms.gle/KHVkYxybmK12...
NSF National Deep Inference Fabric
NDIF is a research computing project that enables researchers and students to crack open the mysteries inside large-scale AI systems.
ndif.us
October 1, 2025 at 6:10 PM
Reminder that today is the deadline to apply for our hot-swapping program! Be the first to test out many new models remotely on NDIF and submit your application today!
More details: ndif.us/hotswap.html
Application link: forms.gle/KHVkYxybmK12...
More details: ndif.us/hotswap.html
Application link: forms.gle/KHVkYxybmK12...
Want increased remote model availability on NDIF? Interested in studying model checkpoints?
Sign up for the NDIF hot-swapping pilot by October 1st: forms.gle/Cf4WF3xiNzud...
Sign up for the NDIF hot-swapping pilot by October 1st: forms.gle/Cf4WF3xiNzud...
September 26, 2025 at 6:57 PM
Want increased remote model availability on NDIF? Interested in studying model checkpoints?
Sign up for the NDIF hot-swapping pilot by October 1st: forms.gle/Cf4WF3xiNzud...
Sign up for the NDIF hot-swapping pilot by October 1st: forms.gle/Cf4WF3xiNzud...
Do you wish you could run experiments on any model remotely from your laptop? In a future release, NDIF users will be able to dynamically deploy any model from HuggingFace on NDIF for remote experimentation. But before this, we need your help!
September 4, 2025 at 12:41 AM
Do you wish you could run experiments on any model remotely from your laptop? In a future release, NDIF users will be able to dynamically deploy any model from HuggingFace on NDIF for remote experimentation. But before this, we need your help!
Reposted by NDIF Team
This Friday NEMI 2025 is at Northeastern in Boston, 8 talks, 24 roundtables, 90 posters; 200+ attendees. Thanks to
goodfire.ai/ for sponsoring! nemiconf.github.io/summer25/
If you can't make it in person, the livestream will be here:
www.youtube.com/live/4BJBis...
goodfire.ai/ for sponsoring! nemiconf.github.io/summer25/
If you can't make it in person, the livestream will be here:
www.youtube.com/live/4BJBis...
New England Mechanistic Interpretability Workshop
About:The New England Mechanistic Interpretability (NEMI) workshop aims to bring together academic and industry researchers from the New England and surround...
www.youtube.com
August 18, 2025 at 6:06 PM
This Friday NEMI 2025 is at Northeastern in Boston, 8 talks, 24 roundtables, 90 posters; 200+ attendees. Thanks to
goodfire.ai/ for sponsoring! nemiconf.github.io/summer25/
If you can't make it in person, the livestream will be here:
www.youtube.com/live/4BJBis...
goodfire.ai/ for sponsoring! nemiconf.github.io/summer25/
If you can't make it in person, the livestream will be here:
www.youtube.com/live/4BJBis...
Reposted by NDIF Team
Announcing a deep net interpretability talk series!
Every week you will find new talks on recent research in the science of neural networks. The first few are posted: jackmerullo.bsky.social, Roy Rinberg, and me.
At the @ndif-team.bsky.social Youtube Channel: www.youtube.com/@NDIFTeam
Every week you will find new talks on recent research in the science of neural networks. The first few are posted: jackmerullo.bsky.social, Roy Rinberg, and me.
At the @ndif-team.bsky.social Youtube Channel: www.youtube.com/@NDIFTeam
NDIF Team
We're a research computing project cracking open the mysteries inside large-scale AI systems.
The NSF National Deep Inference Fabric consists of a unique combination of hardware and software that provides a remotely-accessible computing resource for scientists and students to perform detailed and reproducible experiments on large pretrained AI models, such as open large language models.
We aim to make AI interpretability research more accessible through this channel by publishing lectures and educational content covering real interpretability research.
www.youtube.com
August 18, 2025 at 6:02 PM
Announcing a deep net interpretability talk series!
Every week you will find new talks on recent research in the science of neural networks. The first few are posted: jackmerullo.bsky.social, Roy Rinberg, and me.
At the @ndif-team.bsky.social Youtube Channel: www.youtube.com/@NDIFTeam
Every week you will find new talks on recent research in the science of neural networks. The first few are posted: jackmerullo.bsky.social, Roy Rinberg, and me.
At the @ndif-team.bsky.social Youtube Channel: www.youtube.com/@NDIFTeam
Our YouTube channel is live! Our first video features @davidbau.bsky.social presenting the ROME project:
www.youtube.com/watch?v=eKd...
www.youtube.com/watch?v=eKd...
ROME: Locating and Editing Factual Associations in GPT with David Bau
David Bau is an Assistant Professor of Computer Science at Northeastern University's Khoury College. His lab studies the structure and interpretation of deep...
www.youtube.com
August 7, 2025 at 5:36 PM
Our YouTube channel is live! Our first video features @davidbau.bsky.social presenting the ROME project:
www.youtube.com/watch?v=eKd...
www.youtube.com/watch?v=eKd...
Induction heads are attention heads that help complete patterns by copying tokens (transformer-circuits.pub/2021/framew...), but can they also copy over concepts?
August 5, 2025 at 4:31 PM
Induction heads are attention heads that help complete patterns by copying tokens (transformer-circuits.pub/2021/framew...), but can they also copy over concepts?
Great to present what’s coming next for NDIF at the @actinterp.bsky.social workshop at #ICML2025!
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
July 19, 2025 at 7:54 PM
Great to present what’s coming next for NDIF at the @actinterp.bsky.social workshop at #ICML2025!
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
We’re excited to announce a new series of applied "mini paper" tutorials! The goal of this series is to help researchers get hands-on experience with findings, methods, and results from recent papers in interpretability using NNsight and NDIF.
July 16, 2025 at 7:41 PM
We’re excited to announce a new series of applied "mini paper" tutorials! The goal of this series is to help researchers get hands-on experience with findings, methods, and results from recent papers in interpretability using NNsight and NDIF.
Excited to share our first paper replication tutorial, walking you through the main figures from "Do Language Models Use Their Depth Efficiently?" by @robertcsordas.bsky.social
🔎 Demo on Colab: colab.research.google.com/github/ndif-...
📖 Read the full manuscript: arxiv.org/abs/2505.13898
🔎 Demo on Colab: colab.research.google.com/github/ndif-...
📖 Read the full manuscript: arxiv.org/abs/2505.13898
Google Colab
colab.research.google.com
July 4, 2025 at 12:27 AM
Excited to share our first paper replication tutorial, walking you through the main figures from "Do Language Models Use Their Depth Efficiently?" by @robertcsordas.bsky.social
🔎 Demo on Colab: colab.research.google.com/github/ndif-...
📖 Read the full manuscript: arxiv.org/abs/2505.13898
🔎 Demo on Colab: colab.research.google.com/github/ndif-...
📖 Read the full manuscript: arxiv.org/abs/2505.13898
We are prereleasing NNsight 0.5 today! We've added many highly-requested new features, including easier access to intermediate values within the forward pass, ability to run any code within NNsight’s tracing context (no more proxies!), and easier debugging.
June 20, 2025 at 9:09 PM
We are prereleasing NNsight 0.5 today! We've added many highly-requested new features, including easier access to intermediate values within the forward pass, ability to run any code within NNsight’s tracing context (no more proxies!), and easier debugging.
Are you interested in researching diffusion models in NNsight? We've released our first non-LLM tutorial, which covers the Diffusion Lens technique!
May 22, 2025 at 6:22 PM
Are you interested in researching diffusion models in NNsight? We've released our first non-LLM tutorial, which covers the Diffusion Lens technique!
At #ICLR2025 in Singapore? Come visit our poster tomorrow (Saturday, April 26th)! This work addresses a critical gap in ML research: the ability to study the internals of very large neural networks.
April 25, 2025 at 6:03 PM
At #ICLR2025 in Singapore? Come visit our poster tomorrow (Saturday, April 26th)! This work addresses a critical gap in ML research: the ability to study the internals of very large neural networks.
Reposted by NDIF Team
What will be the linchpin for AI dominance?
Read our NSF/OSTP recommendations written with Goodfire's Tom McGrath tommcgrath.github.io, Transluce's Sarah Schwettmann cogconfluence.com, MIT's Dylan Hadfield-Menell @dhadfieldmenell.bsky.social
TLDR; Dominance comes from **interpretability** 🧵 ↘️
Read our NSF/OSTP recommendations written with Goodfire's Tom McGrath tommcgrath.github.io, Transluce's Sarah Schwettmann cogconfluence.com, MIT's Dylan Hadfield-Menell @dhadfieldmenell.bsky.social
TLDR; Dominance comes from **interpretability** 🧵 ↘️
March 16, 2025 at 1:57 PM
What will be the linchpin for AI dominance?
Read our NSF/OSTP recommendations written with Goodfire's Tom McGrath tommcgrath.github.io, Transluce's Sarah Schwettmann cogconfluence.com, MIT's Dylan Hadfield-Menell @dhadfieldmenell.bsky.social
TLDR; Dominance comes from **interpretability** 🧵 ↘️
Read our NSF/OSTP recommendations written with Goodfire's Tom McGrath tommcgrath.github.io, Transluce's Sarah Schwettmann cogconfluence.com, MIT's Dylan Hadfield-Menell @dhadfieldmenell.bsky.social
TLDR; Dominance comes from **interpretability** 🧵 ↘️
Please help amplify ARBOR, a fantastic new research opportunity! If you’d like to start contributing, NDIF is now hosting DeepSeek R1 8B and 70B, open for all researchers to experiment on via our API.
Sign up for API access here: login.ndif.us
Sign up for API access here: login.ndif.us
February 20, 2025 at 10:35 PM
Please help amplify ARBOR, a fantastic new research opportunity! If you’d like to start contributing, NDIF is now hosting DeepSeek R1 8B and 70B, open for all researchers to experiment on via our API.
Sign up for API access here: login.ndif.us
Sign up for API access here: login.ndif.us
Reposted by NDIF Team
Today we're launching a multi-lab open collaboration, the ARBOR project, to accelerate AI interpretability research for reasoning models. Please join us!
github.com/ARBORproject...
(ARBOR = Analysis of Reasoning Behavior through Open Research)
github.com/ARBORproject...
(ARBOR = Analysis of Reasoning Behavior through Open Research)
GitHub - ARBORproject/arborproject.github.io
Contribute to ARBORproject/arborproject.github.io development by creating an account on GitHub.
github.com
February 20, 2025 at 7:55 PM
Today we're launching a multi-lab open collaboration, the ARBOR project, to accelerate AI interpretability research for reasoning models. Please join us!
github.com/ARBORproject...
(ARBOR = Analysis of Reasoning Behavior through Open Research)
github.com/ARBORproject...
(ARBOR = Analysis of Reasoning Behavior through Open Research)
Reposted by NDIF Team
Announcing ARBOR, an open research community for collectively understanding how reasoning models like openai-o3 and deepseek-r1 work. We invite all researchers and enthusiasts to this initiative by @wattenberg.bsky.social's and @davidbau.bsky.social's lab.
arborproject.github.io
arborproject.github.io
February 20, 2025 at 7:55 PM
Announcing ARBOR, an open research community for collectively understanding how reasoning models like openai-o3 and deepseek-r1 work. We invite all researchers and enthusiasts to this initiative by @wattenberg.bsky.social's and @davidbau.bsky.social's lab.
arborproject.github.io
arborproject.github.io
The application deadline for our summer engineering fellowship is tomorrow! Don't forget to apply here: ndif.us/fellowship.h...
Calling all students looking for summer opportunities! Apply to our Summer Engineering Fellowship today: ndif.us/fellowship.h...
February 6, 2025 at 9:11 PM
The application deadline for our summer engineering fellowship is tomorrow! Don't forget to apply here: ndif.us/fellowship.h...
New version alert! We've officially released NNsight 0.4, which you can now install with pip.
If you haven’t yet tried out NNsight 0.4, here’s what’s new:
If you haven’t yet tried out NNsight 0.4, here’s what’s new:
February 3, 2025 at 1:41 PM
New version alert! We've officially released NNsight 0.4, which you can now install with pip.
If you haven’t yet tried out NNsight 0.4, here’s what’s new:
If you haven’t yet tried out NNsight 0.4, here’s what’s new: