NDIF Team
@ndif-team.bsky.social
The National Deep Inference Fabric, an NSF-funded computational infrastructure to enable research on large-scale Artificial Intelligence.
🔗 NDIF: https://ndif.us
🧰 NNsight API: https://nnsight.net
😸 GitHub: https://github.com/ndif-team/nnsight
🔗 NDIF: https://ndif.us
🧰 NNsight API: https://nnsight.net
😸 GitHub: https://github.com/ndif-team/nnsight
Ever wished you could explore what's happening inside a 405B parameter model without writing any code? Workbench, our AI interpretability interface, is now live for public beta at workbench.ndif.us!
October 10, 2025 at 5:35 PM
Ever wished you could explore what's happening inside a 405B parameter model without writing any code? Workbench, our AI interpretability interface, is now live for public beta at workbench.ndif.us!
Read the paper or play around with some demos on the project website!
ArXiv: arxiv.org/abs/2410.22366
Project Website: sdxl-unbox.epfl.ch/
ArXiv: arxiv.org/abs/2410.22366
Project Website: sdxl-unbox.epfl.ch/
October 3, 2025 at 6:45 PM
Read the paper or play around with some demos on the project website!
ArXiv: arxiv.org/abs/2410.22366
Project Website: sdxl-unbox.epfl.ch/
ArXiv: arxiv.org/abs/2410.22366
Project Website: sdxl-unbox.epfl.ch/
Using causal mediation analysis on words that span multiple tokens, @sfeucht.bsky.social et al. found concept induction heads that are separate from token induction heads.
🔗 dualroute.baulab.info/
🔗 dualroute.baulab.info/
August 5, 2025 at 4:31 PM
Using causal mediation analysis on words that span multiple tokens, @sfeucht.bsky.social et al. found concept induction heads that are separate from token induction heads.
🔗 dualroute.baulab.info/
🔗 dualroute.baulab.info/
Induction heads are attention heads that help complete patterns by copying tokens (transformer-circuits.pub/2021/framew...), but can they also copy over concepts?
August 5, 2025 at 4:31 PM
Induction heads are attention heads that help complete patterns by copying tokens (transformer-circuits.pub/2021/framew...), but can they also copy over concepts?
Great to present what’s coming next for NDIF at the @actinterp.bsky.social workshop at #ICML2025!
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
July 19, 2025 at 7:54 PM
Great to present what’s coming next for NDIF at the @actinterp.bsky.social workshop at #ICML2025!
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
If you missed us, let’s chat after the conference. Reach out here: forms.gle/LtTyYnkaxDyg...
We’re excited to announce a new series of applied "mini paper" tutorials! The goal of this series is to help researchers get hands-on experience with findings, methods, and results from recent papers in interpretability using NNsight and NDIF.
July 16, 2025 at 7:41 PM
We’re excited to announce a new series of applied "mini paper" tutorials! The goal of this series is to help researchers get hands-on experience with findings, methods, and results from recent papers in interpretability using NNsight and NDIF.
We are prereleasing NNsight 0.5 today! We've added many highly-requested new features, including easier access to intermediate values within the forward pass, ability to run any code within NNsight’s tracing context (no more proxies!), and easier debugging.
June 20, 2025 at 9:09 PM
We are prereleasing NNsight 0.5 today! We've added many highly-requested new features, including easier access to intermediate values within the forward pass, ability to run any code within NNsight’s tracing context (no more proxies!), and easier debugging.
At #ICLR2025 in Singapore? Come visit our poster tomorrow (Saturday, April 26th)! This work addresses a critical gap in ML research: the ability to study the internals of very large neural networks.
April 25, 2025 at 6:03 PM
At #ICLR2025 in Singapore? Come visit our poster tomorrow (Saturday, April 26th)! This work addresses a critical gap in ML research: the ability to study the internals of very large neural networks.
Note: NDIF's remotely-hosted models are now running on NNsight 0.4. You will need to update your NNsight version before running experiments remotely! 🎉
February 3, 2025 at 1:41 PM
Note: NDIF's remotely-hosted models are now running on NNsight 0.4. You will need to update your NNsight version before running experiments remotely! 🎉
🌊 Streaming: Locally access and manipulate values during remote execution using .local()
February 3, 2025 at 1:41 PM
🌊 Streaming: Locally access and manipulate values during remote execution using .local()
🔄 Multiple Token Generation: Apply interventions to all generated tokens with .all(), streamlining the multiple token generation process.
February 3, 2025 at 1:41 PM
🔄 Multiple Token Generation: Apply interventions to all generated tokens with .all(), streamlining the multiple token generation process.
📝 Syntax Updates: You can now use Python if statements and for loops during NNsight’s tracing context. Plus, no more need for .value calls!
February 3, 2025 at 1:41 PM
📝 Syntax Updates: You can now use Python if statements and for loops during NNsight’s tracing context. Plus, no more need for .value calls!
⚡ vLLM Support: Investigate models from the vLLM library with NNsight, making inference more efficient and scalable for real-world applications.
February 3, 2025 at 1:41 PM
⚡ vLLM Support: Investigate models from the vLLM library with NNsight, making inference more efficient and scalable for real-world applications.
New version alert! We've officially released NNsight 0.4, which you can now install with pip.
If you haven’t yet tried out NNsight 0.4, here’s what’s new:
If you haven’t yet tried out NNsight 0.4, here’s what’s new:
February 3, 2025 at 1:41 PM
New version alert! We've officially released NNsight 0.4, which you can now install with pip.
If you haven’t yet tried out NNsight 0.4, here’s what’s new:
If you haven’t yet tried out NNsight 0.4, here’s what’s new:
🔔 We have new features coming to #NNsight soon! NNsight 0.4 will be released on January 31st. Stay tuned and join our Discord for the latest updates: lnkd.in/eJkRGvGB.
👀 For a sneak peek at the new features, check out our walkthrough: colab.research.google.com/drive/1TtYi5...
👀 For a sneak peek at the new features, check out our walkthrough: colab.research.google.com/drive/1TtYi5...
January 23, 2025 at 10:09 PM
🔔 We have new features coming to #NNsight soon! NNsight 0.4 will be released on January 31st. Stay tuned and join our Discord for the latest updates: lnkd.in/eJkRGvGB.
👀 For a sneak peek at the new features, check out our walkthrough: colab.research.google.com/drive/1TtYi5...
👀 For a sneak peek at the new features, check out our walkthrough: colab.research.google.com/drive/1TtYi5...
Calling all students looking for summer opportunities! Apply to our Summer Engineering Fellowship today: ndif.us/fellowship.h...
January 21, 2025 at 4:46 PM
Calling all students looking for summer opportunities! Apply to our Summer Engineering Fellowship today: ndif.us/fellowship.h...
🚨 Reminder: Applications for NDIF’s 405b pilot program close on December 31st, 2024! Don’t miss your chance to run experiments on the world’s largest open-sourced model, Llama 405b. 🌍
We host the model, you do the science!
Apply: 👉 ndif.us/405b.html
We host the model, you do the science!
Apply: 👉 ndif.us/405b.html
December 27, 2024 at 3:32 PM
🚨 Reminder: Applications for NDIF’s 405b pilot program close on December 31st, 2024! Don’t miss your chance to run experiments on the world’s largest open-sourced model, Llama 405b. 🌍
We host the model, you do the science!
Apply: 👉 ndif.us/405b.html
We host the model, you do the science!
Apply: 👉 ndif.us/405b.html
We’re looking for researchers to help us test our system in exchange for free hosted access to Llama 405b weights through the NNsight API. You don’t have to worry about distributed systems, job scheduling, or GPU resources. It's as simple as setting 'remote = True':
December 20, 2024 at 7:49 PM
We’re looking for researchers to help us test our system in exchange for free hosted access to Llama 405b weights through the NNsight API. You don’t have to worry about distributed systems, job scheduling, or GPU resources. It's as simple as setting 'remote = True':
More big news! Applications are open for the NDIF Summer Engineering Fellowship—an opportunity to work on cutting-edge AI research infrastructure this summer in Boston! 🚀
December 10, 2024 at 9:59 PM
More big news! Applications are open for the NDIF Summer Engineering Fellowship—an opportunity to work on cutting-edge AI research infrastructure this summer in Boston! 🚀