Stella Biderman
@stellaathena.bsky.social
I make sure that OpenAI et al. aren't the only people who are able to study large scale AI systems.
Has anyone else had Claude code become non-functional recently? Even with a test input it spins for minutes without doing anything. Same thing happens in terminal.
February 7, 2026 at 4:40 PM
Has anyone else had Claude code become non-functional recently? Even with a test input it spins for minutes without doing anything. Same thing happens in terminal.
Reposted by Stella Biderman
And the next talk (exact details TBA) by @pjox.bsky.social and @very-laurie.bsky.social from Common Crawl on work we've been collaborating on to build better benchmarking of LangID systems and understand the issues with the long tail of human language that comes up at Common Crawl scales.
January 9, 2026 at 12:56 AM
And the next talk (exact details TBA) by @pjox.bsky.social and @very-laurie.bsky.social from Common Crawl on work we've been collaborating on to build better benchmarking of LangID systems and understand the issues with the long tail of human language that comes up at Common Crawl scales.
Reposted by Stella Biderman
We’re bringing back a Community Spotlight talk series, highlighting cool work being done by members of our community. We’re kicking it off with a talk on running diffusion-based world-models in real time on consumer hardware.
Jan 9th at 2 pm US Eastern Time
Jan 9th at 2 pm US Eastern Time
January 9, 2026 at 12:56 AM
We’re bringing back a Community Spotlight talk series, highlighting cool work being done by members of our community. We’re kicking it off with a talk on running diffusion-based world-models in real time on consumer hardware.
Jan 9th at 2 pm US Eastern Time
Jan 9th at 2 pm US Eastern Time
What are people's favorite paper / project websites? I'm looking to build a library to base future ones I make off of.
The one EleutherAI has done that I'm proudest of is deepignorance.ai
The one EleutherAI has done that I'm proudest of is deepignorance.ai
Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards
Filtering pretraining data prevents dangerous capabilities, doesn’t sacrifice general performance, and results in models that are resistant to tampering.
deepignorance.ai
January 6, 2026 at 8:15 PM
What are people's favorite paper / project websites? I'm looking to build a library to base future ones I make off of.
The one EleutherAI has done that I'm proudest of is deepignorance.ai
The one EleutherAI has done that I'm proudest of is deepignorance.ai
If you're looking for the 60 minutes piece on CECOT that Bari Weiss canned to protect the President, you can find it here: archive.org/details/60-m...
60 Minutes Inside CECOT : Free Download, Borrow, and Streaming : Internet Archive
Full video of the 60 Minutes Inside CECOT episode that CBS pulled.
archive.org
December 23, 2025 at 4:02 AM
If you're looking for the 60 minutes piece on CECOT that Bari Weiss canned to protect the President, you can find it here: archive.org/details/60-m...
Incredibly proud of my friend and colleague @storytracer.com. Two weeks ago he and his cofounders @sucho-org.bsky.social were honored for organizing a global network of volunteers to exfiltrate and back up endangered Ukrainian cultural heritage in the wake of the invasion by Russia.
December 19, 2025 at 7:51 PM
Incredibly proud of my friend and colleague @storytracer.com. Two weeks ago he and his cofounders @sucho-org.bsky.social were honored for organizing a global network of volunteers to exfiltrate and back up endangered Ukrainian cultural heritage in the wake of the invasion by Russia.
Really great to see NVIDIA staking out a pro-open data position. This used to be common, if not the norm in AI, and the backing away from this level of transparency has done a lot of harm to the research community.
Nemotron 3
A new hybrid mamba2/attention LLM from NVIDIA that beats Qwen3-30B-A3B (same size & shape)
Notes:
* 1M context, with incredible recall past 256K
* New open datasets
* 10 open source RL environments
Overall this is a huge win for neolabs
huggingface.co/nvidia/NVIDI...
A new hybrid mamba2/attention LLM from NVIDIA that beats Qwen3-30B-A3B (same size & shape)
Notes:
* 1M context, with incredible recall past 256K
* New open datasets
* 10 open source RL environments
Overall this is a huge win for neolabs
huggingface.co/nvidia/NVIDI...
December 16, 2025 at 7:32 PM
Really great to see NVIDIA staking out a pro-open data position. This used to be common, if not the norm in AI, and the backing away from this level of transparency has done a lot of harm to the research community.
Reposted by Stella Biderman
Compare the statement about the antisemitic terror attack in Australia by the Israeli Prime Minister with the one by Zohran Mamdani, and ask yourself who more truly cares about condemning antisemitism, as opposed to using it to promote unrelated politics.
December 14, 2025 at 4:45 PM
Compare the statement about the antisemitic terror attack in Australia by the Israeli Prime Minister with the one by Zohran Mamdani, and ask yourself who more truly cares about condemning antisemitism, as opposed to using it to promote unrelated politics.
"The incentives made me do it" is an excuse, not a justification. You can be better than that, and if you're not it's because you choose to not be.
December 14, 2025 at 8:54 PM
"The incentives made me do it" is an excuse, not a justification. You can be better than that, and if you're not it's because you choose to not be.
Reposted by Stella Biderman
It's a wrap on EvalEval in San Diego! A jam packed day of learning, making new friends, critically examining the field of evals, and walking away with renewed energy and new collaborations!
We have a lot of announcements coming, but first: EvalEval will be back for #ACL2026!
We have a lot of announcements coming, but first: EvalEval will be back for #ACL2026!
December 10, 2025 at 10:56 PM
It's a wrap on EvalEval in San Diego! A jam packed day of learning, making new friends, critically examining the field of evals, and walking away with renewed energy and new collaborations!
We have a lot of announcements coming, but first: EvalEval will be back for #ACL2026!
We have a lot of announcements coming, but first: EvalEval will be back for #ACL2026!
In 2023-ish it was trendy to write papers trying to explain why scaling laws had power law structures. The papers I remember were pretty unconvincing. Did anything meaningful come of this work? What does the best work in this vein look like?
November 29, 2025 at 4:36 PM
In 2023-ish it was trendy to write papers trying to explain why scaling laws had power law structures. The papers I remember were pretty unconvincing. Did anything meaningful come of this work? What does the best work in this vein look like?
Put this person in jail.
Put the person who drafted it in jail.
Put the higher ups who covered it up in jail.
This is a crime. If Kilmar had done the same they wouldn't hesitate to punish him. ICE is a criminal organization, not a law enforcement organization, and justice requires accountability.
Put the person who drafted it in jail.
Put the higher ups who covered it up in jail.
This is a crime. If Kilmar had done the same they wouldn't hesitate to punish him. ICE is a criminal organization, not a law enforcement organization, and justice requires accountability.
A senior ICE official just admitted in an evidentiary hearing in Kilmar Abrego Garcia’s case that someone else drafted his declaration in the case and he didn’t know what certain words meant.
November 20, 2025 at 6:44 PM
Put this person in jail.
Put the person who drafted it in jail.
Put the higher ups who covered it up in jail.
This is a crime. If Kilmar had done the same they wouldn't hesitate to punish him. ICE is a criminal organization, not a law enforcement organization, and justice requires accountability.
Put the person who drafted it in jail.
Put the higher ups who covered it up in jail.
This is a crime. If Kilmar had done the same they wouldn't hesitate to punish him. ICE is a criminal organization, not a law enforcement organization, and justice requires accountability.
Hyped to write "The models in this paper cost us 476,246.57 USD to train. I'm sorry you are sad we didn't redo all of our experiments on multiple independent training datasets. If you'd like to give us a million dollars we'd be happy to run the experiments you wish" in my response to a reviewer.
November 14, 2025 at 11:07 PM
Hyped to write "The models in this paper cost us 476,246.57 USD to train. I'm sorry you are sad we didn't redo all of our experiments on multiple independent training datasets. If you'd like to give us a million dollars we'd be happy to run the experiments you wish" in my response to a reviewer.
Reposted by Stella Biderman
🚨 AI keeps scaling, but social impact evaluations aren’t–and the data proves it 🚨
Our new paper, 📎“Who Evaluates AI’s Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations,” analyzes hundreds of evaluation reports and reveals major blind spots ‼️🧵 (1/7)
Our new paper, 📎“Who Evaluates AI’s Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations,” analyzes hundreds of evaluation reports and reveals major blind spots ‼️🧵 (1/7)
November 13, 2025 at 1:59 PM
🚨 AI keeps scaling, but social impact evaluations aren’t–and the data proves it 🚨
Our new paper, 📎“Who Evaluates AI’s Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations,” analyzes hundreds of evaluation reports and reveals major blind spots ‼️🧵 (1/7)
Our new paper, 📎“Who Evaluates AI’s Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations,” analyzes hundreds of evaluation reports and reveals major blind spots ‼️🧵 (1/7)
Reposted by Stella Biderman
Our #NeurIPS2025 paper shows that even comparable monolingual tokenizers have different compression rates across languages. But by getting rid of whitespace tokenization and using a custom vocab size for each language, we can reduce token premiums. Preprint out now!
October 28, 2025 at 3:11 PM
Our #NeurIPS2025 paper shows that even comparable monolingual tokenizers have different compression rates across languages. But by getting rid of whitespace tokenization and using a custom vocab size for each language, we can reduce token premiums. Preprint out now!
I feel like there are several blog posts or papers that put forth a research agenda of "making AI research a scientific field" or "advancing the science of AI" or something like that. I'm trouble finding them, does this ring a bell to anyone / does anyone have links to notable examples?
October 3, 2025 at 4:00 PM
I feel like there are several blog posts or papers that put forth a research agenda of "making AI research a scientific field" or "advancing the science of AI" or something like that. I'm trouble finding them, does this ring a bell to anyone / does anyone have links to notable examples?
Reposted by Stella Biderman
I want to print it out giant and put it everywhere
September 18, 2025 at 12:05 AM
I want to print it out giant and put it everywhere
The new “teen safety” program from OpenAI repeats the same lies that companies and governments have been saying since the internet began. This won't achieve better online safety for kids, but it will suppress individual liberty and promote censorship.
openai.com/index/buildi...
openai.com/index/buildi...
Building towards age prediction
Learn how OpenAI is building age prediction and parental controls in ChatGPT to create safer, age-appropriate experiences for teens while supporting families with new tools.
openai.com
September 18, 2025 at 12:40 AM
The new “teen safety” program from OpenAI repeats the same lies that companies and governments have been saying since the internet began. This won't achieve better online safety for kids, but it will suppress individual liberty and promote censorship.
openai.com/index/buildi...
openai.com/index/buildi...
Reposted by Stella Biderman
the *cato* institute says less than 10% of politically motivated terrorism is caused by leftists. the *cato* institute.
more than two-thirds is from the far-right.
more than two-thirds is from the far-right.
September 17, 2025 at 5:07 PM
the *cato* institute says less than 10% of politically motivated terrorism is caused by leftists. the *cato* institute.
more than two-thirds is from the far-right.
more than two-thirds is from the far-right.
Reposted by Stella Biderman
How can an imitative model like an LLM outperform the experts it is trained on? Our new COLM paper outlines three types of transcendence and shows that each one relies on a different aspect of data diversity. arxiv.org/abs/2508.17669
August 29, 2025 at 9:46 PM
How can an imitative model like an LLM outperform the experts it is trained on? Our new COLM paper outlines three types of transcendence and shows that each one relies on a different aspect of data diversity. arxiv.org/abs/2508.17669
How did you learn to present code? Are there resources that you recommend using to help teach people?
August 27, 2025 at 6:02 PM
How did you learn to present code? Are there resources that you recommend using to help teach people?
Reposted by Stella Biderman
On Thursday we will be joining the #UCLA Latino Policy & Politics Institute for their demo of the newly updated Latino Data Hub (LDH), a public bilingual data platform built to democratize access to critical data about #Latino communities across the country. Register here:
Welcome! You are invited to join a webinar: Exploring the 2025 Latino Data Hub Updates. After registering, you will receive a confirmation email about joining the webinar.
At a time when federal data systems are being defunded, decommissioned, or delayed, public access to reliable, community-level information has never been more critical. Join the UCLA Latino Policy…
ucla.in
August 25, 2025 at 8:01 PM
Reposted by Stella Biderman
Here are a couple of slides that I presented yesterday at #aitechgov about open-weight model risk management.
August 17, 2025 at 10:40 AM
Here are a couple of slides that I presented yesterday at #aitechgov about open-weight model risk management.
Reposted by Stella Biderman
Thanks to @stellaathena.bsky.social for chatting with me about Deep Ignorance: the new paper/project from Eleuther AI and the UK AISI. Bottom line: Worried AI could teach people to build bioweapons? Don’t teach it how
fortune.com/2025/08/14/w...
fortune.com/2025/08/14/w...
AI safety tip: if you don’t want it giving bioweapon instructions, maybe don’t put them in the training data, say researchers
New research shows that scrubbing risky material from AI training data can build safeguards that are harder to bypass — and one author calls out tech giants for keeping such work under wraps.
fortune.com
August 15, 2025 at 3:33 AM
Thanks to @stellaathena.bsky.social for chatting with me about Deep Ignorance: the new paper/project from Eleuther AI and the UK AISI. Bottom line: Worried AI could teach people to build bioweapons? Don’t teach it how
fortune.com/2025/08/14/w...
fortune.com/2025/08/14/w...
Reposted by Stella Biderman
“Your driver's license contains a ton of somewhat immutable information about you” like your name, address, DOB, and face, EFF’s Lisa Femia told the @thetennesean.bsky.social. It's not like a credit card number that can be replaced if it's leaked.
Age verification laws are sweeping the US, changing the future of online speech
Age verification laws have been passed in at least 24 states. Some say it’s an effort to protect kids, while others say it restricts protected speech.
www.tennessean.com
August 14, 2025 at 9:16 PM
“Your driver's license contains a ton of somewhat immutable information about you” like your name, address, DOB, and face, EFF’s Lisa Femia told the @thetennesean.bsky.social. It's not like a credit card number that can be replaced if it's leaked.