Announcing 🔭Hubble, a suite of open-source LLMs to advance the study of memorization!

Pretrained 1B/8B param models, with controlled insertion of texts designed to emulate key memorization risks: copyright (e.g., book passages), privacy (e.g., synthetic biographies), and test set contamination

😃 Want strong LLM reasoning without breaking the bank? We explored just how cost-effectively RL can enhance reasoning using LoRA!

[1/9] Introducing Tina: A family of tiny reasoning models with strong performance at low cost, providing an accessible testbed for RL reasoning. 🧵

🔍 Diving deep into LLM reasoning?

From OpenAI's o-series to DeepSeek R1, from post-training to test-time compute — we break it down into structured spreadsheets. 🧵

Excited to release METAGENE-1, a 7B parameter metagenomic foundation model, built to aid in pathogen detection & pandemic monitoring. Pretrained on 1.5 trillion base pairs of DNA/RNA sequenced from wastewater.

A collab w/ USC, PrimeIntellect, & the Nucleic Acid Observatory.

metagene.ai

Entropy is one of those formulas that many of us learn, swallow whole, and even use regularly without really understanding.

(E.g., where does that “log” come from? Are there other possible formulas?)

Yet there's an intuitive & almost inevitable way to arrive at this expression.

hi everyone!! let's try this optimal transport again 🙃

Delighted to publish my new molecular animation:

DNA Break Repair by Homologous Recombination

youtu.be/Xe-83tBcxhs

Anne Gagneux, Ségolène Martin, @quentinbertrand.bsky.social Remi Emonet and I wrote a tutorial blog post on flow matching: dl.heeere.com/conditional-... with lots of illustrations and intuition!

We got this idea after their cool work on improving Plug and Play with FM: arxiv.org/abs/2410.02423

Thrilled to announce Boltz-1, the first open-source and commercially available model to achieve AlphaFold3-level accuracy on biomolecular structure prediction! An exciting collaboration with Jeremy, Saro, and an amazing team at MIT and Genesis Therapeutics. A thread!

We've made a starter pack for researchers/organizations working on open-source LLMS.

Please let us know if we missed you or if you'd like to be added!

go.bsky.app/FELkyDr

Since creating an API that can deliver crow facts via REST, I've delivered 3,250 crow facts as JSON. Get yours today:

curl facts.drugcrow.ai

explanation: diffuse.one/p/d1-004

Talk: Speculations on Test-Time Scaling

A tutorial on the technical aspects behind OpenAI's o1 and open research questions in this space.

youtu.be/6PEJ96k1kiw
Slides+bibliography: github.com/srush/awesom...

Trembling with excitement in announcing the first ever International Conference on Probabilistic Numerics! Probabilistic Numerics is about machine learning FOR numerical computation, like optimisation. 1st - 3rd September 2025, EURECOM, France, submissions due 5th March 2025. probnum25.github.io

Visualize infinite series! Here's a page I made a few years ago, letting you play with convergence and divergence.
www.bewitched.com/demo/taylor/...

trying to make a diagram of the cast of characters in the terminal and so far it's very chaotic

There are a lot of discussion on if "scaling is done," with stories from the Information saying that the latest GPT models aren't showing what OpenAI wanted while Sam Altman still parades around saying AGI is near. I wanted to explain why both of these can be true.

I'm making a list of AI for Science researchers on bluesky — let me know if I missed you / if you'd like to join!

go.bsky.app/AcP9Lix

Useful!