Danny Wood
banner
echostatements.bsky.social
Danny Wood
@echostatements.bsky.social
AI Research Scientist || PhD in machine learning || Ensembles, probabilistic machine learning, recurrent neural networks || https://echostatements.github.io
Pinned
Siamese neural networks are a neat way of doing one-shot/few-shot classification but there's something about the way they're usually implemented that felt a bit inefficient to me

Here are a couple of relatively simple tricks you can do to speed up training Siamese networks by 2.5x! 1/9 🧵
Suddenly, the explanation in Solo for how Han Solo got his full name doesn't seem quite so far-fetched
November 25, 2025 at 5:20 PM
New tragedy of the commons just dropped

www.bbc.com/news/article...
'No-phone rave went well until people broke rules'
People at Warehouse-project's phone-free event couldn't keep off their mobiles, one raver says.
www.bbc.com
November 16, 2025 at 9:51 AM
This result was one of the foundational ideas built upon by what has since become by far my most cited paper, so I'm really happy to see a version on arXiv where it can hopefully be preserved for posterity
November 13, 2025 at 10:59 PM
Reposted by Danny Wood
I published a new post on my rarely updated personal blog! It's a sequel of sorts to my Quanta coverage of the Busy Beaver game, focusing on a particularly fearsome Turing machine known by the awesome name Antihydra.
Why Busy Beaver Hunters Fear the Antihydra
In which I explore the biggest barrier in the busy beaver game. What is Antihydra, what is the Collatz conjecture, how are they connected, and what makes them so daunting?
benbrubaker.com
October 27, 2025 at 4:04 PM
I'm a big fan of when counterexamples to intuitive sounding theorems are so convoluted that outside of mathematics, the kind of rules-lawyering needed to construct them would be considered pedantic or even rude

youtu.be/pLgcZLysOFk?...
The Most Obvious Theorem in All of Mathematics
YouTube video by Metamorphic
youtu.be
October 26, 2025 at 1:39 PM
How do you make Minecraft spherical? A really fun read about all the problem solving that goes into transferring Minecraft gameplay onto a spherical world

www.bowerbyte.com/posts/blocky...
Blocky Planet — Making Minecraft Spherical
Discover the unique design challenges of creating a spherical planet out of Minecraft-like blocks.
www.bowerbyte.com
October 21, 2025 at 7:35 PM
Really nice primer on double-descent and the bias-variance trade-off

I'm impressed by the depth that Welch Labs consistently manages to pack into their videos without sacrificing the storytelling for a popular science audience

www.youtube.com/watch?v=z64a...
What the Books Get Wrong about AI [Double Descent]
YouTube video by Welch Labs
www.youtube.com
October 20, 2025 at 9:16 AM
Since @spmontecarlo.bsky.social shared a post about Crinkled Arcs a couple of weeks ago, I've spent a fair bit of time digging into them

This new blog post attempts to collect what I found into an interactive introduction to crinkled arcs and their relationship to Brownian Motion
Crinkled Arcs And Brownian Motion
A crinkled arc is a continuous curve that appears as if it is making right-angle turns at every point along its trajectory. Additionally, if you draw a straight line between two recent points and comp...
echostatements.github.io
October 14, 2025 at 11:25 AM
A surprisingly intuitive and practical use for limit ordinals (assuming you have an infinite chess board handy)

youtu.be/CQ4Ap5itTX4?...
Mate-in-Omega, The Great Phenomenon of Infinite Chess
YouTube video by Naviary
youtu.be
October 11, 2025 at 4:07 PM
Reposted by Danny Wood
“Everyone knows” what an autoencoder is… but there's an important complementary picture missing from most introductory material.

In short: we emphasize how autoencoders are implemented—but not always what they represent (and some of the implications of that representation).🧵
September 6, 2025 at 9:20 PM
Reposted by Danny Wood
Does anyone have a good reference for paradoxes in set theory? I'm looking for something self-contained.
August 14, 2025 at 2:01 PM
Looking at the code in Hugging Face's library for the new GPT models, I was a bit disappointed by how similar they are to Llama & Mistral models, but there is one cool trick I hadn't seen before: attention sinks. These are a mechanism by which attention heads can say "I don't have anything to add"
August 7, 2025 at 4:29 PM
A little etymological fact that I like is that "lemma" and "dilemma" are from the same ancient Greek origin

If you translate "lemma" as meaning a proposition, a dilemma is literally having two propositions to consider
July 22, 2025 at 12:59 PM
Siamese neural networks are a neat way of doing one-shot/few-shot classification but there's something about the way they're usually implemented that felt a bit inefficient to me

Here are a couple of relatively simple tricks you can do to speed up training Siamese networks by 2.5x! 1/9 🧵
July 18, 2025 at 12:17 PM
Reposted by Danny Wood
Aleatoric and epistemic uncertainty are clear-cut concepts, right? ... right? 😵‍💫 In our new ICLR blogpost we let different schools of thought speak and contradict each other, and revisit chatbots where “the character of aleatory ‘transforms’ into epistemic” iclr-blogposts.github.io/2025/blog/re...
May 8, 2025 at 8:18 AM
I would never have guessed it was even possible to make things this beautiful in matplotlib
April 4, 2025 at 9:31 AM