Mason Kamb
@masonkamb.bsky.social
Pinned
Mason Kamb
@masonkamb.bsky.social
· Dec 31
Excited to finally share this work w/ @suryaganguli.bsky.social Tl;dr: we find the first closed-form analytical theory that replicates the outputs of the very simplest diffusion models, with median pixel wise r^2 values of 90%+. arxiv.org/abs/2412.20292
Reposted by Mason Kamb
A great @quantamagazine.bsky.social article on our theory of creativity in convolutional diffusion models lead by @masonkamb.bsky.social See also our paper with new results in version 2: arxiv.org/abs/2412.20292 to be presented as an oral at @icmlconf.bsky.social #icml25
June 30, 2025 at 6:05 PM
A great @quantamagazine.bsky.social article on our theory of creativity in convolutional diffusion models lead by @masonkamb.bsky.social See also our paper with new results in version 2: arxiv.org/abs/2412.20292 to be presented as an oral at @icmlconf.bsky.social #icml25
Honored to have had my recent work with
@suryaganguli.bsky.social on the mechanisms behind creativity in diffusion models featured in this lovely article by
Webb Wright for Quanta magazine!
@suryaganguli.bsky.social on the mechanisms behind creativity in diffusion models featured in this lovely article by
Webb Wright for Quanta magazine!
A new paper shows that the “creativity” of certain AI may actually be a direct, inevitable consequence of how they are built. Webb Wright reports:
www.quantamagazine.org/researchers-...
www.quantamagazine.org/researchers-...
Researchers Uncover Hidden Ingredients Behind AI Creativity | Quanta Magazine
Image generators are designed to mimic their training data, so where does their apparent creativity come from? A recent study suggests that it’s an inevitable by-product of their architecture.
www.quantamagazine.org
June 30, 2025 at 4:20 PM
Honored to have had my recent work with
@suryaganguli.bsky.social on the mechanisms behind creativity in diffusion models featured in this lovely article by
Webb Wright for Quanta magazine!
@suryaganguli.bsky.social on the mechanisms behind creativity in diffusion models featured in this lovely article by
Webb Wright for Quanta magazine!
Reposted by Mason Kamb
NEW: Mason Kamb ( @masonkamb.bsky.social ) from @stanford.edu presents a predictive theory of combinatorial creativity in diffusion models.
Watch the video: youtu.be/DP_kGt0-2cg
#NeuroAI2025 #AI #ML #NeuroAI
Watch the video: youtu.be/DP_kGt0-2cg
#NeuroAI2025 #AI #ML #NeuroAI
An Analytic Theory of Creativity in Convolutional Diffusion Models with Mason Kamb
Mason Kamb from Stanford University joined the Frontiers of NeuroAI Symposium on June 6, 2025, to discuss "An Analytic Theory of Creativity in Convolutional ...
youtu.be
June 12, 2025 at 3:05 PM
NEW: Mason Kamb ( @masonkamb.bsky.social ) from @stanford.edu presents a predictive theory of combinatorial creativity in diffusion models.
Watch the video: youtu.be/DP_kGt0-2cg
#NeuroAI2025 #AI #ML #NeuroAI
Watch the video: youtu.be/DP_kGt0-2cg
#NeuroAI2025 #AI #ML #NeuroAI
Reposted by Mason Kamb
The DOGE etc. damage to US science will have enormous effects that will linger for decades. But they will be sufficiently gradual and diffuse that people who want to pretend the cause wasn't obvious will be able to do so.
We polled Nature readers to ask if they were thinking of leaving the US for jobs abroad. Three-quarters of them (who said they were US-based scientists) said yes. 🧪
www.nature.com/articles/d41...
www.nature.com/articles/d41...
75% of US scientists who answered Nature poll consider leaving
More than 1,600 readers answered our poll; many said they were looking for jobs in Europe and Canada.
www.nature.com
March 27, 2025 at 3:09 PM
The DOGE etc. damage to US science will have enormous effects that will linger for decades. But they will be sufficiently gradual and diffuse that people who want to pretend the cause wasn't obvious will be able to do so.
Reposted by Mason Kamb
In another blow to legacy media, I'm hearing that the Trump administration plans to remove The Atlantic from its war-plans group chat. The outlet will be replaced in the chat by the Gateway Pundit.
March 24, 2025 at 5:11 PM
In another blow to legacy media, I'm hearing that the Trump administration plans to remove The Atlantic from its war-plans group chat. The outlet will be replaced in the chat by the Gateway Pundit.
Reposted by Mason Kamb
real instructive that just by paying attention to the background hum of regular small plane crashes the media has created a perception of a sharp increase
February 19, 2025 at 6:57 PM
real instructive that just by paying attention to the background hum of regular small plane crashes the media has created a perception of a sharp increase
Reposted by Mason Kamb
Finally got to reading the fascinating & excellent paper by Kamb and Ganguli, which makes a significant contribution to diffusion/GenAI literature & will likely become one of the most-cited works in this space. Unlike many "theoretical" ML studies, theirs is high-dimensional and practical.. 1/n
Excited to finally share this work w/ @suryaganguli.bsky.social Tl;dr: we find the first closed-form analytical theory that replicates the outputs of the very simplest diffusion models, with median pixel wise r^2 values of 90%+. arxiv.org/abs/2412.20292
January 11, 2025 at 4:10 PM
Finally got to reading the fascinating & excellent paper by Kamb and Ganguli, which makes a significant contribution to diffusion/GenAI literature & will likely become one of the most-cited works in this space. Unlike many "theoretical" ML studies, theirs is high-dimensional and practical.. 1/n
Reposted by Mason Kamb
Our new paper! "Analytic theory of creativity in convolutional diffusion models" lead expertly by @masonkamb.bsky.social
arxiv.org/abs/2412.20292
Our closed-form theory needs no training, is mechanistically interpretable & accurately predicts diffusion model outputs with high median r^2~0.9
arxiv.org/abs/2412.20292
Our closed-form theory needs no training, is mechanistically interpretable & accurately predicts diffusion model outputs with high median r^2~0.9
December 31, 2024 at 4:54 PM
Our new paper! "Analytic theory of creativity in convolutional diffusion models" lead expertly by @masonkamb.bsky.social
arxiv.org/abs/2412.20292
Our closed-form theory needs no training, is mechanistically interpretable & accurately predicts diffusion model outputs with high median r^2~0.9
arxiv.org/abs/2412.20292
Our closed-form theory needs no training, is mechanistically interpretable & accurately predicts diffusion model outputs with high median r^2~0.9
Excited to finally share this work w/ @suryaganguli.bsky.social Tl;dr: we find the first closed-form analytical theory that replicates the outputs of the very simplest diffusion models, with median pixel wise r^2 values of 90%+. arxiv.org/abs/2412.20292
December 31, 2024 at 4:00 PM
Excited to finally share this work w/ @suryaganguli.bsky.social Tl;dr: we find the first closed-form analytical theory that replicates the outputs of the very simplest diffusion models, with median pixel wise r^2 values of 90%+. arxiv.org/abs/2412.20292