Catch me during NYC Climate Week on September 24th for an evening of talks hosted by TED Countdown -- I will be talking about all things AI and sustainability 🌍
countdown.ted.com/ai-for-clima...
Catch me during NYC Climate Week on September 24th for an evening of talks hosted by TED Countdown -- I will be talking about all things AI and sustainability 🌍
countdown.ted.com/ai-for-clima...
We tracked down the origins of these numbers 🕵♀️ and wrote a paper about it!
arxiv.org/abs/2506.15572
We tracked down the origins of these numbers 🕵♀️ and wrote a paper about it!
arxiv.org/abs/2506.15572
Check out the evergreen Space I made to find your inner Pedro here! huggingface.co/spaces/sasha...
Check out the evergreen Space I made to find your inner Pedro here! huggingface.co/spaces/sasha...
A quote from my TED talk is featured in an exhibit on AI at the Exploratorium in San Francisco -- go check it out if you're in town!
A quote from my TED talk is featured in an exhibit on AI at the Exploratorium in San Francisco -- go check it out if you're in town!
We ran some experiments where we show that the total energy consumed is ~0.245 Wh (roughly equivalent to powering a 5 W LED bulb for approximately 3 minutes).
We ran some experiments where we show that the total energy consumed is ~0.245 Wh (roughly equivalent to powering a 5 W LED bulb for approximately 3 minutes).
Even if this is the true amount of energy used for a query (and that's a big if!), multiplied by the billions of queries a day, this adds up massively.
And that's not counting image generation, which is much more energy-intensive!
Even if this is the true amount of energy used for a query (and that's a big if!), multiplied by the billions of queries a day, this adds up massively.
And that's not counting image generation, which is much more energy-intensive!
And the conclusion: "𝘗𝘰𝘸𝘦𝘳 𝘤𝘰𝘯𝘴𝘵𝘳𝘢𝘪𝘯𝘵𝘴 𝘸𝘪𝘭𝘭 𝘭𝘪𝘬𝘦𝘭𝘺 𝘣𝘦𝘤𝘰𝘮𝘦 𝘵𝘩𝘦 𝘱𝘳𝘪𝘮𝘢𝘳𝘺 𝘣𝘰𝘵𝘵𝘭𝘦𝘯𝘦𝘤𝘬 𝘧𝘰𝘳 𝘈𝘐 𝘴𝘶𝘱𝘦𝘳𝘤𝘰𝘮𝘱𝘶𝘵𝘦𝘳 𝘨𝘳𝘰𝘸𝘵𝘩"
And the conclusion: "𝘗𝘰𝘸𝘦𝘳 𝘤𝘰𝘯𝘴𝘵𝘳𝘢𝘪𝘯𝘵𝘴 𝘸𝘪𝘭𝘭 𝘭𝘪𝘬𝘦𝘭𝘺 𝘣𝘦𝘤𝘰𝘮𝘦 𝘵𝘩𝘦 𝘱𝘳𝘪𝘮𝘢𝘳𝘺 𝘣𝘰𝘵𝘵𝘭𝘦𝘯𝘦𝘤𝘬 𝘧𝘰𝘳 𝘈𝘐 𝘴𝘶𝘱𝘦𝘳𝘤𝘰𝘮𝘱𝘶𝘵𝘦𝘳 𝘨𝘳𝘰𝘸𝘵𝘩"
"𝘤𝘰𝘮𝘱𝘶𝘵𝘢𝘵𝘪𝘰𝘯𝘢𝘭 𝘱𝘦𝘳𝘧𝘰𝘳𝘮𝘢𝘯𝘤𝘦 𝘰𝘧 𝘈𝘐 𝘴𝘶𝘱𝘦𝘳𝘤𝘰𝘮𝘱𝘶𝘵𝘦𝘳𝘴 𝘩𝘢𝘴 𝘥𝘰𝘶𝘣𝘭𝘦𝘥 𝘦𝘷𝘦𝘳𝘺 𝘯𝘪𝘯𝘦 𝘮𝘰𝘯𝘵𝘩𝘴, 𝘸𝘩𝘪𝘭𝘦 𝘩𝘢𝘳𝘥𝘸𝘢𝘳𝘦 𝘢𝘤𝘲𝘶𝘪𝘴𝘪𝘵𝘪𝘰𝘯 𝘤𝘰𝘴𝘵 𝘢𝘯𝘥 𝘱𝘰𝘸𝘦𝘳 𝘯𝘦𝘦𝘥𝘴 𝘣𝘰𝘵𝘩 𝘥𝘰𝘶𝘣𝘭𝘦𝘥 𝘦𝘷𝘦𝘳𝘺 𝘺𝘦𝘢𝘳."
"𝘤𝘰𝘮𝘱𝘶𝘵𝘢𝘵𝘪𝘰𝘯𝘢𝘭 𝘱𝘦𝘳𝘧𝘰𝘳𝘮𝘢𝘯𝘤𝘦 𝘰𝘧 𝘈𝘐 𝘴𝘶𝘱𝘦𝘳𝘤𝘰𝘮𝘱𝘶𝘵𝘦𝘳𝘴 𝘩𝘢𝘴 𝘥𝘰𝘶𝘣𝘭𝘦𝘥 𝘦𝘷𝘦𝘳𝘺 𝘯𝘪𝘯𝘦 𝘮𝘰𝘯𝘵𝘩𝘴, 𝘸𝘩𝘪𝘭𝘦 𝘩𝘢𝘳𝘥𝘸𝘢𝘳𝘦 𝘢𝘤𝘲𝘶𝘪𝘴𝘪𝘵𝘪𝘰𝘯 𝘤𝘰𝘴𝘵 𝘢𝘯𝘥 𝘱𝘰𝘸𝘦𝘳 𝘯𝘦𝘦𝘥𝘴 𝘣𝘰𝘵𝘩 𝘥𝘰𝘶𝘣𝘭𝘦𝘥 𝘦𝘷𝘦𝘳𝘺 𝘺𝘦𝘢𝘳."
Measuring both on context-specific data is important to measure both real-world performance and efficiency!
Measuring both on context-specific data is important to measure both real-world performance and efficiency!
I mean, yes, surely, but... the only way to prove that is by reporting them in the first place? 🤷
I mean, yes, surely, but... the only way to prove that is by reporting them in the first place? 🤷
I'm stocking up on popcorn for what's guaranteed to be a wild ride! 🍿 🍿
I'm stocking up on popcorn for what's guaranteed to be a wild ride! 🍿 🍿
(but that creepy AI clone of me is going to haunt my nightmares until the end of time)
(but that creepy AI clone of me is going to haunt my nightmares until the end of time)
It's truly like feminism never happened 🙅♀️
(I have been ranting about this ever since people started using it to demonstrate GANs back in the 2010s, I can't believe it's still an "acceptable" task in AI!)
It's truly like feminism never happened 🙅♀️
(I have been ranting about this ever since people started using it to demonstrate GANs back in the 2010s, I can't believe it's still an "acceptable" task in AI!)
huggingface.co/blog/sasha/r...
huggingface.co/blog/sasha/r...
First of all -- that number is a back of the envelope calculation 𝗯𝗮𝘀𝗲𝗱 𝗼𝗻 𝗹𝗶𝘁𝘁𝗹𝗲 𝗺𝗼𝗿𝗲 𝘁𝗵𝗮𝗻 𝘃𝗶𝗯𝗲𝘀 𝗮𝗻𝗱 𝗴𝘂𝗲𝘀𝘀𝘄𝗼𝗿𝗸.
First of all -- that number is a back of the envelope calculation 𝗯𝗮𝘀𝗲𝗱 𝗼𝗻 𝗹𝗶𝘁𝘁𝗹𝗲 𝗺𝗼𝗿𝗲 𝘁𝗵𝗮𝗻 𝘃𝗶𝗯𝗲𝘀 𝗮𝗻𝗱 𝗴𝘂𝗲𝘀𝘀𝘄𝗼𝗿𝗸.
What's the energy cost?
→ Without reasoning: wrong (😅), but low energy use
→ With reasoning: correct (!!)… but using 42x more energy!
What's the energy cost?
→ Without reasoning: wrong (😅), but low energy use
→ With reasoning: correct (!!)… but using 42x more energy!
iea.blob.core.windows.net/assets/86ed1...
Hope this will spark a multitude of discussions and debates, and help us collectively come to a better understanding of how AI's energy demands are evolving over time.
iea.blob.core.windows.net/assets/86ed1...
Hope this will spark a multitude of discussions and debates, and help us collectively come to a better understanding of how AI's energy demands are evolving over time.
I'll check it every day to make sure we haven't reached AGI yet 😝
Thank you @yjernite.bsky.social for the share!
gpt-unicorn.adamkdean.co.uk
I'll check it every day to make sure we haven't reached AGI yet 😝
Thank you @yjernite.bsky.social for the share!
gpt-unicorn.adamkdean.co.uk
In these times of change and social pressure, having safe spaces like this is so important 🦋💖
In these times of change and social pressure, having safe spaces like this is so important 🦋💖
How about Beijing? Roughly 𝟲𝟭% 𝗼𝗳 𝗶𝘁𝘀 𝗲𝗹𝗲𝗰𝘁𝗿𝗶𝗰𝗶𝘁𝘆 𝗰𝗼𝗺𝗲𝘀 𝗳𝗿𝗼𝗺 𝗯𝘂𝗿𝗻𝗶𝗻𝗴 𝗰𝗼𝗮𝗹.
How about Beijing? Roughly 𝟲𝟭% 𝗼𝗳 𝗶𝘁𝘀 𝗲𝗹𝗲𝗰𝘁𝗿𝗶𝗰𝗶𝘁𝘆 𝗰𝗼𝗺𝗲𝘀 𝗳𝗿𝗼𝗺 𝗯𝘂𝗿𝗻𝗶𝗻𝗴 𝗰𝗼𝗮𝗹.