Aidan Kelly
@helloaidank.bsky.social
Data Scientist at Nesta in the Discovery team | Passion for clean energy and all things generative AI | Views are my own.
MSc from UvA, PhD in particle physics from UCL.
MSc from UvA, PhD in particle physics from UCL.
Honestly, it is scary seeing fascism on the march across many different western countries. There are Portuguese elections today where Ventura (the Farage of Portugal) is likely to reach the runoff showdown.
We must resist!
We must resist!
January 18, 2026 at 3:45 PM
Honestly, it is scary seeing fascism on the march across many different western countries. There are Portuguese elections today where Ventura (the Farage of Portugal) is likely to reach the runoff showdown.
We must resist!
We must resist!
Reposted by Aidan Kelly
I've had a first stab at making a list of GenAI ppl on here but it's proving harder than anticipated! X is still the place to be for that content.
Let me know if you're interested in being added or know anyone who would be a good addition😎
bsky.app/profile/did:...
Let me know if you're interested in being added or know anyone who would be a good addition😎
bsky.app/profile/did:...
April 25, 2025 at 9:05 PM
I've had a first stab at making a list of GenAI ppl on here but it's proving harder than anticipated! X is still the place to be for that content.
Let me know if you're interested in being added or know anyone who would be a good addition😎
bsky.app/profile/did:...
Let me know if you're interested in being added or know anyone who would be a good addition😎
bsky.app/profile/did:...
Gentle intro to on-policy distillation for language models from Thinking Machines. It defines a lot of key terms used in post-training which I found useful.
Seems like there is scope using this technique to post-train LMs without need for huge compute.
thinkingmachines.ai/blog/on-poli...
Seems like there is scope using this technique to post-train LMs without need for huge compute.
thinkingmachines.ai/blog/on-poli...
On-Policy Distillation
On-policy, dense supervision is a useful tool for distillation
thinkingmachines.ai
January 13, 2026 at 11:11 AM
Gentle intro to on-policy distillation for language models from Thinking Machines. It defines a lot of key terms used in post-training which I found useful.
Seems like there is scope using this technique to post-train LMs without need for huge compute.
thinkingmachines.ai/blog/on-poli...
Seems like there is scope using this technique to post-train LMs without need for huge compute.
thinkingmachines.ai/blog/on-poli...
Reposted by Aidan Kelly
Really interesting piece in the FT with Yann LeCun (@yann-lecun.bsky.social). Insights into the dynamics at Meta and how the winds of AI have changed recently.
Interested in learning more about the world models he has been working on.
www.ft.com/content/e3c4...
Interested in learning more about the world models he has been working on.
www.ft.com/content/e3c4...
Computer scientist Yann LeCun: ‘Intelligence really is about learning’
The AI pioneer on stepping down from Meta, the limits of large language models — and the launch of his new start-up
www.ft.com
January 2, 2026 at 6:04 PM
Really interesting piece in the FT with Yann LeCun (@yann-lecun.bsky.social). Insights into the dynamics at Meta and how the winds of AI have changed recently.
Interested in learning more about the world models he has been working on.
www.ft.com/content/e3c4...
Interested in learning more about the world models he has been working on.
www.ft.com/content/e3c4...
Reposted by Aidan Kelly
Introducing DroPE: Extending Context by Dropping Positional Embeddings
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
January 12, 2026 at 4:07 AM
Introducing DroPE: Extending Context by Dropping Positional Embeddings
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
Listening to the news agent podcast earlier with Mehdi Hasan, and talk of Trump being re-elected in 2020 rather than 2024 may have been the lesser of two evils. On the surface, it seems relatively convincing.
January 11, 2026 at 9:00 PM
Listening to the news agent podcast earlier with Mehdi Hasan, and talk of Trump being re-elected in 2020 rather than 2024 may have been the lesser of two evils. On the surface, it seems relatively convincing.
Really interesting piece in the FT with Yann LeCun (@yann-lecun.bsky.social). Insights into the dynamics at Meta and how the winds of AI have changed recently.
Interested in learning more about the world models he has been working on.
www.ft.com/content/e3c4...
Interested in learning more about the world models he has been working on.
www.ft.com/content/e3c4...
Computer scientist Yann LeCun: ‘Intelligence really is about learning’
The AI pioneer on stepping down from Meta, the limits of large language models — and the launch of his new start-up
www.ft.com
January 2, 2026 at 6:04 PM
Really interesting piece in the FT with Yann LeCun (@yann-lecun.bsky.social). Insights into the dynamics at Meta and how the winds of AI have changed recently.
Interested in learning more about the world models he has been working on.
www.ft.com/content/e3c4...
Interested in learning more about the world models he has been working on.
www.ft.com/content/e3c4...
Watching what's happening over on grok in terms of image manipulation is really quite worrying and a clear violation of privacy. It needs to be regulated with a big stick, however I fear this is only the tip of the iceberg of what's out there on the web.
January 2, 2026 at 12:17 PM
Watching what's happening over on grok in terms of image manipulation is really quite worrying and a clear violation of privacy. It needs to be regulated with a big stick, however I fear this is only the tip of the iceberg of what's out there on the web.
Reposted by Aidan Kelly
There's been a lot of discourse lately about how coding agents have become overwhelming, and that SWEs who don't use them yet just won't be able to catch up. I don't believe this is true, but we do need to know what problems coding agents are solving to approach them with an engineering mindset.
Coding Agents Are Easy, Actually
Software engineering is here to stay
karashiiro.leaflet.pub
January 1, 2026 at 8:45 PM
There's been a lot of discourse lately about how coding agents have become overwhelming, and that SWEs who don't use them yet just won't be able to catch up. I don't believe this is true, but we do need to know what problems coding agents are solving to approach them with an engineering mindset.
Reposted by Aidan Kelly
I didn't see enough news about this crazy/cool paper from DeepSeek - you take text, and convert it to imagery, and you get BETTER performance. Oh and some really neat ideas about contextual memory too.
www.distributedthoughts.org/a-picture-is...
www.distributedthoughts.org/a-picture-is...
A Picture Is Worth Ten Thousand Tokens
DeepSeek's new OCR model achieves 97% accuracy while using one-tenth the tokens by rendering text as images. The computationally "heavy" modality turns out to be the efficient one, which should make u...
www.distributedthoughts.org
December 29, 2025 at 7:27 PM
I didn't see enough news about this crazy/cool paper from DeepSeek - you take text, and convert it to imagery, and you get BETTER performance. Oh and some really neat ideas about contextual memory too.
www.distributedthoughts.org/a-picture-is...
www.distributedthoughts.org/a-picture-is...
Can't stop listening to this. Mixture of synth, bass and guitar alongside this genre must have felt like it was from another planet in 1980.
www.youtube.com/watch?v=qh-j...
www.youtube.com/watch?v=qh-j...
A Forest
YouTube video by The Cure - Topic
www.youtube.com
December 29, 2025 at 6:29 PM
Can't stop listening to this. Mixture of synth, bass and guitar alongside this genre must have felt like it was from another planet in 1980.
www.youtube.com/watch?v=qh-j...
www.youtube.com/watch?v=qh-j...
Reposted by Aidan Kelly
Exploring TabPFN: A Foundation Model Built for Tabular Data
Understanding the architecture, training pipeline and implementing TabPFN in practice
Telegram AI Digest
#ai #foundationmodel #news
Understanding the architecture, training pipeline and implementing TabPFN in practice
Telegram AI Digest
#ai #foundationmodel #news
Exploring TabPFN: A Foundation Model Built for Tabular Data
Understanding the architecture, training pipeline and implementing TabPFN in practice
towardsdatascience.com
December 27, 2025 at 9:20 PM
Exploring TabPFN: A Foundation Model Built for Tabular Data
Understanding the architecture, training pipeline and implementing TabPFN in practice
Telegram AI Digest
#ai #foundationmodel #news
Understanding the architecture, training pipeline and implementing TabPFN in practice
Telegram AI Digest
#ai #foundationmodel #news
Trying to understand some code in Rust and it's giving me vietnam style flashbacks to C++
December 25, 2025 at 8:46 PM
Trying to understand some code in Rust and it's giving me vietnam style flashbacks to C++
Merry Christmas! 🎄
December 25, 2025 at 12:55 PM
Merry Christmas! 🎄
Thoughtful piece by my current favourite podcaster @dwarkesh.bsky.social on where we're at with AI progress and reflections around intelligence itself: substack.com/home/post/p-...
Thoughts on AI progress (Dec 2025)
Why I'm moderately bearish in the short term, and explosively bullish in the long term
substack.com
December 6, 2025 at 11:03 AM
Thoughtful piece by my current favourite podcaster @dwarkesh.bsky.social on where we're at with AI progress and reflections around intelligence itself: substack.com/home/post/p-...
Yann LeCun being let go by Meta might have some unexpected benefits 🍿
November 15, 2025 at 5:37 PM
Yann LeCun being let go by Meta might have some unexpected benefits 🍿
This may be very old man of me, but I feel like there is something about the bluesky algorithm/my feed that is not sucking me in enough. I know, I know, it's sort of the point but still, I need to have some pull to check out the content and it isn't quite itching that scratch.
November 4, 2025 at 9:49 PM
This may be very old man of me, but I feel like there is something about the bluesky algorithm/my feed that is not sucking me in enough. I know, I know, it's sort of the point but still, I need to have some pull to check out the content and it isn't quite itching that scratch.
Reposted by Aidan Kelly
With the AWS outage, now‘s as good a time as any to post this old strip.
October 20, 2025 at 10:18 AM
With the AWS outage, now‘s as good a time as any to post this old strip.
Link to the article piece: www.nesta.org.uk/feature/miss...
Mission Radar: emerging trends and signals in affordable low-carbon heating
Innovations to improve the affordability of low-carbon heating
www.nesta.org.uk
October 20, 2025 at 11:39 AM
Link to the article piece: www.nesta.org.uk/feature/miss...
🏛️ Policy trends:
Electricity price reduction is climbing the policy agenda. Recent debate has centred on long-term ways to bring down prices for households and businesses. That’s key to helping heat pumps compete with gas boilers on running costs. (7/7)
Electricity price reduction is climbing the policy agenda. Recent debate has centred on long-term ways to bring down prices for households and businesses. That’s key to helping heat pumps compete with gas boilers on running costs. (7/7)
October 20, 2025 at 11:39 AM
🏛️ Policy trends:
Electricity price reduction is climbing the policy agenda. Recent debate has centred on long-term ways to bring down prices for households and businesses. That’s key to helping heat pumps compete with gas boilers on running costs. (7/7)
Electricity price reduction is climbing the policy agenda. Recent debate has centred on long-term ways to bring down prices for households and businesses. That’s key to helping heat pumps compete with gas boilers on running costs. (7/7)
This combined heat pumps, community energy storage, EV car clubs and solar panels to cut bills and upfront costs. (6/7)
October 20, 2025 at 11:39 AM
This combined heat pumps, community energy storage, EV car clubs and solar panels to cut bills and upfront costs. (6/7)
🔬 Research funding:
UK research has shifted from optimising heat pumps to green finance, mirroring the investment trend.
Example: Rossendale Borough Council received over £2 million for a place-based decarbonisation demonstrator in terraced streets. (5/7)
UK research has shifted from optimising heat pumps to green finance, mirroring the investment trend.
Example: Rossendale Borough Council received over £2 million for a place-based decarbonisation demonstrator in terraced streets. (5/7)
October 20, 2025 at 11:39 AM
🔬 Research funding:
UK research has shifted from optimising heat pumps to green finance, mirroring the investment trend.
Example: Rossendale Borough Council received over £2 million for a place-based decarbonisation demonstrator in terraced streets. (5/7)
UK research has shifted from optimising heat pumps to green finance, mirroring the investment trend.
Example: Rossendale Borough Council received over £2 million for a place-based decarbonisation demonstrator in terraced streets. (5/7)
IKEA: Meatballs, flat-packs and now heat pumps. The company is now offering heat pumps in several European countries, including the UK since late September, through partnerships with manufacturers such as Aira. (4/7)
October 20, 2025 at 11:39 AM
IKEA: Meatballs, flat-packs and now heat pumps. The company is now offering heat pumps in several European countries, including the UK since late September, through partnerships with manufacturers such as Aira. (4/7)
💡 Venture funding:
Finance for low-carbon heating is getting a green light from investors. Global investment in 2025 rose sharply for businesses offering loans and financial products to support uptake. (3/7)
Finance for low-carbon heating is getting a green light from investors. Global investment in 2025 rose sharply for businesses offering loans and financial products to support uptake. (3/7)
October 20, 2025 at 11:39 AM
💡 Venture funding:
Finance for low-carbon heating is getting a green light from investors. Global investment in 2025 rose sharply for businesses offering loans and financial products to support uptake. (3/7)
Finance for low-carbon heating is getting a green light from investors. Global investment in 2025 rose sharply for businesses offering loans and financial products to support uptake. (3/7)