Robert Hogan
@rob-hogan.bsky.social
Director of AI @ CergenX, using AI to detect brain injury in newborns // PhD Theoretical Physics | deep learning, science, medtech
https://selfsupervised.substack.com/
https://selfsupervised.substack.com/
New blog post about a side project I've been tipping away at.
I've build an app to explore open-ended idea discovery using LLMs in a multi-agent evolutionary algorithm.
I've also open source the code so you can play with yourself
I've build an app to explore open-ended idea discovery using LLMs in a multi-agent evolutionary algorithm.
I've also open source the code so you can play with yourself
October 6, 2025 at 9:55 AM
New blog post about a side project I've been tipping away at.
I've build an app to explore open-ended idea discovery using LLMs in a multi-agent evolutionary algorithm.
I've also open source the code so you can play with yourself
I've build an app to explore open-ended idea discovery using LLMs in a multi-agent evolutionary algorithm.
I've also open source the code so you can play with yourself
Might be a lack of imagination on my part but my default expectation is for the $6.5bn acquisition on Jony Ive's io to result in OpenAI wearable pendant like the so many already out there (e.g. Limitless below)
Hopefully the was something more exciting in the deal.
Hopefully the was something more exciting in the deal.
June 1, 2025 at 12:35 PM
Might be a lack of imagination on my part but my default expectation is for the $6.5bn acquisition on Jony Ive's io to result in OpenAI wearable pendant like the so many already out there (e.g. Limitless below)
Hopefully the was something more exciting in the deal.
Hopefully the was something more exciting in the deal.
It's an exciting time for scientists everywhere 🧪
May 19, 2025 at 12:29 PM
It's an exciting time for scientists everywhere 🧪
Work like AlphaEvolve is what for me has always been the clear distinction between Google DeepMind and OpenAI. 🧵
May 15, 2025 at 11:36 AM
Work like AlphaEvolve is what for me has always been the clear distinction between Google DeepMind and OpenAI. 🧵
Delighted to see our Wave device receive breakthrough designation from the FDA
#neosky #medsky
www.irishtimes.com/business/202...
#neosky #medsky
www.irishtimes.com/business/202...
Cork medtech Cergenx secures FDA support for neonatal brain injury device
UCC spin-out’s Wave device uses AI to offer hope of early intervention for newborns with brain injury
www.irishtimes.com
January 20, 2025 at 9:10 AM
Delighted to see our Wave device receive breakthrough designation from the FDA
#neosky #medsky
www.irishtimes.com/business/202...
#neosky #medsky
www.irishtimes.com/business/202...
Our seizure detection paper is finally out! Published in npj Digital Medicine.
Lots of work went into this one co-led with @johnotoole.bsky.social.
Blog: www.cergenx.com/blog/scaling...
Paper: www.nature.com/articles/s41...
#Neosky
Lots of work went into this one co-led with @johnotoole.bsky.social.
Blog: www.cergenx.com/blog/scaling...
Paper: www.nature.com/articles/s41...
#Neosky
CergenX Blog - Scaling AI for expert level seizure detection in newborns
Innovation in Neonatal Brain Assessment Technology.
www.cergenx.com
January 13, 2025 at 4:53 PM
Our seizure detection paper is finally out! Published in npj Digital Medicine.
Lots of work went into this one co-led with @johnotoole.bsky.social.
Blog: www.cergenx.com/blog/scaling...
Paper: www.nature.com/articles/s41...
#Neosky
Lots of work went into this one co-led with @johnotoole.bsky.social.
Blog: www.cergenx.com/blog/scaling...
Paper: www.nature.com/articles/s41...
#Neosky
Reposted by Robert Hogan
Want a job in robotics in New York? faunarobotics.com
January 7, 2025 at 1:17 AM
Want a job in robotics in New York? faunarobotics.com
Reposted by Robert Hogan
Interesting paper showing how LLMs change their representational geometry in-context to match a task structure: arxiv.org/abs/2501.00070
Here, the model’s latent representations show a grid structure matching the task.
#MLSKy #NeuroAI
Here, the model’s latent representations show a grid structure matching the task.
#MLSKy #NeuroAI
January 6, 2025 at 4:19 PM
Interesting paper showing how LLMs change their representational geometry in-context to match a task structure: arxiv.org/abs/2501.00070
Here, the model’s latent representations show a grid structure matching the task.
#MLSKy #NeuroAI
Here, the model’s latent representations show a grid structure matching the task.
#MLSKy #NeuroAI
I think we are only scratching the surface of what current LLMs can do. We're fumbling in the dark with prompts. We might just be starting to find the light.
New blog post
open.substack.com/pub/selfsupe...
New blog post
open.substack.com/pub/selfsupe...
January 2, 2025 at 11:03 PM
I think we are only scratching the surface of what current LLMs can do. We're fumbling in the dark with prompts. We might just be starting to find the light.
New blog post
open.substack.com/pub/selfsupe...
New blog post
open.substack.com/pub/selfsupe...
So glad that Quanta Magazine exists. Absolutely love their top breakthroughs of the year series and it's really one of the few science magazines where you can learn things deeper that very surface level. They actually try to get to meat of it.
youtu.be/UhG56kltfP4?...
youtu.be/UhG56kltfP4?...
2024's Biggest Breakthroughs in Physics
YouTube video by Quanta Magazine
youtu.be
December 30, 2024 at 9:51 PM
So glad that Quanta Magazine exists. Absolutely love their top breakthroughs of the year series and it's really one of the few science magazines where you can learn things deeper that very surface level. They actually try to get to meat of it.
youtu.be/UhG56kltfP4?...
youtu.be/UhG56kltfP4?...
Reposted by Robert Hogan
"Ants solving a geometric problem and it's amazing."
This is a great example of 'emergent phenomenon':
- None of the ants understand the problem they're solving.
- None of them can see the whole shape.
- A series of small decisions or rules add up to something with a new layer of complexity.
This is a great example of 'emergent phenomenon':
- None of the ants understand the problem they're solving.
- None of them can see the whole shape.
- A series of small decisions or rules add up to something with a new layer of complexity.
Son hormigas resolviendo un problema geométrico y es para flipar en colores.
December 25, 2024 at 5:54 PM
"Ants solving a geometric problem and it's amazing."
This is a great example of 'emergent phenomenon':
- None of the ants understand the problem they're solving.
- None of them can see the whole shape.
- A series of small decisions or rules add up to something with a new layer of complexity.
This is a great example of 'emergent phenomenon':
- None of the ants understand the problem they're solving.
- None of them can see the whole shape.
- A series of small decisions or rules add up to something with a new layer of complexity.
Might be of interest to folks in 🧪 and ⚛️.
I think there are some strong parallelism between what's happened in the last few years of AI with what happened in last few centuries of physics.
I think there are some strong parallelism between what's happened in the last few years of AI with what happened in last few centuries of physics.
First post on substack on something I've been thinking about for a while.
Check it out here open.substack.com/pub/selfsupe...
Check it out here open.substack.com/pub/selfsupe...
December 23, 2024 at 1:43 PM
Might be of interest to folks in 🧪 and ⚛️.
I think there are some strong parallelism between what's happened in the last few years of AI with what happened in last few centuries of physics.
I think there are some strong parallelism between what's happened in the last few years of AI with what happened in last few centuries of physics.
First post on substack on something I've been thinking about for a while.
Check it out here open.substack.com/pub/selfsupe...
Check it out here open.substack.com/pub/selfsupe...
December 23, 2024 at 12:00 AM
First post on substack on something I've been thinking about for a while.
Check it out here open.substack.com/pub/selfsupe...
Check it out here open.substack.com/pub/selfsupe...
Goalposts moving at lightning speed.
Is _anyone_ surprised?
Is _anyone_ surprised?
December 20, 2024 at 6:36 PM
Goalposts moving at lightning speed.
Is _anyone_ surprised?
Is _anyone_ surprised?
Interesting that there's a bit of diversity developing in these model offerings. We had o1 the test time compute stuff, and Gemini are going all in on the "native" integration of various modalities in and out, with a focus on agents.
blog.google/products/gem...
blog.google/products/gem...
Gemini 2.0: Our latest, most capable AI model yet
See how Gemini 2.0 and our research prototypes work — and how they’ll help make our Google products more helpful.
blog.google
December 11, 2024 at 5:04 PM
Interesting that there's a bit of diversity developing in these model offerings. We had o1 the test time compute stuff, and Gemini are going all in on the "native" integration of various modalities in and out, with a focus on agents.
blog.google/products/gem...
blog.google/products/gem...
@quantamagazine.bsky.social really is always such a joy to read.
Excellent write up of the surface code and Google's result with their new quantum computer chip Willow 🧪⚛️
www.quantamagazine.org/quantum-comp...
Excellent write up of the surface code and Google's result with their new quantum computer chip Willow 🧪⚛️
www.quantamagazine.org/quantum-comp...
Quantum Computers Cross Critical Error Threshold | Quanta Magazine
In a first, researchers have shown that adding more “qubits” to a quantum computer can make it more resilient. It’s an essential step on the long road to practical applications.
www.quantamagazine.org
December 9, 2024 at 10:01 PM
@quantamagazine.bsky.social really is always such a joy to read.
Excellent write up of the surface code and Google's result with their new quantum computer chip Willow 🧪⚛️
www.quantamagazine.org/quantum-comp...
Excellent write up of the surface code and Google's result with their new quantum computer chip Willow 🧪⚛️
www.quantamagazine.org/quantum-comp...
Just adding to 🧪 🙂
First baby steps in #AI4Science for Neonatal EEG! We built the first neonatal seizure detection AI at expert level. It reveals new insights into seizure progression in babies & differences between localized vs generalized seizures. #AES2024 #Neonatal #EEG #AI
December 9, 2024 at 5:04 PM
Just adding to 🧪 🙂
First baby steps in #AI4Science for Neonatal EEG! We built the first neonatal seizure detection AI at expert level. It reveals new insights into seizure progression in babies & differences between localized vs generalized seizures. #AES2024 #Neonatal #EEG #AI
December 9, 2024 at 5:01 PM
First baby steps in #AI4Science for Neonatal EEG! We built the first neonatal seizure detection AI at expert level. It reveals new insights into seizure progression in babies & differences between localized vs generalized seizures. #AES2024 #Neonatal #EEG #AI
Reposted by Robert Hogan
If an #H5N1 pandemic starts tomorrow or in three months, there will be little mystery as to how it happened. The conditions are all there. They have been for a while.
So in some ways the more interesting question to me at the moment is: Why aren’t we in a pandemic yet?
Story here, 🧵 to come:
🧪#IDSky
So in some ways the more interesting question to me at the moment is: Why aren’t we in a pandemic yet?
Story here, 🧵 to come:
🧪#IDSky
Why hasn’t the bird flu pandemic started?
Some scientists examining mutations found in H5N1 viruses fear major outbreak is imminent but others says pathogen remains unpredictable
www.science.org
December 6, 2024 at 12:54 PM
If an #H5N1 pandemic starts tomorrow or in three months, there will be little mystery as to how it happened. The conditions are all there. They have been for a while.
So in some ways the more interesting question to me at the moment is: Why aren’t we in a pandemic yet?
Story here, 🧵 to come:
🧪#IDSky
So in some ways the more interesting question to me at the moment is: Why aren’t we in a pandemic yet?
Story here, 🧵 to come:
🧪#IDSky
Individual grants of up to $1m from AI for Math Fund by Renaissance Philanthropy. Very cool
🧪
renaissancephilanthropy.org/initiatives/...
🧪
renaissancephilanthropy.org/initiatives/...
AI for Math Fund – A brighter future for all through science, technology, and innovation
renaissancephilanthropy.org
December 6, 2024 at 1:20 PM
Individual grants of up to $1m from AI for Math Fund by Renaissance Philanthropy. Very cool
🧪
renaissancephilanthropy.org/initiatives/...
🧪
renaissancephilanthropy.org/initiatives/...
🧪⚛️
Interesting work from Dr Thomas Helfer on using AI to improve fidelity of Black Hole simulations.
We overlapped in TPPC group in King's College London during our PhDs. An huge amount PhDs from there are now working with AI for various applications in science and industry.
arxiv.org/abs/2411.02453
We overlapped in TPPC group in King's College London during our PhDs. An huge amount PhDs from there are now working with AI for various applications in science and industry.
arxiv.org/abs/2411.02453
December 5, 2024 at 7:01 AM
🧪⚛️
Finally catching up on this Test Time Training paper. Thoughts
- very nice results
- interesting that TTT helps smaller models more (sign that scale is disproportionately useful for more memorization?)
- What a pain, I really hope we don't have to do this 😅
arxiv.org/abs/2411.07279
- very nice results
- interesting that TTT helps smaller models more (sign that scale is disproportionately useful for more memorization?)
- What a pain, I really hope we don't have to do this 😅
arxiv.org/abs/2411.07279
The Surprising Effectiveness of Test-Time Training for Abstract Reasoning
Language models have shown impressive performance on tasks within their training distribution, but often struggle with novel problems requiring complex reasoning. We investigate the effectiveness of t...
arxiv.org
December 3, 2024 at 10:50 PM
Finally catching up on this Test Time Training paper. Thoughts
- very nice results
- interesting that TTT helps smaller models more (sign that scale is disproportionately useful for more memorization?)
- What a pain, I really hope we don't have to do this 😅
arxiv.org/abs/2411.07279
- very nice results
- interesting that TTT helps smaller models more (sign that scale is disproportionately useful for more memorization?)
- What a pain, I really hope we don't have to do this 😅
arxiv.org/abs/2411.07279
New study: AI _increases_ burnout in Radiologists
Highlighted difference between screening and clinical settings. AI can actually increase workload in clinical settings when an abnormality is found due to time spent in differential diagnosis.
jamanetwork.com/journals/jam...
Highlighted difference between screening and clinical settings. AI can actually increase workload in clinical settings when an abnormality is found due to time spent in differential diagnosis.
jamanetwork.com/journals/jam...
Artificial Intelligence and Radiologist Burnout
This cross-sectional study investigates whether there is an association between artificial intelligence (AI) use in radiology and radiologist burnout in China.
jamanetwork.com
December 3, 2024 at 1:06 PM
New study: AI _increases_ burnout in Radiologists
Highlighted difference between screening and clinical settings. AI can actually increase workload in clinical settings when an abnormality is found due to time spent in differential diagnosis.
jamanetwork.com/journals/jam...
Highlighted difference between screening and clinical settings. AI can actually increase workload in clinical settings when an abnormality is found due to time spent in differential diagnosis.
jamanetwork.com/journals/jam...
Pretty alarming discovery.
They found you can totally destroy a model by pruning a single weight.
Also have some nice results that use this to improve quantization.
My main concern though is what this tells us about how brittle these models can be.
arxiv.org/html/2411.07...
They found you can totally destroy a model by pruning a single weight.
Also have some nice results that use this to improve quantization.
My main concern though is what this tells us about how brittle these models can be.
arxiv.org/html/2411.07...
November 30, 2024 at 7:39 AM
Pretty alarming discovery.
They found you can totally destroy a model by pruning a single weight.
Also have some nice results that use this to improve quantization.
My main concern though is what this tells us about how brittle these models can be.
arxiv.org/html/2411.07...
They found you can totally destroy a model by pruning a single weight.
Also have some nice results that use this to improve quantization.
My main concern though is what this tells us about how brittle these models can be.
arxiv.org/html/2411.07...