Matjaž Jogan
@matjazjogan.bsky.social
#surgicalAI #surgicaldatascience #perception #cognition researcher @UPenn @pennsurgery @PCASOLab
New work from Guiqiu Liao & PCASO Lab accepted to #MICCAI2025
We bring object-centric learning to the OR—predicting future slot configs to discover tools & anatomy, opening ways for interpretable surgical scene understanding with low computational demands
#SurgicalAI#SurgicalDataScience
We bring object-centric learning to the OR—predicting future slot configs to discover tools & anatomy, opening ways for interpretable surgical scene understanding with low computational demands
#SurgicalAI#SurgicalDataScience
July 4, 2025 at 2:07 AM
New work from Guiqiu Liao & PCASO Lab accepted to #MICCAI2025
We bring object-centric learning to the OR—predicting future slot configs to discover tools & anatomy, opening ways for interpretable surgical scene understanding with low computational demands
#SurgicalAI#SurgicalDataScience
We bring object-centric learning to the OR—predicting future slot configs to discover tools & anatomy, opening ways for interpretable surgical scene understanding with low computational demands
#SurgicalAI#SurgicalDataScience
Reposted by Matjaž Jogan
Thrilled to see our TinyRNN paper in @nature! We show how tiny RNNs predict choices of individual subjects accurately while staying fully interpretable. This approach can transform how we model cognitive processes in both healthy and disordered decisions. doi.org/10.1038/s415...
Discovering cognitive strategies with tiny recurrent neural networks - Nature
Modelling biological decision-making with tiny recurrent neural networks enables more accurate predictions of animal choices than classical cognitive models and offers insights into the underlying cog...
doi.org
July 2, 2025 at 7:03 PM
Thrilled to see our TinyRNN paper in @nature! We show how tiny RNNs predict choices of individual subjects accurately while staying fully interpretable. This approach can transform how we model cognitive processes in both healthy and disordered decisions. doi.org/10.1038/s415...
Reposted by Matjaž Jogan
🚨 New Challenge Alert! 🚨
The Open Surgical Suturing Skills Challenge is back — now with brand new data and a tracking task! 🧵🛠️
Think you can assess skill or track hands & tools in surgical videos? Come join us!
🔗 More info: www.synapse.org/Synapse:syn6...
📣 Follow updates: @hoffoh.bsky.social
The Open Surgical Suturing Skills Challenge is back — now with brand new data and a tracking task! 🧵🛠️
Think you can assess skill or track hands & tools in surgical videos? Come join us!
🔗 More info: www.synapse.org/Synapse:syn6...
📣 Follow updates: @hoffoh.bsky.social
OSS2025
'OSS2025' (Synapse ID: syn66256386) is a project on Synapse. Synapse is a platform for supporting scientific collaborations centered around shared biomedical data sets.
www.synapse.org
May 9, 2025 at 11:43 AM
🚨 New Challenge Alert! 🚨
The Open Surgical Suturing Skills Challenge is back — now with brand new data and a tracking task! 🧵🛠️
Think you can assess skill or track hands & tools in surgical videos? Come join us!
🔗 More info: www.synapse.org/Synapse:syn6...
📣 Follow updates: @hoffoh.bsky.social
The Open Surgical Suturing Skills Challenge is back — now with brand new data and a tracking task! 🧵🛠️
Think you can assess skill or track hands & tools in surgical videos? Come join us!
🔗 More info: www.synapse.org/Synapse:syn6...
📣 Follow updates: @hoffoh.bsky.social
Reposted by Matjaž Jogan
LastCall MICCAI #MedicalImaging Computing in Resource Constrained Settings Workshop & KI (MIRASOL) event.fourwaves.com/mirasol/pages TravelGrants will be available #miccai
June 18, 2025 at 7:45 AM
LastCall MICCAI #MedicalImaging Computing in Resource Constrained Settings Workshop & KI (MIRASOL) event.fourwaves.com/mirasol/pages TravelGrants will be available #miccai
Reposted by Matjaž Jogan
You still have time to submit your work to the FAIMI Workshop at MICCAI 2025 focused on fairness, bias, and equity in AI for medical imaging.
Check out the important dates and details:
👉 faimi-workshop.github.io/2025-miccai-...
#FAIMI #MICCAI2025 #MedicalImaging #FairAI #HealthcareAI #AIethics
Check out the important dates and details:
👉 faimi-workshop.github.io/2025-miccai-...
#FAIMI #MICCAI2025 #MedicalImaging #FairAI #HealthcareAI #AIethics
June 18, 2025 at 2:14 PM
You still have time to submit your work to the FAIMI Workshop at MICCAI 2025 focused on fairness, bias, and equity in AI for medical imaging.
Check out the important dates and details:
👉 faimi-workshop.github.io/2025-miccai-...
#FAIMI #MICCAI2025 #MedicalImaging #FairAI #HealthcareAI #AIethics
Check out the important dates and details:
👉 faimi-workshop.github.io/2025-miccai-...
#FAIMI #MICCAI2025 #MedicalImaging #FairAI #HealthcareAI #AIethics
Reposted by Matjaž Jogan
Guiqiu Liao, Matjaz Jogan, Eric Eaton, Daniel A. Hashimoto: FORLA:Federated Object-centric Representation Learning with Slot Attention https://arxiv.org/abs/2506.02964 https://arxiv.org/pdf/2506.02964 https://arxiv.org/html/2506.02964
June 4, 2025 at 6:16 AM
Guiqiu Liao, Matjaz Jogan, Eric Eaton, Daniel A. Hashimoto: FORLA:Federated Object-centric Representation Learning with Slot Attention https://arxiv.org/abs/2506.02964 https://arxiv.org/pdf/2506.02964 https://arxiv.org/html/2506.02964
Object-centric federated learning across heterogeneous datasets, new work from PCASO lab
Guiqiu Liao, Matjaz Jogan, Eric Eaton, Daniel A. Hashimoto
FORLA:Federated Object-centric Representation Learning with Slot Attention
https://arxiv.org/abs/2506.02964
FORLA:Federated Object-centric Representation Learning with Slot Attention
https://arxiv.org/abs/2506.02964
June 7, 2025 at 5:59 PM
Object-centric federated learning across heterogeneous datasets, new work from PCASO lab
Reposted by Matjaž Jogan
Glad to see that our recent paper on digital twins for biomedical systems aligns with this view: simple correlational data cannot be used for digital twins and, accordingly, for building decisions.
www.nature.com/articles/s41...
www.nature.com/articles/s41...
May 5, 2025 at 5:08 PM
Glad to see that our recent paper on digital twins for biomedical systems aligns with this view: simple correlational data cannot be used for digital twins and, accordingly, for building decisions.
www.nature.com/articles/s41...
www.nature.com/articles/s41...
Reposted by Matjaž Jogan
Today I'm delivering an open science lecture for our master students. These kind of lectures are one of the most enjoyable parts of my job
March 5, 2025 at 9:06 AM
Today I'm delivering an open science lecture for our master students. These kind of lectures are one of the most enjoyable parts of my job
PCASO’s Guiqiu Liao gave a great presentation on VDST-Net at WACV25. Learning segmentation masks from extremely weak labels reduces cost of annotating objects in multi-dimensional data (videos, volumetric data).
Video: video.computer.org/WACV-Posters...
#WACV2025 #surgicaldatascience
Video: video.computer.org/WACV-Posters...
#WACV2025 #surgicaldatascience
March 5, 2025 at 2:20 PM
PCASO’s Guiqiu Liao gave a great presentation on VDST-Net at WACV25. Learning segmentation masks from extremely weak labels reduces cost of annotating objects in multi-dimensional data (videos, volumetric data).
Video: video.computer.org/WACV-Posters...
#WACV2025 #surgicaldatascience
Video: video.computer.org/WACV-Posters...
#WACV2025 #surgicaldatascience
Reposted by Matjaž Jogan
For the new science refugees here, I invite you to slip into the warm embrace of 20+ hours of free soothing lectures on scientific methods, a stats course for people who hate statistics, would rather be doing research or planning revolutions. Try the 1st vid - it's not what you expect. #stats 🧪
Statistical Rethinking 2023 - YouTube
Share your videos with friends, family, and the world
www.youtube.com
August 31, 2024 at 6:34 AM
For the new science refugees here, I invite you to slip into the warm embrace of 20+ hours of free soothing lectures on scientific methods, a stats course for people who hate statistics, would rather be doing research or planning revolutions. Try the 1st vid - it's not what you expect. #stats 🧪
How do we judge the viscosity of materials? It turns out it depends not only on how they move, but also on how they look. Our latest work with the incredible Jeffrey Martin now out in RSOS royalsocietypublishing.org/doi/10.1098/...
February 26, 2025 at 4:29 PM
How do we judge the viscosity of materials? It turns out it depends not only on how they move, but also on how they look. Our latest work with the incredible Jeffrey Martin now out in RSOS royalsocietypublishing.org/doi/10.1098/...
Reposted by Matjaž Jogan
Do large language models develop "emergent" models of the world? My latest Substack posts explore this claim and more generally the nature of "world models":
LLMs and World Models, Part 1: aiguide.substack.com/p/llms-and-w...
LLMs and World Models, Part 2: aiguide.substack.com/p/llms-and-w...
LLMs and World Models, Part 1: aiguide.substack.com/p/llms-and-w...
LLMs and World Models, Part 2: aiguide.substack.com/p/llms-and-w...
LLMs and World Models, Part 1
How do Large Language Models Make Sense of Their “Worlds”?
aiguide.substack.com
February 13, 2025 at 10:30 PM
Do large language models develop "emergent" models of the world? My latest Substack posts explore this claim and more generally the nature of "world models":
LLMs and World Models, Part 1: aiguide.substack.com/p/llms-and-w...
LLMs and World Models, Part 2: aiguide.substack.com/p/llms-and-w...
LLMs and World Models, Part 1: aiguide.substack.com/p/llms-and-w...
LLMs and World Models, Part 2: aiguide.substack.com/p/llms-and-w...
Reposted by Matjaž Jogan
Can LLMs be used to discover interpretable models of human and animal behavior?🤔
Turns out: yes!
Thrilled to share our latest preprint where we used FunSearch to automatically discover symbolic cognitive models of behavior.
1/12
Turns out: yes!
Thrilled to share our latest preprint where we used FunSearch to automatically discover symbolic cognitive models of behavior.
1/12
February 10, 2025 at 12:21 PM
Can LLMs be used to discover interpretable models of human and animal behavior?🤔
Turns out: yes!
Thrilled to share our latest preprint where we used FunSearch to automatically discover symbolic cognitive models of behavior.
1/12
Turns out: yes!
Thrilled to share our latest preprint where we used FunSearch to automatically discover symbolic cognitive models of behavior.
1/12
Reposted by Matjaž Jogan
Modern-Day Oracles or Bullshit Machines?
Jevin West (@jevinwest.bsky.social) and I have spent the last eight months developing the course on large language models (LLMs) that we think every college freshman needs to take.
thebullshitmachines.com
Jevin West (@jevinwest.bsky.social) and I have spent the last eight months developing the course on large language models (LLMs) that we think every college freshman needs to take.
thebullshitmachines.com
INTRODUCTION
thebullshitmachines.com
February 4, 2025 at 4:12 PM
Modern-Day Oracles or Bullshit Machines?
Jevin West (@jevinwest.bsky.social) and I have spent the last eight months developing the course on large language models (LLMs) that we think every college freshman needs to take.
thebullshitmachines.com
Jevin West (@jevinwest.bsky.social) and I have spent the last eight months developing the course on large language models (LLMs) that we think every college freshman needs to take.
thebullshitmachines.com
Reposted by Matjaž Jogan
"One thing is certain: The changes we make ourselves will be healthier than the ones our adversaries demand."
New work for @undark.org:
undark.org/2025/02/06/o...
New work for @undark.org:
undark.org/2025/02/06/o...
The End of Science’s Peacetime
Opinion | Defending the practice of science from its adversaries will require dealing with some uncomfortable truths.
undark.org
February 6, 2025 at 1:52 PM
"One thing is certain: The changes we make ourselves will be healthier than the ones our adversaries demand."
New work for @undark.org:
undark.org/2025/02/06/o...
New work for @undark.org:
undark.org/2025/02/06/o...
Reposted by Matjaž Jogan
"Imagine a world in which an A.I. can analyze your reading patterns and alert you that you’re about to buy a book where there’s only a 10 percent chance you’ll get past Page 6..."
Fuck off. That's not empowerment, that's outsourcing your soul. That's outsouling.
www.nytimes.com/2025/01/25/o...
Fuck off. That's not empowerment, that's outsourcing your soul. That's outsouling.
www.nytimes.com/2025/01/25/o...
Opinion | AI Can Work for Us
A.I. can be designed to dramatically enhance individual empowerment.
www.nytimes.com
January 25, 2025 at 4:15 PM
"Imagine a world in which an A.I. can analyze your reading patterns and alert you that you’re about to buy a book where there’s only a 10 percent chance you’ll get past Page 6..."
Fuck off. That's not empowerment, that's outsourcing your soul. That's outsouling.
www.nytimes.com/2025/01/25/o...
Fuck off. That's not empowerment, that's outsourcing your soul. That's outsouling.
www.nytimes.com/2025/01/25/o...
New work led by PCASO Lab’s stellar Guiqiu Liao: Slot-BERT introduces long-range unsupervised learning of object-centric surgical video representations. By combining slot attention with masked prediction it robustly scales to long videos across multiple surgical domains arxiv.org/abs/2501.12477
January 25, 2025 at 6:11 PM
New work led by PCASO Lab’s stellar Guiqiu Liao: Slot-BERT introduces long-range unsupervised learning of object-centric surgical video representations. By combining slot attention with masked prediction it robustly scales to long videos across multiple surgical domains arxiv.org/abs/2501.12477
Reposted by Matjaž Jogan
I wrote about the concept of agency (both human and artificial) in the year 2025. gracewlindsay.com/2025/01/24/2...
2025: Agency gained and lost
If you’ve had even a passing glance at tech journalism over the past few months, you know the top buzzword for AI in 2025 is agentic. Agentic AI (according to many think pieces and press releases a…
gracewlindsay.com
January 24, 2025 at 8:41 PM
I wrote about the concept of agency (both human and artificial) in the year 2025. gracewlindsay.com/2025/01/24/2...
Reposted by Matjaž Jogan
Deficient Executive Control in Transformer Attention https://www.biorxiv.org/content/10.1101/2025.01.22.634394v1
January 23, 2025 at 11:16 PM
Deficient Executive Control in Transformer Attention https://www.biorxiv.org/content/10.1101/2025.01.22.634394v1
Reposted by Matjaž Jogan
Our new Harvard/Stanford study out today in Nature Medicine! Our results show language models, while strong at medical exams, stumble when they need to gather patient information through natural conversation - a key finding as healthcare explores AI integration.
How to solve? Enter CRAFT-MD.
How to solve? Enter CRAFT-MD.
January 2, 2025 at 2:09 PM
Our new Harvard/Stanford study out today in Nature Medicine! Our results show language models, while strong at medical exams, stumble when they need to gather patient information through natural conversation - a key finding as healthcare explores AI integration.
How to solve? Enter CRAFT-MD.
How to solve? Enter CRAFT-MD.
Reposted by Matjaž Jogan
Amazing collective problem solving in ants:
December 27, 2024 at 5:01 PM
Amazing collective problem solving in ants:
Reposted by Matjaž Jogan
How do disparities in healthcare access affect ML models? 💰📉🧐 We found that low access to care -> worse EHR data quality -> worse ML performance in a dataset of 134k patients. Work with Anna Zink (on the faculty job market rn!) + Hongzhou Luan, presented at #ML4H2024
December 20, 2024 at 1:04 AM
How do disparities in healthcare access affect ML models? 💰📉🧐 We found that low access to care -> worse EHR data quality -> worse ML performance in a dataset of 134k patients. Work with Anna Zink (on the faculty job market rn!) + Hongzhou Luan, presented at #ML4H2024
Reposted by Matjaž Jogan
A short list of tips for keeping a clean, organized ML codebase for new researchers: eugenevinitsky.com/posts/quick-...
Eugene Vinitsky
eugenevinitsky.com
December 18, 2024 at 8:00 PM
A short list of tips for keeping a clean, organized ML codebase for new researchers: eugenevinitsky.com/posts/quick-...