Jonathon Belotti
@jonathonbelotti.bsky.social
Peeling back the layers @modal_labs. Previously data & ML platform @canva. dms open.
10 months later, we're hiring for a reliability focused engineer :)
jobs.ashbyhq.com/modal/84467a...
If you know someone great that'd want to be a founding reliability eng for Modal's GPU-focused cloud platform, lmk!
jobs.ashbyhq.com/modal/84467a...
If you know someone great that'd want to be a founding reliability eng for Modal's GPU-focused cloud platform, lmk!
February 2, 2026 at 4:08 AM
10 months later, we're hiring for a reliability focused engineer :)
jobs.ashbyhq.com/modal/84467a...
If you know someone great that'd want to be a founding reliability eng for Modal's GPU-focused cloud platform, lmk!
jobs.ashbyhq.com/modal/84467a...
If you know someone great that'd want to be a founding reliability eng for Modal's GPU-focused cloud platform, lmk!
When I was at Canva I had to get a batch job to run demographics analysis vision models on over 90 million images. It took a couple weeks, but felt like with the right infra it could be done in a couple hours.
The infra now exists :)
The infra now exists :)
Introducing Modal Batch: Process 1 Million Jobs with 1 Line of Code
Modal Batch is a new interface backed by a new durable queue system built specifically to make job processing easy, scalable, and fault-tolerant.
modal.com
May 23, 2025 at 3:21 PM
When I was at Canva I had to get a batch job to run demographics analysis vision models on over 90 million images. It took a couple weeks, but felt like with the right infra it could be done in a couple hours.
The infra now exists :)
The infra now exists :)
Reposted by Jonathon Belotti
Hypervisor as a Library #rustlang seiya.me/blog/hypervi...
Hypervisor as a Library
seiya.me
May 20, 2025 at 4:42 PM
Hypervisor as a Library #rustlang seiya.me/blog/hypervi...
We won't tell you where the deep and cheap GPU capacity is, but we will teach you how to fish.
Linear Programming for Fun and Profit
How we use an eighty-year-old algorithm to find arbitrages in the cloud market.
modal.com
May 7, 2025 at 6:28 PM
We won't tell you where the deep and cheap GPU capacity is, but we will teach you how to fish.
Is The Soul of a New Machine the best book about the computer industry because Kidder is..
- an outsider
- a full-time writer
- simply a first rate writer
Other industries have had ‘homegrown’ Pulitzers—medicine, law, finance, bilogy—but not computing.
- an outsider
- a full-time writer
- simply a first rate writer
Other industries have had ‘homegrown’ Pulitzers—medicine, law, finance, bilogy—but not computing.
April 5, 2025 at 7:53 PM
Is The Soul of a New Machine the best book about the computer industry because Kidder is..
- an outsider
- a full-time writer
- simply a first rate writer
Other industries have had ‘homegrown’ Pulitzers—medicine, law, finance, bilogy—but not computing.
- an outsider
- a full-time writer
- simply a first rate writer
Other industries have had ‘homegrown’ Pulitzers—medicine, law, finance, bilogy—but not computing.
LLMs have shifted my blog post drafting back to my static-site repository away from Notion. I can play with HTML and JS so easily during iteration with Cursor.
Markdown+Blocks is hamstringing.
Markdown+Blocks is hamstringing.
April 3, 2025 at 11:51 PM
LLMs have shifted my blog post drafting back to my static-site repository away from Notion. I can play with HTML and JS so easily during iteration with Cursor.
Markdown+Blocks is hamstringing.
Markdown+Blocks is hamstringing.
Is there a SRE book but for startups? Google’s book is great but it doesn’t contend with the tradeoffs and constraints of a young growing startup.
March 31, 2025 at 1:41 PM
Is there a SRE book but for startups? Google’s book is great but it doesn’t contend with the tradeoffs and constraints of a young growing startup.
History-posting once again: thundergolfer.com/blog/the-fir...
The First LLM
A tracing of the history of GPT-1 and its predecessors.
thundergolfer.com
March 24, 2025 at 1:52 PM
History-posting once again: thundergolfer.com/blog/the-fir...
My brilliant @modal-labs.bsky.social colleague Charles won't stop until we're all pushing our GPUs to their limits: modal.com/blog/gpu-uti...
'I paid for the whole GPU, I am going to use the whole GPU': A high-level guide to GPU utilization
A guide to maximizing the utilization of GPUs, from cloud allocations to FLOP/s.
modal.com
February 25, 2025 at 11:02 PM
My brilliant @modal-labs.bsky.social colleague Charles won't stop until we're all pushing our GPUs to their limits: modal.com/blog/gpu-uti...
The Tom Brady of Youtube educational content is at it again. One of those rare lectures which deserves to be called enlightening. I hope @karpathy.bsky.social is steering clear of helicopters, submersibles, and smoking. We need him.
Deep Dive into LLMs like ChatGPT
YouTube video by Andrej Karpathy
www.youtube.com
February 16, 2025 at 4:47 PM
The Tom Brady of Youtube educational content is at it again. One of those rare lectures which deserves to be called enlightening. I hope @karpathy.bsky.social is steering clear of helicopters, submersibles, and smoking. We need him.
At @modal-labs.bsky.social your customer questions sometimes get a whole blog post :)
Why does an NVIDIA H100 SXM 80GB card offer 85.52 GB?
thundergolfer.com/blog/nvidia-...
Why does an NVIDIA H100 SXM 80GB card offer 85.52 GB?
thundergolfer.com/blog/nvidia-...
February 2, 2025 at 10:06 PM
At @modal-labs.bsky.social your customer questions sometimes get a whole blog post :)
Why does an NVIDIA H100 SXM 80GB card offer 85.52 GB?
thundergolfer.com/blog/nvidia-...
Why does an NVIDIA H100 SXM 80GB card offer 85.52 GB?
thundergolfer.com/blog/nvidia-...
Found out you get 220MiB more H100 HBM3e VRAM on Oracle Cloud compared to GCP. GCP's instances have more `reserved` memory and I can't figure out if this is configurable from the guest.
February 1, 2025 at 6:33 PM
Found out you get 220MiB more H100 HBM3e VRAM on Oracle Cloud compared to GCP. GCP's instances have more `reserved` memory and I can't figure out if this is configurable from the guest.
Wrote about how a warmed up container can be saved to disk and later restored for a 2.5x cold start performance boost. Saving live container processes to disk turns out to be pretty whacky and interesting!
modal.com/blog/mem-sna...
modal.com/blog/mem-sna...
Memory Snapshots: Checkpoint/Restore for Sub-second Startup
Serializing container state to disk for aggressive cold start optimization.
modal.com
January 29, 2025 at 9:18 PM
Wrote about how a warmed up container can be saved to disk and later restored for a 2.5x cold start performance boost. Saving live container processes to disk turns out to be pretty whacky and interesting!
modal.com/blog/mem-sna...
modal.com/blog/mem-sna...
This contains the shortest and clearest explanation of S3’s $0.02/gib/month cloud economics that I’ve seen, and lots more good stuff.
tailscale.com/blog/living-...
tailscale.com/blog/living-...
Living in the future, by the numbers
Instead of making the traditional New Year predictions, let’s talk instead about the beautiful technological future we live in: the one that exists right now but we don’t always notice.
tailscale.com
January 22, 2025 at 3:40 PM
This contains the shortest and clearest explanation of S3’s $0.02/gib/month cloud economics that I’ve seen, and lots more good stuff.
tailscale.com/blog/living-...
tailscale.com/blog/living-...
Quick post about those 'latency numbers every programmer must know'. It became mostly an affirmation of
@sirupsen.bsky.social 's napkin-math repo (bookmark it).
@sirupsen.bsky.social 's napkin-math repo (bookmark it).
January 19, 2025 at 5:32 PM
Quick post about those 'latency numbers every programmer must know'. It became mostly an affirmation of
@sirupsen.bsky.social 's napkin-math repo (bookmark it).
@sirupsen.bsky.social 's napkin-math repo (bookmark it).
New goal in 2025 is to write one software essay with the zany energy of an All Souls College essay prompt: Does the moral character of an orgy change when the participants wear Nazi uniforms?
thundergolfer.com/all-souls-so...
thundergolfer.com/all-souls-so...
An ‘All Souls Examination’ of the machine
Inspiration towards a better software essay.
thundergolfer.com
January 7, 2025 at 2:51 AM
New goal in 2025 is to write one software essay with the zany energy of an All Souls College essay prompt: Does the moral character of an orgy change when the participants wear Nazi uniforms?
thundergolfer.com/all-souls-so...
thundergolfer.com/all-souls-so...
GPUs can be understood: modal.com/gpu-glossary...
README | GPU Glossary
modal.com
December 12, 2024 at 11:06 PM
GPUs can be understood: modal.com/gpu-glossary...