But as you increase model size and data, you can’t even fit everything in the GPU memory and a cluster is necessary 😂

For DL stuff it depends on the model size and available data to train. A regular nvidia consumer’s card can handle most of the small sized models today, like cellpose and stardist. But of course it will limit large-scale experiments