Peter Dekkers
pdekkers.bsky.social
Peter Dekkers
@pdekkers.bsky.social
Didn't yet look into Digits. But when I in the past looked at hosting these larger LLMs myself at some cloud provider, the minimal hourly cost were huge ($50/hour). Only made sense if using them for a large user group.

For smaller models however it might be a good alternative.
January 24, 2025 at 11:42 AM
I assume you mean the DeepSeek models? Indeed you can host them yourself, but this pricing assumes you use deepseek.com for your hosting.
DeepSeek
DeepSeek, unravel the mystery of AGI with curiosity. Answer the essential question with long-termism.
deepseek.com
January 24, 2025 at 10:55 AM