@dagonmeister.bsky.social
I can't give you all details, but in my experience (including people in the video game industry), actually 💩💩💩over their beds and other forbidden places is more common than you imagine, specially from the "rich" and poch people.
a woman is sitting at a desk with her mouth open .
ALT: a woman is sitting at a desk with her mouth open .
media.tenor.com
December 18, 2024 at 3:58 PM
I can't give you all details, but in my experience (including people in the video game industry), actually 💩💩💩over their beds and other forbidden places is more common than you imagine, specially from the "rich" and poch people.
Despite the weird formula, we all agree that to serve the latest Llama 70B model you roughly need at least Two Nvidia A100 GPUs 80Gb model (2 X $18000 USD). And this GPU power is just from a memory requirement approach
t.co/sZXSccI3KN
t.co/sZXSccI3KN
https://masteringllm.medium.com/how-much-gpu-memory-is-needed-to-serve-a-large-languagemodel-llm-b1899bb2ab5d
t.co
December 14, 2024 at 1:15 PM
Despite the weird formula, we all agree that to serve the latest Llama 70B model you roughly need at least Two Nvidia A100 GPUs 80Gb model (2 X $18000 USD). And this GPU power is just from a memory requirement approach
t.co/sZXSccI3KN
t.co/sZXSccI3KN