Also no.
Also no.
I disagree with this quote re: energy and land. Water maybe.
I disagree with this quote re: energy and land. Water maybe.
I'm open to being wrong, are you also open to being wrong? Do you hold your opinions or do they hold you?
I'm open to being wrong, are you also open to being wrong? Do you hold your opinions or do they hold you?
When the evidence doesn't support your priors, maybe you should reexamine your assumptions?
Across hyperscalers and smaller operators there is no one number that is correct. The error bars are massive. Anyone claiming to have a perfect idea of the numbers is likely incorrect.
When the evidence doesn't support your priors, maybe you should reexamine your assumptions?
Across hyperscalers and smaller operators there is no one number that is correct. The error bars are massive. Anyone claiming to have a perfect idea of the numbers is likely incorrect.
1) at AWS
2) on the Pleiades supercomputer
3) on infra for PyTorch and model training at Meta across on prem and AWS
4) on prem DCs for SpaceX
5) currently for several customers who run large ML workloads across AWS and on prem GPU farms
1) at AWS
2) on the Pleiades supercomputer
3) on infra for PyTorch and model training at Meta across on prem and AWS
4) on prem DCs for SpaceX
5) currently for several customers who run large ML workloads across AWS and on prem GPU farms
One can hypothesize though and the fact is that power hungry GPU based workloads are not as widely deployed as overall data center capacity. At least not yet.
One can hypothesize though and the fact is that power hungry GPU based workloads are not as widely deployed as overall data center capacity. At least not yet.
Total large GPU deployments in data centers
-----
Total # of data centers
My bet is the denominator is *much* bigger than the numerator. There are fixed power costs for each of the DCs in the denominator that don't go down.
Total large GPU deployments in data centers
-----
Total # of data centers
My bet is the denominator is *much* bigger than the numerator. There are fixed power costs for each of the DCs in the denominator that don't go down.
1. Building data centers takes time.
2. Not all data centers have massive GPU deployments, most around the world basically function as CDNs.
1. Building data centers takes time.
2. Not all data centers have massive GPU deployments, most around the world basically function as CDNs.