Karl Podesta
banner
karlpodesta.bsky.social
Karl Podesta
@karlpodesta.bsky.social
HPC (& Linux! & Cloud!) enthusiast @ #Microsoft. Software Engineer for Azure Batch. Previously 8 years tech-selling to EMEA #Azure #HPC customers, & 12 years tech-running infra/systems. Irish! Dubliner! Exclamation marks!
Part of my “new” job (#azure #batch #HPC) means I come to the Dublin office a lot more (i.e. “at all”). It’s a pretty nice place, and pretty busy today - there’s an all hands and a Christmas party. I can feel the buzz! Almost 4000 people work across whole site. People! #microsoftlifeireland
December 4, 2024 at 1:59 PM
In a more helpful response, here's a current snap of the Azure calculator for East US right now. HBv5 not in there yet, of course. Interesting that v2 and v3 are currently the same price.
November 19, 2024 at 6:53 PM
#Azure #HPC customer stories are all @ customers.microsoft.com - search "HPC"!

There are so many. I'm EMEA based, and my personal favorites are the UK Met Office and Vestas, who both migrated entire supercomputers to Azure. I was also involved ;-)

Speaking from experience: "find your why"!
November 18, 2024 at 1:49 PM
Some #Azure #HPC history/dates:
- Azure! (October 2008)
- Microsoft HPC Pack (December 2008)
- A8 VMs with Infiniband (May 2014)
- Azure Batch (July 2015)
- H-series launch (Sep 2016)
- N-series launch (Dec 2016)
- CycleCloud acquisition (Aug 2017)
- HB-series launch (May 2019)
- Top500 (Jun 2021)
November 18, 2024 at 1:49 PM
#Azure #HPC focused software (e.g. to orchestrate compute):

- Azure Batch - easy API, builtin scheduler (for devs!)

- Azure CycleCloud - Easy Slurm/PBS/LSF/etc! (for sysadmins!)

- Microsoft HPC Pack (for windows on-prem folks!)

- Azure Kubernetes (AKS) - Can do IB clusters! (more devs!)
November 18, 2024 at 1:49 PM
#Azure has Infiniband (IB) network at scale (non-blocking fat tree), for years now! Baked into H & N series VMs, in many (not all) DCs, creating large #HPC #AI clusters. Move data in/out via "Azure Express Route" (dedicated private connection), around via internal backbone, inside clusters w/ IB.
November 18, 2024 at 1:49 PM
#Azure #HPC storage is a continuum of options through price/scale/performance/protocol. Think 5 options in increasing cost/performance, that you can mix/match:

- Azure Blob (Object, Standard/Premium)
- Azure Files (NFS/CIFS as a service!)
- Azure Netapp Files (ANF)
- Azure Managed Lustre (AMLFS)
November 18, 2024 at 1:49 PM
#Azure has 00s of virtual machine (VM) sizes on real computers, spread over 62+ regions globally, upgrading regularly. Everything is virtual (Hyper-V!). Some VMs map 1:1 to h/w.

For #HPC: H (HPC CPUs), N (GPUs), D/E/F (CPUs). Up to 176 cpus/VM! AMD/Intel/NV chips, with Maia/Cobolt new custom chips.
November 18, 2024 at 1:49 PM
Actual footage of the #SC24 show floor:
November 17, 2024 at 2:21 PM
“It looks like you’re attending the SC24 conference!” etc
November 17, 2024 at 1:23 PM
I’m not going to be at #SC24… still feeling grateful for all the SC experiences I’ve had to date :-) Hope everyone has a great conference. And check out my #Microsoft #Azure friends there for all the #HPC things!
November 15, 2024 at 9:42 PM