Karl Podesta
@karlpodesta.bsky.social
HPC (& Linux! & Cloud!) enthusiast @ #Microsoft. Software Engineer for Azure Batch. Previously 8 years tech-selling to EMEA #Azure #HPC customers, & 12 years tech-running infra/systems. Irish! Dubliner! Exclamation marks!
Pinned
Karl Podesta
@karlpodesta.bsky.social
· Nov 17
Mandatory things to ask my #Microsoft #Azure colleagues at #SC24 :
“I’m having a problem with on my Windows laptop - can you fix it?” 💻
“Got any free Xboxes?” 🎮
“When will you rename Copilot to Clippy 2.0?” 🤖
#we-also-do #HPC 🤦 ❤️🚀
“I’m having a problem with
“Got any free Xboxes?” 🎮
“When will you rename Copilot to Clippy 2.0?” 🤖
#we-also-do #HPC 🤦 ❤️🚀
Reposted by Karl Podesta
Optimize your HPC workloads by choosing the right hardware—CPUs for memory-intensive workloads, avoiding GPU-induced complexities and latencies. Get started. youtu.be/NGuVGM6amsw #HPCinAzure #microsoftazure #hpc #microsoft #highperformancecomputing #azurehpc
- YouTube
Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube.
youtu.be
April 15, 2025 at 1:04 PM
Optimize your HPC workloads by choosing the right hardware—CPUs for memory-intensive workloads, avoiding GPU-induced complexities and latencies. Get started. youtu.be/NGuVGM6amsw #HPCinAzure #microsoftazure #hpc #microsoft #highperformancecomputing #azurehpc
Reposted by Karl Podesta
New Open #ClusterScheduler and and fully QAed #Gridware #ClusterScheduler packages will be available soon (v9.0.5). github.com/hpc-gridware... #HPC #HTC #AI #Grafana #Cluster #GridEngine
Release OCS/GCS v9.0.5 · hpc-gridware/clusterscheduler
Major Enhancements
v9.0.5
qtelemetry (Developer Preview in GCS)
This release introduces qtelemetry, a new metrics exporter for Gridware Cluster Scheduler (GCS). It allows administrators to easily c...
github.com
April 15, 2025 at 7:32 PM
New Open #ClusterScheduler and and fully QAed #Gridware #ClusterScheduler packages will be available soon (v9.0.5). github.com/hpc-gridware... #HPC #HTC #AI #Grafana #Cluster #GridEngine
Reposted by Karl Podesta
Ha, I am featured on the #ISC25 registration page along with a bunch of my favorite Microsoft colleagues. I wonder if I can cash this in for a discount on registration.
Sadly, it's mostly the side of my head that is featured. @karlpodesta.bsky.social should probably get the bigger discount.
Sadly, it's mostly the side of my head that is featured. @karlpodesta.bsky.social should probably get the bigger discount.
April 16, 2025 at 8:41 PM
Ha, I am featured on the #ISC25 registration page along with a bunch of my favorite Microsoft colleagues. I wonder if I can cash this in for a discount on registration.
Sadly, it's mostly the side of my head that is featured. @karlpodesta.bsky.social should probably get the bigger discount.
Sadly, it's mostly the side of my head that is featured. @karlpodesta.bsky.social should probably get the bigger discount.
Reposted by Karl Podesta
I've published some notes I took while at #GTC25 last week. Have a look: https://blog.glennklockwood.com/2025/03/gtc-2025-recap.html
Part of why I write is to foster discussion, and I'd love to hear or read others' takes on the conference!
#AI
Part of why I write is to foster discussion, and I'd love to hear or read others' takes on the conference!
#AI
GTC 2025 recap
I attended GTC for the first time this year and got to experience what turned out to be one of the strangest, over-the-top conferences I've ...
blog.glennklockwood.com
March 26, 2025 at 7:49 AM
I've published some notes I took while at #GTC25 last week. Have a look: https://blog.glennklockwood.com/2025/03/gtc-2025-recap.html
Part of why I write is to foster discussion, and I'd love to hear or read others' takes on the conference!
#AI
Part of why I write is to foster discussion, and I'd love to hear or read others' takes on the conference!
#AI
Reposted by Karl Podesta
Boost your HPC workloads with Azure's HB-series VMs, offering an 8x generation-over-generation improvement in memory bandwidth powered by AMD’s custom processors, only available on Azure. Get started. youtu.be/NGuVGM6amsw #HPCinAzure #microsoftazure #hpc #microsoft #highperformancecomputing
- YouTube
Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube.
youtu.be
March 15, 2025 at 8:38 PM
Boost your HPC workloads with Azure's HB-series VMs, offering an 8x generation-over-generation improvement in memory bandwidth powered by AMD’s custom processors, only available on Azure. Get started. youtu.be/NGuVGM6amsw #HPCinAzure #microsoftazure #hpc #microsoft #highperformancecomputing
Reposted by Karl Podesta
Power up HPC with #Serverless! Learn how to optimize performance, slash costs, and scale in the cloud. Check out our deep dive with #AzureFunctions & #AWSLambda. #HPC #CloudComputing #CloudDailywire
Revolutionizing HPC with Serverless Computing
High-Performance Computing (HPC) has traditionally been associated with specialized clusters of powerful servers, complex scheduling systems, and rigorous performance optimizations. Over the years, HPC has been a driving force behind groundbreaking research in physics, genomics, climate science, financial modeling, and more. Today, however, we find ourselves at an interesting crossroads: serverless computing has come of age, and the potential to meld it with HPC is opening new vistas of efficiency and cost-effectiveness.
clouddailywire.com
January 23, 2025 at 5:07 PM
Power up HPC with #Serverless! Learn how to optimize performance, slash costs, and scale in the cloud. Check out our deep dive with #AzureFunctions & #AWSLambda. #HPC #CloudComputing #CloudDailywire
Reposted by Karl Podesta
Simulations are crucial for modern product development, but managing them can be complex. This blog explores SimOps, a framework designed to make your simulation workflows smoother and more efficient. Read on to learn more!
Understanding Simulation Operations (SimOps)
Simulation Operations (SimOps) is a strategic framework designed to optimize and automate simulation processes within engineering and product development. As products become increasingly complex and interconnected, the role of simulations in validating designs, testing hypotheses, and driving innovation becomes more critical. SimOps aims to streamline these processes, enhancing productivity and enabling faster, data-driven decision-making.Core Principles of SimOpsSimOps is built upon a foundatio
www.simops.com
January 23, 2025 at 1:33 PM
Simulations are crucial for modern product development, but managing them can be complex. This blog explores SimOps, a framework designed to make your simulation workflows smoother and more efficient. Read on to learn more!
Reposted by Karl Podesta
I just made my first YouTube video showing off the new MATLAB extension for Visual Studio Code www.youtube.com/watch?v=EWRP...
Waaaay out of my comfort zone here!
Maybe like and subscribe to help me feel better? ;)
Waaaay out of my comfort zone here!
Maybe like and subscribe to help me feel better? ;)
The MATLAB extension for Visual Studio Code. Now with Debugging support!
YouTube video by Michael Croucher
www.youtube.com
December 19, 2024 at 1:21 PM
I just made my first YouTube video showing off the new MATLAB extension for Visual Studio Code www.youtube.com/watch?v=EWRP...
Waaaay out of my comfort zone here!
Maybe like and subscribe to help me feel better? ;)
Waaaay out of my comfort zone here!
Maybe like and subscribe to help me feel better? ;)
Reposted by Karl Podesta
Finally! I get it when people say that AI can be used for automation. I just used gpt-4o-mini, aider and PowerShell to rewrite 700+ of my tests.
foreach ($test in $tests) {
aider --message "$prompt" --file $test.FullName --model azure/gpt-4o-mini --no-stream
}
#OpenAI #aider #PowerShell
foreach ($test in $tests) {
aider --message "$prompt" --file $test.FullName --model azure/gpt-4o-mini --no-stream
}
#OpenAI #aider #PowerShell
Aider AI, the command-line code assistant, is phenomenal
I'm currently working on the final chapter of our book! It's the DevOps chapter, which for a while, I thought would probably be about LLMOps or GenAIOps. But I …
blog.netnerds.net
October 19, 2024 at 12:53 PM
Finally! I get it when people say that AI can be used for automation. I just used gpt-4o-mini, aider and PowerShell to rewrite 700+ of my tests.
foreach ($test in $tests) {
aider --message "$prompt" --file $test.FullName --model azure/gpt-4o-mini --no-stream
}
#OpenAI #aider #PowerShell
foreach ($test in $tests) {
aider --message "$prompt" --file $test.FullName --model azure/gpt-4o-mini --no-stream
}
#OpenAI #aider #PowerShell
Reposted by Karl Podesta
Woohoo! Decisions have been made on the @fosdem.bsky.social'25 HPC, Big Data & Data Science DevRoom talks and the schedule is beginning to populate at fosdem.org/2025/schedul... for what will eventually be a full day of talks in Brussels Sunday 2 February 2025 with recording and streaming available.
FOSDEM 2025 - HPC, Big Data & Data Science
fosdem.org
December 15, 2024 at 4:48 PM
Woohoo! Decisions have been made on the @fosdem.bsky.social'25 HPC, Big Data & Data Science DevRoom talks and the schedule is beginning to populate at fosdem.org/2025/schedul... for what will eventually be a full day of talks in Brussels Sunday 2 February 2025 with recording and streaming available.
Reposted by Karl Podesta
Sometimes you get a good boss. If you get one, appreciate them. We have regular “Connect” reviews, and my boss takes them seriously. He rejected mine last week and redlined it. I was upset, then fixed and returned it. He was right, and the changes set me up for success. Darn it for being right lol.
December 14, 2024 at 5:17 AM
Sometimes you get a good boss. If you get one, appreciate them. We have regular “Connect” reviews, and my boss takes them seriously. He rejected mine last week and redlined it. I was upset, then fixed and returned it. He was right, and the changes set me up for success. Darn it for being right lol.
Reposted by Karl Podesta
Yes, Quantum MPI was a thing, even at #SC21 with @microsoft.com.
arxiv.org/abs/2105.01109
Better late than never ;-).
arxiv.org/abs/2105.01109
Better late than never ;-).
Much like today’s classical #HPC clusters, IBM researchers believe the quantum computers of the future will be made up of multiple processors working together to run circuits much too large and complex for any one #QPU
www.ibm.com/quantum/blog...
www.ibm.com/quantum/blog...
Circuit cutting methods for quantum-centric supercomputing | IBM Quantum Computing Blog
A new paper in _Nature_ offers the world’s first demonstration of two connected QPUs executing a quantum circuit larger than either could manage on its own.
www.ibm.com
December 11, 2024 at 9:23 PM
Yes, Quantum MPI was a thing, even at #SC21 with @microsoft.com.
arxiv.org/abs/2105.01109
Better late than never ;-).
arxiv.org/abs/2105.01109
Better late than never ;-).
Reposted by Karl Podesta
The next episode of our Scott and Mark Learn To podcast series is out. In this one, we learn how to...take a dump!
EPISODE 6 - Scott & Mark Learn To... Take a Dump
YouTube video by Scott Hanselman
www.youtube.com
December 11, 2024 at 6:35 PM
The next episode of our Scott and Mark Learn To podcast series is out. In this one, we learn how to...take a dump!
Reposted by Karl Podesta
Really interesting interactive visualization and demonstration of how Large Language Models (LLMs) work. These form the basis of technologies such as ChatGPT. bbycroft.net/llm 🧪
December 2, 2024 at 11:23 AM
Really interesting interactive visualization and demonstration of how Large Language Models (LLMs) work. These form the basis of technologies such as ChatGPT. bbycroft.net/llm 🧪
Part of my “new” job (#azure #batch #HPC) means I come to the Dublin office a lot more (i.e. “at all”). It’s a pretty nice place, and pretty busy today - there’s an all hands and a Christmas party. I can feel the buzz! Almost 4000 people work across whole site. People! #microsoftlifeireland
December 4, 2024 at 1:59 PM
Part of my “new” job (#azure #batch #HPC) means I come to the Dublin office a lot more (i.e. “at all”). It’s a pretty nice place, and pretty busy today - there’s an all hands and a Christmas party. I can feel the buzz! Almost 4000 people work across whole site. People! #microsoftlifeireland
Reposted by Karl Podesta
I spent the Thanksgiving break typing up my notes from #SC24 which I've posted online. 30% more words than my notes from SC23 (sorry!). Feedback is welcome!
https://buff.ly/41fBhho
#HPC
https://buff.ly/41fBhho
#HPC
SC'24 recap
The premiere annual conference of the high-performance computing community, SC24, was held in Atlanta last week, and it attracted a reco...
buff.ly
December 2, 2024 at 7:53 AM
I spent the Thanksgiving break typing up my notes from #SC24 which I've posted online. 30% more words than my notes from SC23 (sorry!). Feedback is welcome!
https://buff.ly/41fBhho
#HPC
https://buff.ly/41fBhho
#HPC
Reposted by Karl Podesta
We could not have articulated it better.
In our view EasyBuild or Spack are not good enough anymore.
They’re both essential tools, and will remain so going forward, but we need to take the next step and go beyond them, and collaborate even more on a shared stack of software *installations*.
#HPC
In our view EasyBuild or Spack are not good enough anymore.
They’re both essential tools, and will remain so going forward, but we need to take the next step and go beyond them, and collaborate even more on a shared stack of software *installations*.
#HPC
#EESSI goes beyond just building apps—it leverages #EasyBuild to craft and maintain a fully optimized, shared software stack. Distributed via CernVM-FS, this stack can run seamlessly on laptops, workstations, HPC and cloud, but delivers performance and consistent UX everywhere. Check www.eessi.io 👍
Project overview - European Environment for Scientific Software Installations (EESSI)
www.eessi.io
December 1, 2024 at 11:36 AM
We could not have articulated it better.
In our view EasyBuild or Spack are not good enough anymore.
They’re both essential tools, and will remain so going forward, but we need to take the next step and go beyond them, and collaborate even more on a shared stack of software *installations*.
#HPC
In our view EasyBuild or Spack are not good enough anymore.
They’re both essential tools, and will remain so going forward, but we need to take the next step and go beyond them, and collaborate even more on a shared stack of software *installations*.
#HPC
I love this write up. Not least for the references to (& photo of!) Bill Gates at SC05, almost 20 years ago, showing off a #windows #hpc capability that somewhat lives in my current group at work :-)
Last week I published a post about 20 years of supercomputing in MATLAB blogs.mathworks.com/matlab/2024/...
It got a little lost in all the #SC24 chat so talking about it again :) #HPC
It got a little lost in all the #SC24 chat so talking about it again :) #HPC
blogs.mathworks.com
November 29, 2024 at 8:18 AM
Reposted by Karl Podesta
Thank you for the shout out @underfox3.bsky.social.
Thomas Jakobsche - the lead author and my soon to graduate PhD student will be happy to learn about it.
@dmi-hpc.bsky.social
#HPC #Security @unibasel.bsky.social
Thomas Jakobsche - the lead author and my soon to graduate PhD student will be happy to learn about it.
@dmi-hpc.bsky.social
#HPC #Security @unibasel.bsky.social
In this paper, researchers have presented an exploration of fuzzy hashing to classify #HPC application executables, inspired by malware detection techniques.
arxiv.org/pdf/2411.18327
arxiv.org/pdf/2411.18327
November 28, 2024 at 11:45 AM
Thank you for the shout out @underfox3.bsky.social.
Thomas Jakobsche - the lead author and my soon to graduate PhD student will be happy to learn about it.
@dmi-hpc.bsky.social
#HPC #Security @unibasel.bsky.social
Thomas Jakobsche - the lead author and my soon to graduate PhD student will be happy to learn about it.
@dmi-hpc.bsky.social
#HPC #Security @unibasel.bsky.social
Reposted by Karl Podesta
New supercomputer, new record-breaking HACC run. This job ran a single job over 9,000 nodes on Frontier—an impressive feat, and a proof point that Frontier is prime time.
https://buff.ly/3CRqMH1
#HPC
https://buff.ly/3CRqMH1
#HPC
Record-breaking run on Frontier sets new bar for simulating the universe in exascale era
The universe just got a whole lot bigger—or at least in the world of computer simulations, that is. In early November, researchers at the Department of Energy's Argonne National Laboratory used the…
buff.ly
November 28, 2024 at 4:04 PM
New supercomputer, new record-breaking HACC run. This job ran a single job over 9,000 nodes on Frontier—an impressive feat, and a proof point that Frontier is prime time.
https://buff.ly/3CRqMH1
#HPC
https://buff.ly/3CRqMH1
#HPC
Reposted by Karl Podesta
Call for proposals for the HPC, Big Data, and Data Science devroom at the #FOSDEM’25 open source “conference” taking place in Brussels during the weekend of 1-2 Feb 2025 is still open!
hpc-bigdata-fosdem25.github.io
Submission deadline Sunday 1 Dec 2024.
#HPC community: help us spread the word!
hpc-bigdata-fosdem25.github.io
Submission deadline Sunday 1 Dec 2024.
#HPC community: help us spread the word!
FOSDEM'25 HPC, Big Data, and Data Science Devroom
FOSDEM'25 HPC, Big Data, and Data Science Devroom
hpc-bigdata-fosdem25.github.io
November 27, 2024 at 3:26 PM
Call for proposals for the HPC, Big Data, and Data Science devroom at the #FOSDEM’25 open source “conference” taking place in Brussels during the weekend of 1-2 Feb 2025 is still open!
hpc-bigdata-fosdem25.github.io
Submission deadline Sunday 1 Dec 2024.
#HPC community: help us spread the word!
hpc-bigdata-fosdem25.github.io
Submission deadline Sunday 1 Dec 2024.
#HPC community: help us spread the word!
Reposted by Karl Podesta
The #HPC starter pack has been used by many people new to BlueSky who want to immediately start following a decent cross-section of the HPC community
go.bsky.app/7NSBuP1
go.bsky.app/7NSBuP1
November 25, 2024 at 8:50 PM
The #HPC starter pack has been used by many people new to BlueSky who want to immediately start following a decent cross-section of the HPC community
go.bsky.app/7NSBuP1
go.bsky.app/7NSBuP1
I enjoy these live learning sessions with two of Microsoft’s most entertaining (techie!) celebrities.
My session with @scott.hanselman.com on responsible AI (with a lot of often humorous irresponsible AI demos) is now posted: My session on responsible AI (full of irresponsible AI) with Scott Hanselman is now posted:
Scott and Mark learn responsible AI | BRK329
YouTube video by Microsoft Events
youtu.be
November 25, 2024 at 9:42 PM
I enjoy these live learning sessions with two of Microsoft’s most entertaining (techie!) celebrities.
The #azure section here makes a great call out for some relevant #HPC things not mentioned by Microsoft at #SC24!
In particular:
- Da/Ea/Fa v6 VMs
- Spot placement score
- Attribute VM select in Fleet
But also missed:
- ND GB200 v6 VM release!
In particular:
- Da/Ea/Fa v6 VMs
- Spot placement score
- Attribute VM select in Fleet
But also missed:
- ND GB200 v6 VM release!
November 24, 2024 at 11:28 PM
Reposted by Karl Podesta
Some #HPC fun for you all after #SC24 #supercomputing ...
Test yourself with this quiz from our SC24 Tutorial "Delivering HPC: Procurement, Cost Models, Metrics, Value & More"
No prizes, merely fun.
Feel free to post your scores.
forms.office.com/r/YSM7avEwFk
Test yourself with this quiz from our SC24 Tutorial "Delivering HPC: Procurement, Cost Models, Metrics, Value & More"
No prizes, merely fun.
Feel free to post your scores.
forms.office.com/r/YSM7avEwFk
November 23, 2024 at 5:43 PM
Some #HPC fun for you all after #SC24 #supercomputing ...
Test yourself with this quiz from our SC24 Tutorial "Delivering HPC: Procurement, Cost Models, Metrics, Value & More"
No prizes, merely fun.
Feel free to post your scores.
forms.office.com/r/YSM7avEwFk
Test yourself with this quiz from our SC24 Tutorial "Delivering HPC: Procurement, Cost Models, Metrics, Value & More"
No prizes, merely fun.
Feel free to post your scores.
forms.office.com/r/YSM7avEwFk