Torsten Hoefler 🇨🇭
@thoefler.bsky.social
Professor ETHZ, head of SPCL, Chief Architect ML at CSCS researching large-scale #HPC and #AI systems and #Climate computing - youtube: http://bit.ly/3h1VgIU
It's always exciting when research topics receive attention on national TV. CNA, one of Asia's premier TV stations reports on Singapore's $1bn AI for Science and highlights our AI for Health collaboration with Ben Helgason and Bryan Tan, part of my AI Visiting Professorship!
Watch: buff.ly/28Ck77Q
Watch: buff.ly/28Ck77Q
February 5, 2026 at 5:10 AM
It's always exciting when research topics receive attention on national TV. CNA, one of Asia's premier TV stations reports on Singapore's $1bn AI for Science and highlights our AI for Health collaboration with Ben Helgason and Bryan Tan, part of my AI Visiting Professorship!
Watch: buff.ly/28Ck77Q
Watch: buff.ly/28Ck77Q
🔬⚙️ Big opportunity in materials science + #HPC at ADIA Lab — ideal for experts advancing computational materials research, high‑performance simulations, and data‑driven discovery.
Explore the role: buff.ly/dMvhjKL
Horst Simon, Amelie Koch, and the whole ADIA Lab team are great.
A unique chance!
Explore the role: buff.ly/dMvhjKL
Horst Simon, Amelie Koch, and the whole ADIA Lab team are great.
A unique chance!
ADIA Lab - Senior Computational Scientist - Material Sciences - Abu Dhabi Investment Authority
ADIA Lab, an independent research institution based in Abu Dhabi specializing in data and computational sciences, is seeking a Senior Computational Scientist with a focus on Material Sciences. This…
jobs.adia.ae
January 31, 2026 at 2:50 PM
🔬⚙️ Big opportunity in materials science + #HPC at ADIA Lab — ideal for experts advancing computational materials research, high‑performance simulations, and data‑driven discovery.
Explore the role: buff.ly/dMvhjKL
Horst Simon, Amelie Koch, and the whole ADIA Lab team are great.
A unique chance!
Explore the role: buff.ly/dMvhjKL
Horst Simon, Amelie Koch, and the whole ADIA Lab team are great.
A unique chance!
I'll be there as well :-)
AI4X–Accelerate Conference 2026 abstracts have been extended until February 9 (final extension).
Join us in Singapore, June 15–19, 2026.
Submit: ai4x.cc/call-for-sub...
Join us in Singapore, June 15–19, 2026.
Submit: ai4x.cc/call-for-sub...
January 31, 2026 at 2:43 PM
I'll be there as well :-)
Rio Yokota on the #SCA2026 fishbowl panel: "I don't think humans are in any way more trustworthy than an advanced AI" - "In the same way we trust other humans, we could develop trust to AIs" - "If people or AI generate code - how do we know there is no bug inside?" profound thoughts by a wise man.
January 28, 2026 at 2:35 AM
Rio Yokota on the #SCA2026 fishbowl panel: "I don't think humans are in any way more trustworthy than an advanced AI" - "In the same way we trust other humans, we could develop trust to AIs" - "If people or AI generate code - how do we know there is no bug inside?" profound thoughts by a wise man.
Reposted by Torsten Hoefler 🇨🇭
Great talk as always by @thoefler.bsky.social - fully of enthusiasm with mix of technical and asides - but we need to have a chat about legibility of your slides! 😁 (Eg red text on green background)
January 27, 2026 at 1:17 AM
Great talk as always by @thoefler.bsky.social - fully of enthusiasm with mix of technical and asides - but we need to have a chat about legibility of your slides! 😁 (Eg red text on green background)
Reposted by Torsten Hoefler 🇨🇭
Keynote at #SCAsia / #HPC Asia
@thoefler.bsky.social being introduced by Rio Yokota
#UltraEthernet for Next Generation #AI and #HPC workloads
@thoefler.bsky.social being introduced by Rio Yokota
#UltraEthernet for Next Generation #AI and #HPC workloads
January 27, 2026 at 12:53 AM
Keynote at #SCAsia / #HPC Asia
@thoefler.bsky.social being introduced by Rio Yokota
#UltraEthernet for Next Generation #AI and #HPC workloads
@thoefler.bsky.social being introduced by Rio Yokota
#UltraEthernet for Next Generation #AI and #HPC workloads
On the way to SCAsia 2026 in Japan! I'm honored to present the opening keynote to this year's record attendance of more than 2,500 people :-).
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
January 26, 2026 at 2:42 AM
On the way to SCAsia 2026 in Japan! I'm honored to present the opening keynote to this year's record attendance of more than 2,500 people :-).
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
Exciting Singapore AI Research Week Gala Dinner. I was honored to spend an insightful evening sitting next to the guest of honor - Josephine Teo, Minister for Digital Development and Information. A remarkable person!
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
January 25, 2026 at 6:30 AM
Exciting Singapore AI Research Week Gala Dinner. I was honored to spend an insightful evening sitting next to the guest of honor - Josephine Teo, Minister for Digital Development and Information. A remarkable person!
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
Our discussion of challenged and opportunities with in-network collective communication for #AI has been featured in IEEE Computer's January issue 📖. Check out page 24ff!
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
January 21, 2026 at 5:00 AM
Our discussion of challenged and opportunities with in-network collective communication for #AI has been featured in IEEE Computer's January issue 📖. Check out page 24ff!
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
🌍 Shape the future of HPC for Climate Research in Germany!
Uni Hamburg is hiring a director for computing center—advancing large‑scale simulations, data‑intensive workflows, and cutting‑edge infrastructure for climate and earth system science.
Apply 👉 buff.ly/aF6wruR
#HPC #Climate #Supercomputing
Uni Hamburg is hiring a director for computing center—advancing large‑scale simulations, data‑intensive workflows, and cutting‑edge infrastructure for climate and earth system science.
Apply 👉 buff.ly/aF6wruR
#HPC #Climate #Supercomputing
Job advertisement
Faculties
www.uni-hamburg.de
January 19, 2026 at 6:41 AM
🌍 Shape the future of HPC for Climate Research in Germany!
Uni Hamburg is hiring a director for computing center—advancing large‑scale simulations, data‑intensive workflows, and cutting‑edge infrastructure for climate and earth system science.
Apply 👉 buff.ly/aF6wruR
#HPC #Climate #Supercomputing
Uni Hamburg is hiring a director for computing center—advancing large‑scale simulations, data‑intensive workflows, and cutting‑edge infrastructure for climate and earth system science.
Apply 👉 buff.ly/aF6wruR
#HPC #Climate #Supercomputing
I'm looking forward to speak about MDDI's #AI for #Climate at next week's Lorong AI meetup in Singapore next Tuesday!
Join us if you are around:
Join us if you are around:
AI for Climate Sciences · Luma
What would it actually take to build an AI climate scientist? Climate research already relies on large-scale simulations, physical models, and vast…
buff.ly
January 16, 2026 at 4:00 AM
The "best #GYSS25" came to an end. Ideas and experiences are still buzzing in my head 🧠.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
January 12, 2026 at 7:46 AM
The "best #GYSS25" came to an end. Ideas and experiences are still buzzing in my head 🧠.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
I am honored to be named IAS Lee Kong Chian Distinguished Professor at the Nanyang Technological University (NTU) Singapore and give a public lecture today 03.15 PM - 05.40 PM in SHHK Auditorium (HSS) at NTU.
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
January 6, 2026 at 11:15 PM
I am honored to be named IAS Lee Kong Chian Distinguished Professor at the Nanyang Technological University (NTU) Singapore and give a public lecture today 03.15 PM - 05.40 PM in SHHK Auditorium (HSS) at NTU.
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
I'm very much looking forward to my plenary lecture and fireside chat at the 10th iteration of the famous GYSS summit in Singapore.
buff.ly/aVKwfbc
A humbling experience as one of the 21 laureates and 350 attendees. Find me if you're here 😀.
buff.ly/aVKwfbc
A humbling experience as one of the 21 laureates and 350 attendees. Find me if you're here 😀.
Global Young Scientists Summit
The Global Young Scientists Summit in Singapore brings together bright young researchers and top scientific minds from around the world...
buff.ly
January 5, 2026 at 1:00 AM
I'm very much looking forward to my plenary lecture and fireside chat at the 10th iteration of the famous GYSS summit in Singapore.
buff.ly/aVKwfbc
A humbling experience as one of the 21 laureates and 350 attendees. Find me if you're here 😀.
buff.ly/aVKwfbc
A humbling experience as one of the 21 laureates and 350 attendees. Find me if you're here 😀.
Just as we start into the new year, our Ultra Ethernet tutorial with all background exceeds 1,000 views on youtube!
If you prefer reading: buff.ly/Pmq1Xrr
Opened by Saurabh Dighe and featuring Abdul Kabbani on Congestion Control!
📽️ buff.ly/UGvjR1N
Building future #AI and #HPC #networking!
If you prefer reading: buff.ly/Pmq1Xrr
Opened by Saurabh Dighe and featuring Abdul Kabbani on Congestion Control!
📽️ buff.ly/UGvjR1N
Building future #AI and #HPC #networking!
Ultra Ethernet for next-generation AI and HPC workloads
Host: Sujata Banerjee
Speakers: Torsten Hoefler, Microsoft and ETH Zurich; Abdul Kabbani, Microsoft
The Ultra Ethernet Consortium set out to redefine Ethernet-based interconnects for AI and…
buff.ly
January 2, 2026 at 6:00 AM
Just as we start into the new year, our Ultra Ethernet tutorial with all background exceeds 1,000 views on youtube!
If you prefer reading: buff.ly/Pmq1Xrr
Opened by Saurabh Dighe and featuring Abdul Kabbani on Congestion Control!
📽️ buff.ly/UGvjR1N
Building future #AI and #HPC #networking!
If you prefer reading: buff.ly/Pmq1Xrr
Opened by Saurabh Dighe and featuring Abdul Kabbani on Congestion Control!
📽️ buff.ly/UGvjR1N
Building future #AI and #HPC #networking!
A special memory of Piz Daint - once Europe's fastest and first large #GPU #supercomputer
After 13 years of service at #ETH #CSCS, it retired from service. Those two blades shall live on as a milestone in Swiss and European history!
Better than spatulas #nvidia? Enjoy the festive season 🎄 #AI #HPC
After 13 years of service at #ETH #CSCS, it retired from service. Those two blades shall live on as a milestone in Swiss and European history!
Better than spatulas #nvidia? Enjoy the festive season 🎄 #AI #HPC
December 26, 2025 at 6:00 AM
Switzerland, where you go with your hybrid car by electric train to the mountains 🏔️. Always cool.
Happy holidays! ❄️
Happy holidays! ❄️
December 24, 2025 at 7:42 AM
Switzerland, where you go with your hybrid car by electric train to the mountains 🏔️. Always cool.
Happy holidays! ❄️
Happy holidays! ❄️
Reposted by Torsten Hoefler 🇨🇭
With the year slowly winding down, we took a bit of time to get together, celebrate and reflect on the amazing 2025 journey and all the learnings and achievements during our Xmas dinner last Friday.🎄
Happy holidays & 2026, here we come!🚀🥳
#HPC #AI @thoefler.bsky.social @csateth.bsky.social
Happy holidays & 2026, here we come!🚀🥳
#HPC #AI @thoefler.bsky.social @csateth.bsky.social
December 22, 2025 at 8:04 AM
With the year slowly winding down, we took a bit of time to get together, celebrate and reflect on the amazing 2025 journey and all the learnings and achievements during our Xmas dinner last Friday.🎄
Happy holidays & 2026, here we come!🚀🥳
#HPC #AI @thoefler.bsky.social @csateth.bsky.social
Happy holidays & 2026, here we come!🚀🥳
#HPC #AI @thoefler.bsky.social @csateth.bsky.social
NVIDIA explains why they used FP8 as a scaling factor in NVFP and not MXFP-style E8M0.
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
December 22, 2025 at 6:00 AM
NVIDIA explains why they used FP8 as a scaling factor in NVFP and not MXFP-style E8M0.
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
Programming modern accelerators uses more and more complex forms of parallelism for example pipelining loading and computing at all levels.
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
December 17, 2025 at 6:00 AM
Programming modern accelerators uses more and more complex forms of parallelism for example pipelining loading and computing at all levels.
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
Jeff Hammond from NVIDIA gives some historical context on NCCL's lineage going back to MPI, similarly for NVSHMEM. #AI is rooted in a strong #HPC networking history!
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
December 15, 2025 at 6:00 AM
Jeff Hammond from NVIDIA gives some historical context on NCCL's lineage going back to MPI, similarly for NVSHMEM. #AI is rooted in a strong #HPC networking history!
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
Nice overview of PCIe 6.0 key metrics and development - a key goal was to not increase the latency by more than 10ns. Total FEC latency goal <2ns!
Watch: buff.ly/c9hBJcV
Watch: buff.ly/c9hBJcV
December 8, 2025 at 6:00 AM
Nice overview of PCIe 6.0 key metrics and development - a key goal was to not increase the latency by more than 10ns. Total FEC latency goal <2ns!
Watch: buff.ly/c9hBJcV
Watch: buff.ly/c9hBJcV
Ilya Sutskever: "Compression is prediction and vice versa." (15:10).
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
December 3, 2025 at 6:00 AM
Ilya Sutskever: "Compression is prediction and vice versa." (15:10).
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
I talked about a path towards an "AI Climate Scientist" at the ADIA Lab Symposium in Abu Dhabi and the Spanish Royal Academy in Madrid.
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
December 1, 2025 at 6:00 AM
I talked about a path towards an "AI Climate Scientist" at the ADIA Lab Symposium in Abu Dhabi and the Spanish Royal Academy in Madrid.
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf