@matthieucord.bsky.social
Reposted
We’re just scratching the surface of the "big models + raw video + closed-loop sim" stack.
More to come! 🚀
Retweet if you’re excited, and follow @valeoai.bsky.social for updates! 💚
🙏 Thanks for reading!
[10/10]
More to come! 🚀
Retweet if you’re excited, and follow @valeoai.bsky.social for updates! 💚
🙏 Thanks for reading!
[10/10]
February 24, 2025 at 12:53 PM
We’re just scratching the surface of the "big models + raw video + closed-loop sim" stack.
More to come! 🚀
Retweet if you’re excited, and follow @valeoai.bsky.social for updates! 💚
🙏 Thanks for reading!
[10/10]
More to come! 🚀
Retweet if you’re excited, and follow @valeoai.bsky.social for updates! 💚
🙏 Thanks for reading!
[10/10]
Reposted
After 6+ months in the making and over a year of GPU compute, we're excited to release the "Ultra-Scale Playbook": hf.co/spaces/nanot...
A book to learn all about 5D parallelism, ZeRO, CUDA kernels, how/why overlap compute & coms with theory, motivation, interactive plots and 4000+ experiments!
A book to learn all about 5D parallelism, ZeRO, CUDA kernels, how/why overlap compute & coms with theory, motivation, interactive plots and 4000+ experiments!
The Ultra-Scale Playbook - a Hugging Face Space by nanotron
The ultimate guide to training LLM on large GPU Clusters
hf.co
February 19, 2025 at 6:10 PM
After 6+ months in the making and over a year of GPU compute, we're excited to release the "Ultra-Scale Playbook": hf.co/spaces/nanot...
A book to learn all about 5D parallelism, ZeRO, CUDA kernels, how/why overlap compute & coms with theory, motivation, interactive plots and 4000+ experiments!
A book to learn all about 5D parallelism, ZeRO, CUDA kernels, how/why overlap compute & coms with theory, motivation, interactive plots and 4000+ experiments!