Edd Wilder-James
banner
ewj.me
Edd Wilder-James
@ewj.me
Reposted by Edd Wilder-James
Up first: Cloud Storage Connector for PyTorch. If you’re using GCS and PyTorch, this project wants to help speed up your training. Promising POC benchmarks, and you can save and load checkpoints directly to your GCS buckets: github.com/GoogleCloudP...

@googledevs.bsky.social
GitHub - GoogleCloudPlatform/dataflux-pytorch: The Cloud Storage Connector for PyTorch is an effort to improve ML-training efficiency when using data stored in GCS for training datasets. Using the Con...
The Cloud Storage Connector for PyTorch is an effort to improve ML-training efficiency when using data stored in GCS for training datasets. Using the Connector for PyTorch for training is up to 3X ...
github.com
November 16, 2024 at 12:35 AM
Well @penaddict.bsky.social is a great start, I wonder who else?
October 23, 2024 at 7:18 PM