Roy
@roymiles.bsky.social
Research Scientist @Noah's Ark Lab, Huawei
PhD Imperial College London roymiles.github.io
Working on multi-modality and efficient ML
PhD Imperial College London roymiles.github.io
Working on multi-modality and efficient ML
Hey! I will be at NeurIPS @neuripsconf.bsky.social this week (friday 13th) presenting our paper VeLoRA.
tldr; simple method for compressing gradients with a coarse reconstruction during the backwards pass. Significant memory reductions while being complimentary to LoRA!
github.com/roymiles/VeL...
tldr; simple method for compressing gradients with a coarse reconstruction during the backwards pass. Significant memory reductions while being complimentary to LoRA!
github.com/roymiles/VeL...
December 9, 2024 at 2:13 PM
Hey! I will be at NeurIPS @neuripsconf.bsky.social this week (friday 13th) presenting our paper VeLoRA.
tldr; simple method for compressing gradients with a coarse reconstruction during the backwards pass. Significant memory reductions while being complimentary to LoRA!
github.com/roymiles/VeL...
tldr; simple method for compressing gradients with a coarse reconstruction during the backwards pass. Significant memory reductions while being complimentary to LoRA!
github.com/roymiles/VeL...