The simplest alternative to LoRA is to use SVD on the model's weight matrices, then fine-tune the singular values directly. Oddly, this is the most recent technique, called SVF, published in the Transformers² paper (arxiv.org/abs/2501.06...).

The NYT published a bizarre religious article on the Pentium division bug exactly 30 years ago today: "Pentium and Our Crisis of Faith." It argued that you need to have faith in a computer's results, so the Pentium bug was like Martin Luther's Protestant revolt.

www.nytimes.com/1994/12/28/o...