Riemannian Optimization

RiemannLoRA: A Unified Riemannian Framework for Ambiguity-Free LoRA Optimization

RiemannLoRA places LoRA updates on the manifold of rank-r matrices, erasing factorization ambiguity: half the fine-tuning steps and up to 1.2 BLEU more.