GeoLoRA: Geometric integration for parameter efficient fine-tuning

Steffen Schotthöfer, Emanuele Zangrando, Gianluca Ceruti, Francesco Tudisco, Jonas Kusch
preprint, (2022)
arxiv

Geometry-aware training of factorized layers in tensor Tucker format

Emanuele Zangrando, Steffen Schotthöfer, Jonas Kusch, Gianluca Ceruti, Francesco Tudisco
Advances in Neural Information Processing Systems (NeurIPS), (2024)
arxiv

Neural rank collapse: Weight decay and small within-class variability yield low-rank bias

Emanuele Zangrando, Piero Deidda, Simone Brugiapaglia, Nicola Guglielmi, Francesco Tudisco
preprint, (2024)
arxiv

Robust low-rank training via approximate orthonormal constraints

Dayana Savostianova, Emanuele Zangrando, Gianluca Ceruti, Francesco Tudisco
Advances in Neural Information Processing Systems (NeurIPS), (2023)
arxiv doi code

Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations

Steffen Schotthöfer, Emanuele Zangrando, Jonas Kusch, Gianluca Ceruti, Francesco Tudisco
Advances in Neural Information Processing Systems (NeurIPS), (2022)
arxiv doi code