Associate Professor (Reader) in Machine Learning
School of Mathematics, The University of Edinburgh
The Maxwell Institute for Mathematical Sciences
Alan Turing Institute | Bayes Centre | Gen AI Lab
School of Mathematics, Gran Sasso Science Institute
email: f dot tudisco at ed.ac.uk
🚀 Excited to share that our paper Geometry-aware training of factorized layers in tensor Tucker format has been accepted at NeurIPS 2024!
A huge thanks to an amazing team of collaborators and especially to my student Emanuele Zangrando, first author, for their outstanding work. Together, we explored a novel training approach for Tucker-decomposed neural network layers, which dynamically adjusts ranks during training and achieves high compression rates without sacrificing performance.
Looking forward to presenting this and discussing it with the community at NeurIPS!