Question About Geometric Parametrization

[mat10599]

Hello,

Thanks for your amazing work,

I am currently fine-tuning a CoCa model leveraging the pre-trained weights. I did not understand if we can transform the pre-trained weights into their geometric parametrization, or if we need to train the CLIP model from scratch in geometric parametrization form. Are the two parametrizations in this sense "equivalent" ?

Thanks,

Mathieu