Hannah Sterz
Hannah Sterz
Fixes a bug that was prevent embeddings from training properly and changes the test to catch that in the future.
To make the model_config serializable and prevent the error mentioned in #680 move the costum_heads dictionary out of the config and make it a separate attribute of the model class.
I was training and saving REFT modules for the RoBERTa model. But loading them seems to be not possible with the current implementation. I get the following Error: ``` Traceback...