LoRA
LoRA copied to clipboard
Layers.py not being executed
Hi,
I made some changes to the layers.py, however on running the mrpc task on roberta_base, it seems that init() and forward() of the linear layers is not being called at all. I added some print statements inside the forward function to verify this.
In fact, the modeling_roberta.py file is not imported at all which is responsible for importing loralib.
When I ran the model the first time there was some progess bar with "Map" written beside it which was not there in the subsequent runs. Maybe the loralib was read the first time and the model was stored. In all subsequent runs the stored model was run.
Kindly provide guidance.