Bias and ReLU Linear adapter

[hanoonaR]

Hi Authors,

Thank you for sharing your great work. I have a question related to the linear adapter proposed in the paper for Phase B. The paper describes the linear adapter to have a bias and is followed by ReLU activation.

However, in your model description, it is just a linear layer with no bias and activation. Could you please share the best configuration of the linear adapter that helped in your experiments?

Thank you.