How to apply this methods to a new LMs without fine-tune, like a bert?

[sev777]

Hi, In your paper, does the model edited in ROME or MEND methods must be fine-tuned? How to apply the ROME to the model without fine-tuning ? For example, the bert model is not just the GPTs series.

Thanks.

[huu4ontocord]

Same question. How to apply to t5. I see that the MEND algorithm can be applied to t5, but not ROME.

[Wanglvcheng]

我也想问这个问题