OpenDelta
OpenDelta copied to clipboard
Error report: not implemented (When run prefix on gpt2)
When performing prefix on gpt-2, it will report error: not implemented. I think that's because the pre-fix module is not recognized as GPTAttention in new_modules_like function (director: delta_modules/prefix.py).