OpenDelta icon indicating copy to clipboard operation
OpenDelta copied to clipboard

Error report: not implemented (When run prefix on gpt2)

Open yushengsu-thu opened this issue 1 year ago • 0 comments

When performing prefix on gpt-2, it will report error: not implemented. I think that's because the pre-fix module is not recognized as GPTAttention in new_modules_like function (director: delta_modules/prefix.py).

yushengsu-thu avatar Feb 06 '23 15:02 yushengsu-thu