PaddleNLP Electra 模型增加对输入 `past_key_values` 和 `inputs

Electra 模型增加对输入 `past_key_values` 和 `inputs_embeds` 的支持

Open guoshengCS opened this issue 3 years ago • 4 comments

Electra 模型增加对输入 past_key_values 和 inputs_embeds 的支持。可以参考 ERNIE 中对应的代码

通过 past_key_values 和 inputs_embeds 输入可以支持 Prefix-Tuning、P-Tuning这样一些工作。

Sep 28 '22 08:09 guoshengCS

Hi @guoshengCS. I'll be happy to take this. Would you assign this to me?

Oct 01 '22 07:10 sijunhe

I will break past_key_values and inputs_embeds into two separate PRs for easy reviews. The PR for inputs_embeds is ready for review at #3401

Oct 01 '22 09:10 sijunhe

#3411 ready for review as well

Oct 08 '22 17:10 sijunhe

I'll be happy to take this. Would you assign this to me? I will break past_key_values and inputs_embeds into two separate PRs for easy reviews.

Good start and no problem ! And sorry for the missing of messages in holidays.

Oct 11 '22 03:10 guoshengCS

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动，被标记为stale。

Dec 11 '22 00:12 github-actions[bot]