ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard
verified publisher icon hpcaitech

[BUG]: LazyInitContext can not initialize huggingface GPT model

Open feifeibear opened this issue 3 years ago • 1 comments

🐛 Describe the bug

I use LazyInitContext to initialize a GPT model and then call ctx.lazy_init_parameters to initialize the model. I encounter an assert error. So, right now, the model initialized by LazyInitContext can not be correctly initialized.

We will leave this bug for future research!

Environment

No response

feifeibear avatar Nov 11 '22 08:11 feifeibear

https://github.com/hpcaitech/ColossalAI/pull/1897 https://github.com/hpcaitech/ColossalAI/pull/1937

feifeibear avatar Nov 14 '22 07:11 feifeibear

We have updated a lot. This issue was closed due to inactivity. Thanks.

binmakeswell avatar Apr 13 '23 10:04 binmakeswell