hpcaitech
[BUG]: 运行chatgpt推理示例报错
🐛 Describe the bug
(https://github.com/hpcaitech/ColossalAI/tree/main/applications/ChatGPT)/examples/ 运行inference.py 抛出OSError:
Environment
No response
Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑🤝🧑👫🧑🏿🤝🧑🏻👩🏾🤝👨🏿👬🏿
Title: [BUG]: Run the chatgpt reasoning example and report an error
Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑🤝🧑👫🧑🏿🤝🧑🏻👩🏾🤝👨🏿👬🏿
Same
Hi @peng06051126 @hurun @JingxinLee Thanks for reminding. Sorry for the trouble. We have fixed it.
Please refer to the screenshot to check if there is any problem with the inference code. I see that you only modified README.md.
Please refer to the screenshot to check if there is any problem with the inference code. I see that you only modified README.md.
Sorry, We are also fixing the bug of code.
still error：
size mismatch for transformer.ln_f.weight: copying a param with shape torch.Size([768]) from checkpoint, the shape in current model is torch.Size([64]). size mismatch for transformer.ln_f.bias: copying a param with shape torch.Size([768]) from checkpoint, the shape in current model is torch.Size([64]). size mismatch for lm_head.weight: copying a param with shape torch.Size([50257, 768]) from checkpoint, the shape in current model is torch.Size([250880, 64]).
params： parser.add_argument('--model', default='bloom', choices=['gpt2', 'bloom', 'opt']) parser.add_argument('--pretrain', type=str, default='./actor_checkpoint_prompts.pt')
