FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Published 20 hours ago • verified publisher icon lm-sys

bfloat16 on GuanacoAdapter

Open abcbdf opened this issue 2 years ago • 0 comments

Currently, FastChat use float16 instead of bfloat16 on Guanaco model, which is different from https://github.com/artidoro/qlora. I'm wondering what influence this difference will cause. Thanks.

abcbdf avatar Jun 15 '23 07:06 abcbdf