ChatGLM-Tuning icon indicating copy to clipboard operation
ChatGLM-Tuning copied to clipboard
verified publisher icon mymusise

怎么使用训练好的lora做int8推理？

Open Minami-su opened this issue 2 years ago • 1 comments

Minami-su avatar Mar 25 '23 01:03 Minami-su

感觉用了loara比原版慢了很多，我的是V100

xuguozhi avatar Mar 31 '23 02:03 xuguozhi