LLaMA-Factory icon indicating copy to clipboard operation
LLaMA-Factory copied to clipboard

Published 20 hours ago • verified publisher icon hiyouga

model_args.low_cpu_mem_usage设成true和false导出的模型不一致

Open fst813 opened this issue 11 months ago • 4 comments

Reminder

  • [X] I have read the README and searched the existing issues.

Reproduction

如题

Expected behavior

No response

System Info

No response

Others

No response

fst813 avatar Mar 15 '24 07:03 fst813

详细描述下

hiyouga avatar Mar 15 '24 07:03 hiyouga

@hiyouga 把low_cpu_mem_usage设成true和false时，导出模型的md5值不一样。

fst813 avatar Mar 15 '24 07:03 fst813

推理行为呢？

hiyouga avatar Mar 15 '24 08:03 hiyouga

推理暂时未验证

fst813 avatar Mar 15 '24 08:03 fst813

我用--low_cpu_mem_usage导出后推理结果不一致 @hiyouga

lijihua2017 avatar Apr 02 '24 09:04 lijihua2017