LLaMA-Factory icon indicating copy to clipboard operation
LLaMA-Factory copied to clipboard

Request for documented Hardware Requirement memory estimates for training 8B models

Open jim-plus opened this issue 10 months ago • 0 comments

Reminder

  • [X] I have read the README and searched the existing issues.

Reproduction

View https://github.com/hiyouga/LLaMA-Factory README.md Look up Hardware requirements, checking between 7B and 13B columns

Expected behavior

Curious if 8B uses significantly more VRAM or not

System Info

Any browser or text editor

Others

No response

jim-plus avatar Apr 22 '24 16:04 jim-plus