OpenChatKit icon indicating copy to clipboard operation
OpenChatKit copied to clipboard

Published 20 hours ago • verified publisher icon togethercomputer

What is minimum resource requirement to fine-tuning Llama-2-7B-32K-beta model.

Open zzbin0 opened this issue 11 months ago • 0 comments

Hi, What is minimum resource requirement to fine-tuning Llama-2-7B-32K-beta model with finetune_llama-2-7b-32k-mqa.sh script. Such as disk, memory and vRAM. Look forward to your response. Best regards.

zzbin0 avatar Mar 25 '24 02:03 zzbin0