blog icon indicating copy to clipboard operation
blog copied to clipboard

Provide an estimate of costs incurred when following steps in 'Non-engineers guide: Train a LLaMA 2 chatbot'

Open lovestulip opened this issue 2 years ago • 0 comments

Following the great guide: https://huggingface.co/blog/Llama2-for-non-engineers

I've noticed in the guide that for a first-time user who wants to follow the blog steps exactly, using the recommended 'A10G Large' backend, the same model (Meta’s Llama 2 7b foundation model), and even the provided Alpaca instruction tuning dataset, the pricing is listed as '$0.0525/minute.' However, it's not clear how long the training process might take or if there is an option to abort the job if it becomes too cost-intensive. An estimate of how much it might cost when following the exact steps would be immensely helpful. Additionally, guidance on how to abort the job if it is running for days and accumulating significant costs, which can really add up, would also be greatly appreciated. Thank you for addressing this concern!

lovestulip avatar Nov 07 '23 20:11 lovestulip