LLMFarm icon indicating copy to clipboard operation
LLMFarm copied to clipboard

App crashes when running fine tune on Llama-3

Open kebbbnnn opened this issue 1 year ago • 1 comments

App crashes when I run fine tune on Llama-3 model but works perfectly when I try on tinyllama:

Thread 16: EXC_BAD_ACCESS (code=2, address=0x16b5a7c40)

Screenshot 2024-05-17 at 11 25 02 AM

Screenshot 2024-05-17 at 11 26 21 AM

info of my machine:

mac: mac mini m1 2020 ram: 8GB os: ventura 13.6 Xcode: Xcode 15.1

kebbbnnn avatar May 17 '24 03:05 kebbbnnn

I think it has to do with lack of memory. Llama3 is too big for finetune on your Mac. Try openllama 3b.

guinmoon avatar May 17 '24 14:05 guinmoon