SpQR
SpQR copied to clipboard
Vahe1994
Process killed after eval phase
I did try running the code from your repository; however, when I attempted to add the --save_safetensors feature, the process was interrupted after performing the evaluation. I didn't encounter any issues regarding permissions or memory problems. Do you think there might be an issue here?
Hello! Hard to tell. Can you please send the logs of the run? What was the error message?
Hello! Hard to tell. Can you please send the logs of the run? What was the error message?
I don't keep a log, but what I see is that the message before everything stops is just 1 line "Killed"
Are you running on Linux ? Try to increase the swap size, most times linux just print "Killed" if running out of CPU memory
Are you running on Linux ? Try to increase the swap size, most times linux just print "Killed" if running out of CPU memory
Hmm, looks like the problem I'm having is that I'm trying to convert model 7b to a personal computer. @Vahe1994 So can you provide specific configuration with CPU should have to convert 1 model 7b? I see that everything is only using the CPU so I also wonder why we don't use the GPU?