Eric Skiff comments

Repositories
Issues
Comments

Results 3 comments of


                                            Eric Skiff

Can we finetune existing models via the ideas of QLORA

I've got a Mac Studio with M2 Ultra and 192 GB as of yesterday and I'm very interested in this topic. The debate between fine tuning on internal documents vs...

[Feature Request] llama.cpp connection

Following up on this issue, I believe this is now working and complete. I am running llama.cpp with the --api flag, I load the model via the llama.cpp web UI,...

[Feature Request] llama.cpp connection

Oh my gosh. You're absolutely right. I got this working a few nights ago and forgot I got it working by going through oobabooga. Apologies, disregard my comment!