Umut Ay
Any progress on this? I was hoping to consume a more streamlined api via ollama
@Aunali321 could you share a bit more about your solution? I have a 5090 but am having a hard time running Unsloth scripts on it.
@Aunali321 I have a server with 5090 on it. I also self hosted Colab and connected my local machine to Unsloth Colab notebooks. Here is what happens when I try...
I just used QLoRA instead. Works fast, results were good.