Daniel Han

Oh ye converting it to AWQ takes a lot of time!!

That is a fantastic idea! Approximately: Mistral 7b: Min 6-8GB VRAM Llama-3 8b: Min 8-12GB VRAM Gemma 2b: Min 8GB VRAM Gemma 7b: Min 12GB VRAM Llama-2 7b: Min 8GB...

Yes should work!

Oh wait windows correct?

Sorry on the issue! I'll see what I can do!

Oh so sorry this got buried - I'll recheck the issue

@farzad-845 I'm assuming you did not connect a GPU?  Are you using L4, T4? Maybe it doesn't say anything?

@jorgemcgomes Oh kinda forgot to reply here! @young-geng Congrats on the new release of v2! Trying it out right now :) Can see both the multiple spaces issue is fixed...

Hmmm unsure actually - its possible you can try using an older Unsloth version which might work

But unsure - I remember some people managed to make it work