Speedway1
Speedway1
It would need to catch the exceptions to do that but yes, that's a great solution. This way avoids the exception in the first place. But of course other exceptions...
OK brilliant. I will give it some thought and come back to you on this. Thank you for creating such a brilliant tool. It's absolutely fantastic.
Second that. Jamba 1.5 looks like it's filling a very unique space. WOuld be great to have this supported.
Just a head's up that the problem of generating garbage with >1 AMD GPUs is still an issue. Something broke a few versions of Ollama ago because it used to...
Hi @renbuarl , I think that the problem there is your massive context length. It takes a lot of VRAM. Here is a simple bit of bash that we run...