Beckett Dillon

So I've been trying to work on this problem and think I have found a solution but am not nearly skilled enough to pull it off. There has been a...

this is awesome! thank you so much for putting this together, I was working on trying to do the same for my own projects. You just did it a million...

Jumping in to add some results on trying to quant smaller than Q8_0. So far, any of the standard Jamba models (52B) and the smaller community-built models can be converted...

@compilade I tried out the latest changes and the further quant into q6_k works! I haven't tried the others but will do so and let you know ```bash main: built...

Just checking to see if anyone has come close to getting Jamba working here. I've been working on figuring out fine-tuning and training on some new general chat Jamba models...

@compilade Thank you so much for taking this on. I have been trying on my own but failing miserably to get Jamba quantizied with llama.cpp I have been prepping by...

Incredible! Thank you so much for putting in the work to get this running and updating us with the news. I will give this a try this weekend and report...

> [@dosu](https://github.com/dosu) I have reinstalled all plugins and the error has changed. Now I get the following error: > > Failed to transform agent message: PluginInvokeError: {"args":{},"error_type":"ValidationError","message":"1 validation error for...