Do you support miqu?

[runvnc]

Feature request

Support the 'miqu' model.

Motivation

I am not sure if mique is actually the Mistral or Mixtral architecture or something else, but supposedly it may be the best model right now.

Your contribution

I am submitting a PR and can try it out if it becomes available. I appreciate what you do.

[tgaddair]

Hey @runvnc, do you have a link to the HF model? There seem to be a few Miqu variants out there, but all of them I've found are in GGUF. It's possible we support it if it's just a Mixtral variant, but not sure.

[runvnc]

@tgaddair no sorry, thanks for searching for that, did not realize.. what pops up is like 2 bits or something.