Question about exporting Mamba models to GGUF format for Ollama deployment

[zhaohm14]

I am interested in deploying mamba within the Ollama framework. I was wondering if thers's a way to export Mamba models to GGUF format, or if there are any recommended methods for doing so. Thanks a lot!

[tridao]

I'm not familiar with the GGUF format but perhaps others might be able to help.

[supersonictw]

https://github.com/ollama/ollama/issues/3023

[zhaohm14]

ollama/ollama#3023

Thanks a lot