is there a llama.cpp version?

[lucasjinreal]

is there a llama.cpp version?

[zhjohnchan]

Hi @lucasjinreal,

Thanks for your attention.

Yes, we are working on the bloom.cpp and llama.cpp versions. Stay tuned! :-)

Best, Zhihong

[lucasjinreal]

Awesome! looking forward to it!