kerlion comments

Repositories
Issues
Comments

Results 14 comments of


                                            kerlion

> [@kerlion](https://github.com/kerlion) What version of llama-cpp-python are you using? Can you also give me some inside about your platform (OS, etc). image: nvidia/cuda:12.2.0-runtime-ubuntu22.04 llama_cpp_python 0.3.8

Llama 4 not working

I compiled it from the source code, passed this error. But I do not know which "chat_format" to use? Llama-4-Scout-17B-16E-Instruct-UD-Q2_K_XL

InternVL3_5-30B-A3B部署失败

PLS update your LMDeploy to v0..10.0+ for InternVL3_5.