XHPlus

Oh, I just find the early similar issues. But it would be better if there was a makefile sulotion!

Thanks , i have read the issue #2. In fact, i run the program step by step as listed in scripi-simple.sh rather than directly run the script-simple.sh. When　I did...

As for the model file format, we have not tested GGML/GGUF up to now. What is the motivation to use these formats?

Thanks for your great PR! We are refactoring part of our code and will merge your PR as soon as the refactored version is ready. Besides, hope to add a...

Also welcome a contribution from the community, thanks!

If you deploy LightLLM with K8S, you can directly utilize the native load balance ability of K8S infra, such as starting multiple pods in K8S.