adogwangwang
adogwangwang
hello friends, I am deploying the llava model on k8s, but when it run ,it can only launch a server at 127.0.0.1:8080, I have tried add --host 0.0.0.0 ,but it...
@abetlen Hello, when I use python -m llama_cpp.server deployed a llava13b service on the Kubernetes platform, I noticed an issue where only the first image could be correctly returned. When...
When I start the llava13b model using the llama-cpp-python server, I notice that the GPU memory usage increases a little after each inference, which suggests that the GPU memory is...
Can you provide some examples of data formats for training pretrain, reranker, and retriever models? I have no concept of this. Thanks!
hello，thanks for your efforts, I have problems with training efficiency, how long time it takes to train your Tokenizer with your data? I have been training a tokenizer for a...
### Search before asking - [X] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar issues. ### Operating system information Linux ### Python version information >=3.11 ### DB-GPT version...
### Search before asking - [X] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar issues. ### Operating system information Linux ### Python version information >=3.11 ### DB-GPT version...
### Is there an existing issue for the same bug? - [X] I have checked the existing issues. ### Branch name 0.10.0 ### Commit ID e18f407 ### Other environment information...
### Is there an existing issue for the same bug? - [X] I have checked the existing issues. ### Branch name 0.10.0 ### Commit ID e18f407 ### Other environment information...