qwen.cpp icon indicating copy to clipboard operation
qwen.cpp copied to clipboard

什么时候出server功能

Open AppleJunJiang opened this issue 2 years ago • 0 comments

类似llama.cpp的 ./server -m /models/ggml-model-q4_0.bin --host 0.0.0.0 --ctx-size2048 --n -gpu -layers 128

AppleJunJiang avatar Oct 18 '23 10:10 AppleJunJiang