dahema
dahema
Sure. But since it is required by the lcoal law, that's only a matter of time, I think.
Consider use "xargs" or "find -exec" instead?
看看是不是open-webui在对话结束后继续请求了生成对话标题和标签（管理员设置-界面-生成标题、生成标签）
调用opencv?
GPUs got randomly busy while keeping output "DDDDD" ``` (base) root@s4000-8gpu:~# mthreads-gmi -pm -l 2 gpu pid memUtil gpuUtil 0 3230 44% 0% 1 3230 66% 6% 2 3230 66%...
kernel version ubuntu-22.044-LTS linux-5.15.0-136-generic drivers and utils inside musasdk_rc3.1.0.zip from moorethreads official site.
rc3.1.1 installed and rebuiding...
Confirmed it's related to multi-gpu and musa sdk rc3.1.1, which does not have offical support for S4000 especially multi S4000 gpus. Waiting for a driver update.
https://docs.vllm.ai/en/v0.8.3/getting_started/installation/cpu.html > Supported features > vLLM CPU backend supports the following vLLM features: > > Tensor Parallel > > Model Quantization (INT8 W8A8, AWQ, GPTQ) > > Chunked-prefill > >...
非常荣幸得到热情回复，我已经很久不编程序了，所以估计直接参与代码工作有点儿难，我看我能发挥什么作用吧，比如找机会拉一些开发人员进来，提供开发测试环境和测试之类的工作倒是可以。