Jimmy1i
Jimmy1i
After successfully installed kt-kernel and sglang, got a problem when running. Pretty sure nvcc is in system path. ``` k1@k0:~/ktransformers$ python -m sglang.launch_server --host 0.0.0.0 --port 60000 --model /home/k1/models/DeepSeek-R1-GGUF/DeepSeek-R1-UD-Q2_K_XL --kt-cpuinfer...
Do Zen4 cpus of avx2 have any chance?
Same here, even rerun the preparations.
I'm using Ubuntu 24.4, I run export S2_API_KEY="MY KEY" in the terminal, opened another terminal to run launch_scientist.py. Still got 429.
three nodes of 240 TFLOPS, cannot answer Hello 