luchangli
luchangli
@YAMY1234 Hi, I use your branch (https://github.com/YAMY1234/sglang/tree/dpsk_tp) and get some error in PD: ``` [2025-11-25 11:34:35 DP0 TP2] Scheduler hit an exception: Traceback (most recent call last): File "sglang/python/sglang/srt/managers/scheduler.py", line...
@YaoJiayi here are some benchmark method and results: # Benchmark method launch vllm serving: ``` rm -r /DATA/disk1/lmcache_tmp mkdir /DATA/disk1/lmcache_tmp export LMCACHE_CONFIG_FILE=lmcache-config.yaml vllm serve Qwen/Qwen3-32B-FP8 \ -tp 8 \ --disable-log-requests...
Therefore, this PR effectively optimize the performance of disk offloading by reducing the put time.
@YaoJiayi Hi, how do you think about this pr? Currently, a check is failed, but I can't see the details.
code conflict is fixed in latest commit
能不能支持鼠标右键自动粘贴?
@Adsryen 请问下怎么设置这个功能啊?
@zxdong262 好的,感谢