Baizhou Zhang comments

Results 79 comments of


                                            Baizhou Zhang

[Bug] MLA slower than default for small context long outputs and generating bad output reproducibly

@pseudotensor , thank you for your report. We also noticed the strange output bug and we are trying to fix it. For the small throughput on small contexts, we are...

[Bug] MLA slower than default for small context long outputs and generating bad output reproducibly

@pseudotensor @Hugh-yw @lambert0312 The issue of bad output should be fixed by #3785, please stay tuned!

benchmark program for LIMO&AIME

cc @zhaochenyang20 @jhinpan

benchmark program for LIMO&AIME

Hi @tanzelin430 , we don't have evaluation scripts for LIMO and AIME. Feel free to raise a PR~

[Feature] Support unified paging in multi-lora serving

@Sunt-ing Thanks! Looking forward to your contribution!

Question for EP parameter in command for MoE model

Hi @tanzelin430, currently when enabling tp/dp/ep together, their size must be the same since they share the same communication group (tp group). In `python/sglang/srt/server_args.py`, ep_size and dp_size are automatically set...

Question for EP parameter in command for MoE model

@tanzelin430 Yes you can turn off DP.

[Bug] TCPStore Error processing client message: Too many keys being waited. keys: 3891110078061282660, max: 13107

@FrankLeeeee Could you please have a look

[Bug] failed to serve Deepseek R1 via SGLang, encounter ``sqlite3.OperationalError: no such column: "size" - should this be a string literal in single-quotes?`` error

Thanks for reporting, we will check this issue.

[Bug] failed to serve Deepseek R1 via SGLang, encounter ``sqlite3.OperationalError: no such column: "size" - should this be a string literal in single-quotes?`` error

> I resolved this error by running `conda install libsqlite=3.48.0` > > Reference: [lllyasviel/stable-diffusion-webui-forge#2669](https://github.com/lllyasviel/stable-diffusion-webui-forge/issues/2669) @Yonggie @FenghaoZhu Can this method solve your bugs?