yhyang201

After switching to your branch, installing SGLang, and running the script you provided, I encountered the following error: ``` [2025-05-11 16:51:15] error: 'NoneType' object is not iterable ``` The full...

> @yhyang201 Can you help trying again? I have tested it, and there are no issues. Additionally, I previously suggested some code simplifications.

> > > @yhyang201 Can you help trying again? > > > > > > I have tested it, and there are no issues. Additionally, I previously suggested some code...

Do you think it would be possible to open a separate PR for the changes made to the following files? - `python/sglang/test/gsm8k_mixin.py` - `python/sglang/test/mmmu_vlm_mixin.py` - `test/srt/models/test_vlm_models.py` This would help us...

Could you rebase and resolve the conflicts? Then we can run the CI tests — I believe we’ll be able to merge it soon.

Can you check the cause of the CI error? ``` config = config_class.from_pretrained(model, revision=revision) File "/usr/local/lib/python3.10/dist-packages/transformers/configuration_utils.py", line 640, in from_pretrained return cls.from_dict(config_dict, **kwargs) File "/usr/local/lib/python3.10/dist-packages/transformers/configuration_utils.py", line 808, in from_dict config...

1. I tried running the modified `http_pixtral_generation_test.py`, but encountered the following error, which might need to be addressed: ``` [2025-04-07 08:16:52 TP0] Scheduler hit an exception: Traceback (most recent call...

1. When loading the model, the following error occurred: ``` File "/root/sglang/kgl/python/sglang/srt/model_loader/loader.py", line 146, in _initialize_model return model_class( File "/root/sglang/kgl/python/sglang/srt/models/llava.py", line 718, in __init__ vision_model_cls = self._get_sgl_model_cls(config.vision_config, AutoModel) File "/root/sglang/kgl/python/sglang/srt/models/llava.py",...

> could you provide results on mmmu/mmmu pro Some tests are already there, just folded: https://github.com/sgl-project/sglang/pull/5084#issuecomment-2785737622. --- However, in `mmmu/bench_sglang`, when the answer cannot be clearly parsed, a random choice...

> Found unusual impl while testing vllm for pixtral: [starting from pixtral support#8377](https://github.com/vllm-project/vllm/pull/8377/files#diff-dc4afb08b7a54bb237ee02180225d41d542166342c1f09d41978b7893f332dd0), Mistral-AI configs need separate handling, as their newly published models _no longer_ complies with HF standards. >...