Marco Fuchs

Results 2 issues of Marco Fuchs

I'm trying to adjust the `rope_scaling` environment variable. It's mentioned in the documentation as possible, but the assignment in [engine_args.py](https://github.com/runpod-workers/worker-vllm/blob/main/src/engine_args.py) parses the environment variable as a string (obviously). This behavior...

Resolves #192 and #195. I'm not an expert in Python, but the function was required for me to launch a vllm-worker with a `Qwen3-30B-A3B` and more than the 32k context...