sglang_work not working on sglang v0.2.13

[exceedzhang]

trafficstars

Error in sys.excepthook: ubuntu-xllm-stream-1-1 | Original exception was: ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | Traceback (most recent call last): ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | return _run_code(code, main_globals, None, ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | File "/usr/lib/python3.10/runpy.py", line 86, in _run_code ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | exec(code, run_globals) ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | File "/usr/local/lib/python3.10/dist-packages/fastchat/serve/sglang_worker.py", line 290, in ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | runtime = sgl.Runtime( ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | File "/usr/local/lib/python3.10/dist-packages/sglang/api.py", line 40, in Runtime ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | return Runtime(*args, **kwargs) ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | File "/usr/local/lib/python3.10/dist-packages/sglang/srt/server.py", line 534, in __init__ ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | raise RuntimeError( ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | RuntimeError: Initialization failed. Please see the error messages above. @merrymercy