dhritiman

Results 1 comments of dhritiman

SIGABRT - Fatal Python error: Aborted when running vllm on llama2-7b with --tensor-parallel-size 2

I just re-ran this with the latest vLLM 0.1.4 wheels for python 3.10 and it failed with the same error. Would highly appreciate if you can provide any inputs here.