Hillary Sanders

icon indicating a website link hillarysanders.com icon indicating an email [email protected]

icon location Portland, OR icon location ML & neural network researcher & engineer

Results 2 issues of Hillary Sanders

[Bug]: VLLM hangs on prediction when preceded by other predictions

### Your current environment Collecting environment information... PyTorch version: N/A Is debug build: N/A CUDA used to build PyTorch: N/A ROCM used to build PyTorch: N/A OS: Ubuntu 20.04.6 LTS...

bug

[Bug]: VLLM OOMing unpredictably on prediction

2 comment

### Your current environment Collecting environment information... PyTorch version: N/A Is debug build: N/A CUDA used to build PyTorch: N/A ROCM used to build PyTorch: N/A OS: Ubuntu 20.04.6 LTS...

bug