erjieyong

AssertionError: No inf checks were recorded for this optimizer.

4

First of all, a great thank you for sharing this model to the world!!! Anyway, i've been trying to train my own model based off of this repo. My objective...

Aborted request without reason

38

Hi, i am trying to load test vllm on a single gpu with 20 concurrent request. Each request would pass through the llm engine twice. Once to change the prompt,...

IVF AssertionError due to padded zeros

1

to account for padded zeros added by https://github.com/stanford-futuredata/ColBERT/pull/336