Vaibhav
Results
2
comments of
Vaibhav
@Co1lin sorry, just saw this. These are numbers for the instruct model. I see that the issue you linked ran the base model, which might be having issues completing the...
wanted to update: LORA rank 256 works with vllm 0.8.2