SSPRATAP17 comments

Repositories
Issues
Comments

Results 3 comments of


                                            SSPRATAP17

[Bug]: Enabling LoRA not working with vLLM

I have tested with below versions of triton and vLLM where LoRA issue is observed: `triton - 3.3.0+gitb962e444` `vllm - 0.8.3.dev19+g3eb08ed9.rocm634` Also, I've tested with triton 3.2.0 and vLLM 0.7.3...

[Bug]: Enabling LoRA not working with vLLM

can you please update on this issue?

[Bug]: Enabling LoRA not working with vLLM

Thanks @ozziemoreno for update. But still it is failing with triton 3.3.0+gitb962e444 version. @jeejeelee, can you please update on this issue?