Angky William

Results 7 comments of Angky William

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server

@simon-mo @khluu can I get help to unblock buildkite, thanks!

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server

> > @simon-mo @khluu can I get help to unblock buildkite, thanks! > > which test do you need to unblock? of if you want permission to unblock tests, can...

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server

Thanks for the feedback @youkaichao From what I understand so far, there are three main areas I'd need to modify for LoRA plugin support: 1. `lora/resolver.py` - Introduce an abstraction...

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server

I’ve made the concrete change here: https://github.com/vllm-project/vllm/pull/15733 Let me know if this make sense!

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server

Updated the code with: - Merge latest code from main - Refactor lora resolver as a plugin per @youkaichao's input

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server

@joerunde I’ve added the test for LoRA loading flow via LoRAResolver, along with the corresponding documentation. I believe the code is ready to be merged — let me know if...

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server

@simon-mo I’ve added an example of the `LoRAResolver` implementation to the documentation