zuxinqi
Results
1
comments of
zuxinqi
> I added this quick solution below for llama-hf model. The steps are > > 1. Load original llama to vllm with `llm = LLM("llama-7b")` ... > 2. Load lora...
zuxinqi
> I added this quick solution below for llama-hf model. The steps are > > 1. Load original llama to vllm with `llm = LLM("llama-7b")` ... > 2. Load lora...