lorax
lorax copied to clipboard
Add `LGAI-EXAONE-3.5` model
Hi there!
To add LGAI-EXAONE-3.5 model support to Lorax.
I tested the result against the vLLM counterpart + an LoRA adapter and seemingly they were the same. Update on the above sentence: Sometimes they were the same and sometimes that of the vLLM changed.
flash_exaone_modeling is inspired by flash_cohere_modeling, flash_llama_modeling and also the custom model code in the model HF repo.
Fixes #743