lorax icon indicating copy to clipboard operation
lorax copied to clipboard

Add `LGAI-EXAONE-3.5` model

Open sadra-barikbin opened this issue 10 months ago • 0 comments

Hi there!

To add LGAI-EXAONE-3.5 model support to Lorax.

I tested the result against the vLLM counterpart + an LoRA adapter and seemingly they were the same. Update on the above sentence: Sometimes they were the same and sometimes that of the vLLM changed.

flash_exaone_modeling is inspired by flash_cohere_modeling, flash_llama_modeling and also the custom model code in the model HF repo.

Fixes #743

sadra-barikbin avatar Jan 20 '25 21:01 sadra-barikbin