thexplorer comments

Repositories
Issues
Comments

Results 3 comments of


                                            thexplorer

It will be a good idea to support T5 series model.

Hey @svjack! We've planned for T5 after a few pending releases, but if there's more interest, we can fast-track it! ( Just two more T5 requests on this thread, and...

LoRA MoE with k_proj, up_proj, down_proj

@aksh555, could you share the scripts for replicating the model composition and the forward pass?

LoRA MoE with k_proj, up_proj, down_proj

Hi @Aurora-slz, Could you please share the adapter configurations for `llama3_lora_1` and `llama3_lora_2`? If they are available on HuggingFace, providing the URLs would be very helpful. This will assist us...