litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard
verified publisher icon Lightning-AI

Qwen support

Open vabatista opened this issue 2 years ago • 2 comments

It would be very helpful if lit-gpt provides support for the new models Qwen (https://huggingface.co/Qwen). They have strong performance compared to other open source models.

vabatista avatar Dec 20 '23 10:12 vabatista

After a brief skim over the HF implementation, I don't see any blockers to support it. Contributions are welcome!

carmocca avatar Dec 20 '23 15:12 carmocca

Maybe you can also add support for Qwen 1.5.

vabatista avatar Mar 18 '24 21:03 vabatista