litgpt
litgpt copied to clipboard
[feat] support 01-ai Yi-6B/34B
@carmocca @awaelchli hi, guys, any thoughts on merging it to main? thx.
Hey just pinging to see if you are still interested in pursuing this PR. Personally, I think it'd be awesome to support the YI models in LitGPT. There have been some improvements in the tokenizer in LitGPT recently that could now make this more easily possible.
Btw if rebasing here based on the main branch (which changed a lot) is too messy, you could also just open a fresh PR.