litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard
verified publisher icon Lightning-AI

[feat] support 01-ai Yi-6B/34B

Open metame-none opened this issue 1 year ago • 2 comments

  • support Yi models from 01-ai
  • also support chat with history

metame-none avatar Jan 24 '24 13:01 metame-none

@carmocca @awaelchli hi, guys, any thoughts on merging it to main? thx.

metame-none avatar Feb 23 '24 16:02 metame-none

Hey just pinging to see if you are still interested in pursuing this PR. Personally, I think it'd be awesome to support the YI models in LitGPT. There have been some improvements in the tokenizer in LitGPT recently that could now make this more easily possible.

Btw if rebasing here based on the main branch (which changed a lot) is too messy, you could also just open a fresh PR.

rasbt avatar Jul 08 '24 18:07 rasbt