Easy-Transformer icon indicating copy to clipboard operation
Easy-Transformer copied to clipboard

Published 20 hours ago • verified publisher icon neelnanda-io

[Proposal] Support Falcon

Open aVariengien opened this issue 1 year ago • 1 comments

Proposal

The Technology Innovation Institute released a model family called falcon. It contains two sizes, 7b and 40b, each of them have an instruct version. It could be cool if they were supported by TransformerLens. To my knowledge, these are the only open-source instruct fine-tuned model currently available.

The HF models can be found here.

Checklist

  • [x] I have checked that there is no similar issue in the repo (required)

aVariengien avatar Jun 23 '23 11:06 aVariengien

Agreed this would be great! Would you be interested in writing a PR for it?

alan-cooney avatar Oct 24 '23 13:10 alan-cooney