keras-nlp icon indicating copy to clipboard operation
keras-nlp copied to clipboard

Add `Falcon` Model

Open SamanehSaadat opened this issue 1 year ago • 2 comments

Falcon is a family of language models created by the Technology Innovation Institute (TII). Falcon family has multiple base models: Falcon-180b, Falcon-40B, Falcon-7B, and Falcon-rw-1b. Instruction tuned version of some of the models is available as well: Falcon-7B-Instruct and Falcon-40B-Instruct. Since this is a high quality model, it would be a good addition to the collection of KerasNLP models. I will be working on adding this model.

The following components should be implemented:

  • [x] Backbone
  • [x] Tokenizer
  • [x] Presets
  • [x] Preprocessors
  • [ ] Task

SamanehSaadat avatar Dec 19 '23 01:12 SamanehSaadat

Hi @SamanehSaadat. This seems a good enhancement project and I would also like to collaborate with you on this.

simeetnayan81 avatar Jan 02 '24 17:01 simeetnayan81

Hi @simeetnayan81! Thanks for your interest in this project. We appreciate you offering to collaborate. The scope of this project is pretty small and I'm handling it for now. But I'll definitely reach out if we need your help. If you're interested in contributing to Keras, please take a look at issues with contributions-welcome label.

SamanehSaadat avatar Jan 04 '24 23:01 SamanehSaadat