curated-transformers icon indicating copy to clipboard operation
curated-transformers copied to clipboard

Add a an extras/contrib package

Open danieldk opened this issue 2 years ago • 0 comments

Some models deviate so much from standard transformer encoder/decoders (e.g. DeBERTa and Falcon old architecture) that we probably should not support them in mainline Curated Transformers to avoid cluttering the abstractions too much (it's curated after all). Though it would still be nice to provide official support for these models. Consider an add-on package for these models.

Probably requires #346.

danieldk avatar Oct 03 '23 15:10 danieldk