esm icon indicating copy to clipboard operation
esm copied to clipboard

Fix ESM-C tokenizers

Open matkozak opened this issue 2 months ago • 0 comments

Initializing TokenizerCollection in ESM-C models requires access to ESM3, even if not using the weights or non-sequence tokenizers.

This is the simplest fix which does not affect TokenizerCollection.

https://github.com/evolutionaryscale/esm/issues/155

matkozak avatar Dec 06 '24 08:12 matkozak