esm
esm copied to clipboard
Fix ESM-C tokenizers
Initializing TokenizerCollection
in ESM-C models requires access to ESM3, even if not using the weights or non-sequence tokenizers.
This is the simplest fix which does not affect TokenizerCollection
.
https://github.com/evolutionaryscale/esm/issues/155