ginza-transformers icon indicating copy to clipboard operation
ginza-transformers copied to clipboard

Use custom tokenizers in spacy-transformers

Results 2 ginza-transformers issues
Sort by recently updated
recently updated
newest added

Hi there, thanks for providing this package. While using this package indirectly via `ja-ginza-electra`, I got a github's dependabot error that `transformers` version cannot be upgraded more than 4.26.0 which...

Hi. Do you think Ginza-transformers can work with encoder-decoder transformers, such as nllb or t5? I mean getting the encoder to be used as a tokenizer in Spacy. Reason for...