Timur Ganiev
Results
2
issues of
Timur Ganiev
We currently have access to the vocab object as `tokenizer.get_vocab()`. When I try to reinitialize my BPE model from memory, I need to provide both `vocab` and` merges` objects. But...
Stale
Added `num_channels` method for preprocessors and `num_query_channels` property for decoders.