tokenizers-wasm icon indicating copy to clipboard operation
tokenizers-wasm copied to clipboard
verified publisher icon mithril-security

Boggus tokenizer pulling implementation

Open mbrunel opened this issue 3 years ago • 0 comments

The pull_from_pretrained method should be improved to match the original implementation. See #1 for details about the problems it causes

mbrunel avatar Jul 06 '22 11:07 mbrunel