EdgeChains icon indicating copy to clipboard operation
EdgeChains copied to clipboard
verified publisher icon arakoodev

JS - add Claude BPE Tokenizer

Open sandys opened this issue 2 years ago • 0 comments

https://twitter.com/AlexReibman/status/1704212821607645332 https://github.com/anthropics/anthropic-tokenizer-typescript

https://github.com/anthropics/anthropic-tokenizer-typescript/blob/bd241051066ea37120f2898419e3fc8662fab280/index.ts#L3C1-L3C1

sandys avatar Sep 20 '23 07:09 sandys