Tokenizer icon indicating copy to clipboard operation
Tokenizer copied to clipboard

Tokenizer TS Web Browser Compatability

Open Wolfleader101 opened this issue 1 year ago • 1 comments

Hello,

The TS package doesnt work on web browser due to its usage of fs and path, is there any plans to support web browsers?

Cheers!

Wolfleader101 avatar May 08 '24 03:05 Wolfleader101

Sorry, web browser support is not our priority as of now, but feel free to create a PR if you really need it, the fs/path are only used to load the bpe model files, they can be replaced with http stream in browser setting.

shengyfu avatar May 13 '24 17:05 shengyfu