tokenizers-wasm icon indicating copy to clipboard operation
tokenizers-wasm copied to clipboard

Remote WASM package file

Open visheratin opened this issue 2 years ago • 0 comments

Hello @mbrunel! Thank you very much for the library, having fully functional transformers in the browser is very helpful.

I'm wondering how can I use not local WASM file but one located on a remote server? Something like: import * as wasm from 'https://www.storage.com/tokenizers_wasm_bg.wasm';

In ONNX runtime for web they have a special flag that allows to use remote WASM files:

/**
* Set a custom URL prefix to the .wasm files or a set of overrides for each .wasm file. The override path should be
* an absolute path.
*/
wasmPaths?: WasmPrefixOrFilePaths;

Could you please help me to achieve the same for tokenizers-wasm?

visheratin avatar Dec 14 '22 18:12 visheratin