transformers.js
transformers.js copied to clipboard
fixes for ort-1.17
the ort tensor object in 1.17 has changed to add support for keeping webgpu tensors on gpu (ie to avoid copies of kv_cache or hidden state). As result the Object.assign() no longer works. Either we extend the ort tensor or we decouple by keeping it around in the transformers.js tensor ... we think later is the cleanest. Take a look and let us know. Using extend is another option that would work.
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
I think this one is included in the v3 branch - closing.