transformers.js icon indicating copy to clipboard operation
transformers.js copied to clipboard

fixes for ort-1.17

Open guschmue opened this issue 1 year ago • 1 comments

the ort tensor object in 1.17 has changed to add support for keeping webgpu tensors on gpu (ie to avoid copies of kv_cache or hidden state). As result the Object.assign() no longer works. Either we extend the ort tensor or we decouple by keeping it around in the transformers.js tensor ... we think later is the cleanest. Take a look and let us know. Using extend is another option that would work.

guschmue avatar Feb 21 '24 01:02 guschmue

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

I think this one is included in the v3 branch - closing.

guschmue avatar Jun 25 '24 16:06 guschmue