Steven Roussey
Steven Roussey
spelling: contents to be read into **prorgam** memory.
I think this project uses an old version of [detect-package-manager](https://github.com/egoist/detect-package-manager) 2.x instead of 3.x which detects bun. For anyone using bun and workspaces, this means total failure. But you just...
Does that not just mean that PretrainedModelOptions = any ? The problem is that tsc obeys some JSDoc conventions which does not allow `SomeThing1 & SomeThing2` due to closure compiler...
> Looks like the same as #1190 I will have a look
@xenova a few thoughts on what i did: I added abort_signal to PretrainedOptions. Most places just pass the options around, but many places rebuild them, so you will see more...
> > Looks like the same as #1190 > > I will have a look I can see reasons to have a custom fetch() but I think those are orthogonal...
For reference: https://github.com/microsoft/onnxruntime/issues/23703
Also, I made `abort_signal` required in various places... that is to help me find the places I have missed. I will make it optional when done.
I haven't tried it myself yet, but it is definitely undocumented. I don't see signal or anything in the docs. https://onnxruntime.ai/docs/api/js/interfaces/InferenceSession.SessionOptions.html#freeDimensionOverrides
Oh, I see now... you are simulating an abort. The text generation keeps going though. If you are using progress callbacks, you can just ignore them (after the user hits...