wasi-nn icon indicating copy to clipboard operation
wasi-nn copied to clipboard

Residence proposal

Open abrown opened this issue 1 year ago • 2 comments

This merges together some of #69 with various discussions we've had in the ML working group.

abrown avatar Apr 29 '24 15:04 abrown

This change is probably not desirable if we adopt #74: if a user can't change where a model resides any more, they shouldn't be allowed to change where a tensor resides.

abrown avatar Aug 22 '24 17:08 abrown

Is this also implying that tensors in pipelines that cross hardware boundaries will automatically be moved around at compute time?

geekbeast avatar Oct 01 '24 02:10 geekbeast