wasi-nn icon indicating copy to clipboard operation
wasi-nn copied to clipboard

Manage memory residency of tensors

Open geekbeast opened this issue 11 months ago • 1 comments

Support multi-device memory residency of tensors.

geekbeast avatar Mar 18 '24 15:03 geekbeast

Like we discussed (and as commented in #70), this change is probably not desirable if we adopt https://github.com/WebAssembly/wasi-nn/pull/74: if a user can't change where a model resides any more, they shouldn't be allowed to change where a tensor resides.

abrown avatar Aug 22 '24 17:08 abrown