wasi-nn-onnx
wasi-nn-onnx copied to clipboard
deislabs
Experimental ONNX implementation for WASI NN.
Hi! I am a developer/researcher on WebAssembly. I am looking for the independent runtimes of WebAssembly that could run Wasm (or wasi-nn) with GPUs. I am wondering if this repo...
The bindings have been updated to 1.8.1: https://github.com/nbigaouette/onnxruntime-rs/pull/90
This would add the CUDA and DirectML headers and pull the appropriate shared object. See https://github.com/nbigaouette/onnxruntime-rs/issues/57 As I am not currently on a CUDA-enabled machine, labeling this as `help wanted`.
This issue has multiple purposes: - helps show people new to WASI NN how to pre-process data for examples other than SqueezeNet / ImageNet / MobileNet in Rust and /...
The Rust bindings for the ONNX runtime are based on a fork of this project - https://github.com/nbigaouette/onnxruntime-rs, whose latest supported ONNX release is 1.6. Given that we already use a...
Right now, if you try to run the compiled helper binary `wasmtime-onnx`, you get the following error: ``` error loading shared libraries: libonnxruntime.so.1.6.0: cannot open shared object file: No such...
See https://github.com/nbigaouette/onnxruntime-rs/issues/82
Currently, if input and output tensors are not F32, both runtimes will panic. This stems from the way we handle and store input and output tensors, particularly when using the...
With #15, around 75% of the logic is identical between the C runtime and Tract implementations. We should investigate whether it makes sense to model out a generic `WasnNnCtx` that...