hydai
hydai
What's the output of `curl -sSf https://raw.githubusercontent.com/WasmEdge/WasmEdge/master/utils/install.sh | bash -s -- -v 0.13.5 --plugins wasi_nn-ggml wasmedge_rustls`? This error shows that the wasi_nn plugin is not installed correctly.
Is your shell bash? Do you run `source /home/wwl/.bashrc` before the execution? And what's the folder context of `/home/wwl/.wasmedge`? Try to use `tree /home/wwl/.wasmedge` to get the full output.
Looks like the installation is done. `libwasmedgePluginWasiNN.so` exists. What's the output of `WASMEDGE_PLUGIN_PATH=/home/wwl/.wasmedge/plugin wasmedge --dir .:. --nn-preload default:GGML:AUTO:Meta-Llama-3-8B-Instruct-Q5_K_M.gguf llama-chat.wasm -p llama-3-chat`?
Does the error still occur after you appending `WASMEDGE_PLUGIN_PATH=/home/wwl/.wasmedge/plugin` before the `wasmedge` command?
 I cannot reproduce the error on our runner. In the environment, if there is no other wasmedge installation and the plugin is installed in...
Hi @17862687921 Is this issue fixed? If not, please feel free to re-open it.
Due to the inactivity, this PR has been replaced by #3688.
Hi @AkihiroSuda We extended the WASI-NN spec with a new function called `LoadByNameWithConfig`[1] and made it the default in our examples. This function's design purpose is to set the GPU...
> I believe we should implement the `LoadByNameWithConfig` function in the NNRPC component. However, before proceeding with its implementation, I can provide a new example that does not utilize the...
@q82419 Let's have rc.3 to include this NNRPC bugfix.