Xin Liu
Xin Liu
Updated: 2023-04-06 We did the same test on `WasmEdge-0.12.0-alpha.2-38-gdad018af` with both Rust SDK and Go SDK. You can find the test results and the relevant material, like test scripts and...
@CaptainVincent Sorry, I missed the notification email. @L-jasmine is responsible for adapting Rust SDK for WasmEdge-0.14.0. @L-jasmine Could you please share the detailed schedule with Vincent? Thanks a lot!
@paulmchen The host function execution cancellation depends on the async runtime used. The code snippets below from [the example: Cancel Async Host Functions in Exeuction](https://github.com/second-state/wasmedge-rustsdk-examples/tree/refactor/support-rust-sdk/timeout-async-func-execution) demonstrate a similar case, in...
@dranger003 Does the gguf model generated by `conver-hf-to-gguf.py` of this PR work on your end? I used `Q5_K_M` on my side and the text generation was not correct: - Input...
@ggerganov The `convert-hf-to-gguf.py` of this PR works on my side. Before running the python script, use `pip install -e ./gguf-py/.` to update the local gguf package. For your convenience, I...
Not sure if the model could be converted to GGUF. According to the descriptions on `Qwen-VL` and `Qwen-VL-Chat`, we will try `Qwen-VL-Chat`, and list it as a candidate in LlamaEdge...
Failed to convert to gguf by the same [issue](https://github.com/ggerganov/llama.cpp/issues/5331).