RWKVSharp icon indicating copy to clipboard operation
RWKVSharp copied to clipboard

call rwkv v4/v5/v6/v7 raven/world/finch 1B5-14B rwkv.cpp using csharp cpu/gpu (support INT4,8,Float16,32)

Results 2 RWKVSharp issues
Sort by recently updated
recently updated
newest added

This error occurs when running CRWKV.ONNX.Test. ``` Input Model Name (RWKV_32_2560_16.onnx): RWKV-4-Raven-3B-v11-Eng99-Other1-20230425-ctx4096_32_2560_16.bin Loading... Unhandled exception. Microsoft.ML.OnnxRuntime.OnnxRuntimeException: [ErrorCode:InvalidProtobuf] Load model from /home/hugh/RiderProjects/CSharp-RWKV-V4/CRWKV.ONNX.Test/bin/Debug/net6.0/Model/RWKV-4-Raven-3B-v11-Eng99-Other1-20230425-ctx4096_32_2560_16.bin failed:Protobuf parsing failed. at Microsoft.ML.OnnxRuntime.NativeApiStatus.VerifySuccess(IntPtr nativeStatus) at Microsoft.ML.OnnxRuntime.InferenceSession.Init(String modelPath,...

HI, I'm trying to run your models with CPU, the application crashes while loading the model. To verify if these ONNX models could be loaded by CPU, I created a...