PaddleSharp icon indicating copy to clipboard operation
PaddleSharp copied to clipboard

ONNX runtime version

Open maxpeacock opened this issue 5 months ago • 4 comments

Feature request type

enhancement

Is your feature request related to a problem? Please describe

I have been using the project with the Sdcb.PaddleInference.runtime.win64.mkl for some time now and am very satisfied with it. Recently, I wanted to integrate the Nuget package YoloDotNet into my solution and found that I was having problems because YoloDotNet uses a much newer version of the ONNX runtime.

Describe the solution you'd like

Would it be possible to update the ONNX runtime or control which version is used so that I can use both packages in the same solution? Or is there another way to solve the problem?

Describe alternatives you've considered

No response

Additional context

No response

maxpeacock avatar Aug 07 '25 07:08 maxpeacock

ONNX Runtime is referenced by upstream PaddlePaddle/Paddle repository, but I think it's safe to delete it (to avoid conflictions) if you don't need ONNX engine for PaddleSharp project in windows.

sdcb avatar Aug 07 '25 07:08 sdcb

Ok, thanks I see. Unfortunatly I have to use the onnx runtime, because the with the current version the FullOcrModel crashes in 5 out of 10 runs, if I use Mkldnn. The PaddleOcrRecognizer does not crash with Mkldnn.

maxpeacock avatar Aug 07 '25 12:08 maxpeacock

We've made similar observations. Before version 3.x the library run very very well with ONNX runtime - much better than MKLDNN. Starting with the latest version, ONNX become unstable. Sometimes - not deterministic yet, it crashes. So, we had to move to MKLDNN which is more stable currently.

maxfurioso avatar Aug 07 '25 21:08 maxfurioso

#153

maxfurioso avatar Aug 27 '25 13:08 maxfurioso