onnxruntime
onnxruntime copied to clipboard
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
### Describe the issue OS: Windows ONNX Runtime version: 1.19.1 CUDA version: 12.6 cuDNN version: 9.3.0 I'm using the following packages. But vs2022 can't find “onnxruntime_cxx_api.h”   ### Urgency...
### Description This PR is for the API change for WebGPU EP. This PR is for review purpose. The build may fail because of lack implementation of the interface. ####...
### Description Enables using the MLBuffers to pass data between models. ### Motivation and Context Using MLBuffers instead of ArrayBuffers reduces the number of copies between the CPU and devices...
### Describe the issue I am trying to use Onnx in Blazor Webassembly, in order to do inference within a browser. I am not sure if there might be a...
### Description Follow-up to: https://github.com/microsoft/onnxruntime/pull/21793 - Support looking past a per-axis DQ to do in-place Unsqueeze/Transpose of initializers - Support looking past a per-axis DQ to cancel a Transpose or...
### Describe the issue I have a detector with FP16 and FP32 weights(onnx). Below is the code for FP32 which gives the correct detections when inferencing on FP32 weights. ```...
### Description This PR will support for Interactive Decoding via the use of a 2-D seqlens_k tensor, which holds the past and total sequence lengths of each sequence in a...
### Describe the issue I install the 1.19.0 onnxruntime. I think it should be supported Where operator. However, I can not run it and got an error: onnxruntime.capi.onnxruntime_pybind11_state.NotImplemented: [ONNXRuntimeError] :...
### Describe the documentation issue Is oneDNN onnx support windows 11? I want to enable oneDNN in onnx to accelerate cpu. Only windows10 is written in the Support Coverage of...
### Describe the issue It's building with 1.18.1 but not with 1.19.0, this is the docker image I use to build: ### Urgency Newest version can't be build with openvino....