Foundry-Local icon indicating copy to clipboard operation
Foundry-Local copied to clipboard

gpt-oss model conversion with OLIVE cannot run with Onnx GenAI runtime

Open leestott opened this issue 4 months ago • 2 comments

Requirement is to have GPT-OSS ONNX Models available on Hugging Face as at present there are no ONNX models only GGUF and MLX.

leestott avatar Aug 11 '25 08:08 leestott

@leestott Is this still an issue?

natke avatar Aug 25 '25 19:08 natke

@natke this is still an issue, the issue here is there are no QNN NPU model builds currently for GPT-OSS

leestott avatar Sep 08 '25 19:09 leestott