Li Ming

icon company University of Electronic and Science Technology of China @UESTC icon location Student of University of Electronic and Science Technology of China @UESTC

Results 2 issues of Li Ming

`Invalid fd was supplied: -1` optimum.onnxruntime load onnx model failed

1 comment

I used onnx package load my llm model directly successfully in my ubuntu x86 platform. `model = onnx.load("Qwen_models/Qwen-7B-onnx/qwen_model.onnx") for node in model.graph.node: print(node.op_type) pass` but failed with `optimum`，my code is...

bug
onnxruntime
onnx

What other library that optimum-benchmark support other than transformer

3 comment

Can I use Optimum-benchmark to evaluate the performance of qwen.cpp or llama.cpp？