deepsparse

deepsparse copied to clipboard

how to use c++ api of deepsparse to deploy my optimized model

cbingdu

Hello! I was wondering there was any recent comprehensive inference/accuracy benchmarks done between DeepSparse, ONNXRuntime, and OpenVINO? I'm aware of performance benchmarks done with OpenVINO (#397) but that article's figures...

vjsrinivas

Hi, I am an engineer from Intel and I work mostly on the performance optimization of PyTorch on intel Xeon CPUs (also I am the pytorch module maintainer for cpu...

mingfeima

I download the files of SOLAR 10.7B (https://huggingface.co/neuralmagic/SOLAR-10.7B-Instruct-v1.0-pruned50-quant-ds) in my MacBook Pro (Ventura 13.4) takes 4-5 minutes to load the model and works fine. **Expected behavior** I expected to work...

MariGaS

Per the main [README announcement](https://github.com/neuralmagic/deepsparse/blob/main/README.md), DeepSparse is being deprecated by June 2, 2025. Further development has been suspended; thank you for the inputs and support!

jeanniefinks