deepsparse
deepsparse copied to clipboard
Sparsity-aware deep learning inference runtime for CPUs
* Simple Example Connecting DeepSparse Logging To Prometheus
Had the wrong readme in here
I have finetuned ROBERTA model(TFAutomodelforsequenceclassification busased ) in my local path How can I perform text classification inferencing from that model using deepsparse? I am using GPU and CUDA 12...
The legacy text-generation pipeline supported trust_remote_code as an argument, which was inherited from the Transformers base pipeline here: https://github.com/neuralmagic/deepsparse/blob/491302a5135028ccb4eb26d016a1537304b8e7bc/src/deepsparse/transformers/pipelines/pipeline.py#L91 This was useful for models with custom code related to their...
#1629