deepsparse issues

How can I make proper request to server

1

**Describe the bug** A clear and concise description of what the bug is. **Expected behavior** A clear and concise description of what you expected to happen. **Environment** Include all relevant...

Alex-SSK

bug

[Question] about converting onnx model with dynamic batch size input to deepsparse model

2

I tried to convert onnx model with dynamic batch size into deepsparse ``` from deepsparse import compile_model from deepsparse.utils import generate_random_inputs onnx_filepath = "tts_model.onnx" batch_size = 4 # Generate random...

phamkhactu

bug

Failed to import dynamically quantized roberta model in ONNX format.

1

**Describe the bug** I cannot seem to load a dynamically quantized roberta model for cpu inference in ONNX format. I can load the pre-quantized model just fine. Currently working on...

tsamiss

bug

Extractor dfs performance

1

### Description This change modifies the DFS search used in model extraction to use sets rather than iterables ### Motivation and Context While shape inference is the most significant bottleneck,...

kylesayrs

Conversion and display of yolov8 rtsp video inference results

2

**Is your feature request related to a problem? Please describe.** First of all, thank the developer for the example. Here is the frame rate that I want to test for...

wynshiter

enhancement

Unable to load DeepSparseSentenceTransformer

2

**Describe the bug** I'm trying to replicate the sample code given in the DeepSparseSentenceTransformer documentation. I'm facing errors while executing it. It is mostly related to the version compatibility of...

Capt4in-Levi

bug

Bump gradio from 3.19.1 to 4.36.0 in /examples/benchmark-ui

Bumps [gradio](https://github.com/gradio-app/gradio) from 3.19.1 to 4.36.0. Release notes Sourced from gradio's releases. [email protected] Features #8478 73e1108 - Adds a monitoring dashboard to Gradio apps that can be used to view...

dependabot[bot]

dependencies

What is the format of the boxes returned from a YOLO Pipeline?

2

It's XYXY top left,bottom right. I guess the negative values are just the model predicting that the object extends outside the image. Leaving this open because it's still a problem...

EricPedley