deepsparse
deepsparse copied to clipboard
neuralmagic
Sparsity-aware deep learning inference runtime for CPUs
I am trying to validate my sparse-quantized transfer-learned YOLOv5-m model with the following code: !sparseml.yolov5.val_onnx --model_path yolov5_runs/train/exp6/weights/best.onnx --data yolov5/data2.yaml --imgsz 416 --batch-size 16 The model was exported after the sparse-quantized...
## PR description This PR has two main goals: 1. Make pipelines read `config.json` file from `deployment` directory 2. Make pipelines accept `deployment` directory as a `model_path` argument. Detailed changes:...
This is a branch that: - holds the `blog.md` file with the contents of the blog - holds the `make_videos.sh` script to quickly create the required media. For benchmarking purposes,...
* logger feature beanch * [V2 Logger] utils for import (#1536) * utils for import * clean up + tests * [V2 Logger] registry for default func/class (#1539) * registry...
Propagates the name change; needs sparsezoo PR https://github.com/neuralmagic/sparsezoo/pull/459 and https://github.com/neuralmagic/sparsezoo/pull/460 to land
# Summary - Update our docs to be reflective of some of the defaults which have been updated for text generation - Not a requirement for 1.7 but for completeness,...
server running pipeline for benchmark Note: Cannot have continuous batching with timer middleware. ## Configs ### Server side ```bash deepsparse.server --config_file config.yaml ``` ```yaml num_cores: 2 num_workers: 2 endpoints: -...
Metadata
Owner
Metadata
Sparsity-aware deep learning inference runtime for CPUs