deepsparse

deepsparse copied to clipboard

Adding the SparseStream App to the examples directory. This app allows the user to stream real-time finance-related tweets and classify them using custom sparse models classifying topic and sentiment.. In...

InquestGeronimo

From community slack https://discuss-neuralmagic.slack.com/archives/C020FPF3MQX/p1657890578280219: [mt](https://app.slack.com/team/U03JVQ69Y4D) [8:09 AM](https://discuss-neuralmagic.slack.com/archives/C020FPF3MQX/p1657890578280219) Hello! I was using deepsparse on a checkpoint of a yolov5l model generated by --one-shot on a c5.12xlarge and got the following error...

markurtz

**This PR**: - Creates a common directory "vision" that contains: schema blueprint for all vision pipelines, utils shared between vision pipelines, utils for coco and imagenet dataset, utils for vision...

dbogunowicz

I tested the following commands: - `docker build -t deepsparse_docker .` - `docker build --build-arg GIT_CHECKOUT=main -t deepsparse_docker .` - `docker build --build-arg GIT_CHECKOUT=v1.0.2 -t deepsparse_docker .` - `docker pull...

corey-nm

Unable to startup the server for image classification

3

When I run the script below, the error occur ``` deepsparse.server \ --model_path "zoo:cv/classification/resnet_v1-50/pytorch/sparseml/imagenet/pruned-moderate" \ --task image_classification ``` ValueError: unsupported task given of image_classification for serve model config task='image_classification' model_path='zoo:cv/classification/resnet_v1-50/pytorch/sparseml/imagenet/pruned-moderate'...

I-aashishM

**Describe the bug** Run the instruction `sparseml.transformers.token_classification \ --output_dir models/teacher \ --model_name_or_path zoo:nlp/masked_language_modeling/bert-base/pytorch/huggingface/wikipedia_bookcorpus/base-none \ --recipe zoo:nlp/masked_language_modeling/bert-base/pytorch/huggingface/wikipedia_bookcorpus/base-none?recipe_type=transfer-token_classification \ --recipe_args '{"init_lr":0.00003}' \ --dataset_name conll2003 --per_device_train_batch_size 32 \ --per_device_eval_batch_size 32 --preprocessing_num_workers 6 \...

baiziyuandyufei

Feature Extraction pipeline [WIP]

1

davidberenstein1957

Crash when importing

13

I installed deepsparse using Pip. When I try to import it, Python immediately crashes: ``` (venv) vvolhejn@eu-login-21 ~> python3 Python 3.8.5 (default, Sep 27 2021, 10:10:37) [GCC 8.2.0] on linux...

vvolhejn

getting low fps & inference issue

7

1.i used this repo https://github.com/neuralmagic/deepsparse/tree/main/examples/ultralytics-yolo & this command !python annotate.py \ zoo:cv/detection/yolov5-s/pytorch/ultralytics/coco/pruned_quant-aggressive_94\ --source "/content/loc1min.mp4" \ --quantized-inputs \ --image-shape 416 416 \ --save-dir '/content/ops/' \ --model-config '/content/coco128.yaml'\ --device 'cpu' & im...

akashAD98

Is Deepsparse specially optimized for certain model architectures regardless of the sparsity?

2

Hi there, I have been experimenting with the DeepSparse engine, and this is my second issue. I thought initially that DeepSparse engine is a general engine designed to exploit the...

jz-exwzd