deepsparse
deepsparse copied to clipboard
Sparsity-aware deep learning inference runtime for CPUs
Tested with: - The new unit tests added to PR - running `deepsparse.server --task import:my_pipeline --model_path ...` where my_pipeline.py had this contents ```python from deepsparse.pipeline import Pipeline from deepsparse.transformers.pipelines.question_answering import...
It was noticed that Tevatron embeds the passage title into the raw text input. This PR adds that functionality to the `DeepSparseDensePassageRetriever` as an argument `embed_title`, which allows a user...
This PR reverts the changes made in https://github.com/neuralmagic/deepsparse/pull/532. It was found that installing Haystack dependencies through extras was not feasible. Haystack requires HF transformers as a dependency. However, having HF...
There is a bug in the current implementation of `deepsparse.server`, when files are sent by client (in CV tasks) the server wasn't actually reading in the files sent over the...
Parse messy output from deepsparse.benchmark Also added commit sha info To run: `deepsparse.benchmark zoo:nlp/text_classification/bert-base/pytorch/huggingface/sst2/base-none -x benchmark.json` Before: https://github.com/neuralmagic/deepsparse/blob/main/src/deepsparse/benchmark/img/json_output.png After:
**Describe the bug** Hello, I am trying to compile the onnx-converted model of a sparse Huggingface base Wav2Vec2 model (where sparsity was obtained via unstructured magnitude pruning) through compile_model :...
Bumps [streamlit](https://github.com/streamlit/streamlit) from 1.8.1 to 1.11.1. Commits b6429b6 Fix linting f4b2051 Up version to 1.11.1 80d9979 Ignore component requests outside of the component root 4a04eef Replace legacy app URLs in...