corey-nm
corey-nm
Tested with: - The new unit tests added to PR - running `deepsparse.server --task import:my_pipeline --model_path ...` where my_pipeline.py had this contents ```python from deepsparse.pipeline import Pipeline from deepsparse.transformers.pipelines.question_answering import...
I tested the following commands: - `docker build -t deepsparse_docker .` - `docker build --build-arg GIT_CHECKOUT=main -t deepsparse_docker .` - `docker build --build-arg GIT_CHECKOUT=v1.0.2 -t deepsparse_docker .` - `docker pull...
Todos: - Guard specific torch function calls in torch version checks: - [ ] fuse_modules - [ ] onnx.export - [ ] Get all the unit tests passing (there are...
Following commands were tested, meaning all commands in README are tested: - `docker build --build-arg CUDA_VERSION=11.1 -t sparseml_docker .` - `docker build --build-arg CUDA_VERSION=11.1 --build-arg GIT_CHECKOUT=main -t sparseml_docker .` -...
Note: Not integrated into server yet. Main hook is `start_file_watcher` for server to call into to kick off a watcher process. Everything else is just helpers for that. The file...
This shows users how to use the `/deployment` directory of a model inside docker. Test plan: Run example docker build command from readme
feature branch for supporting new versions of torch TODOS that will happen in other PRs: - [x] Make 3.10/1.12 default in GH workflows - [x] Add 3.9/1.9 backwards compatibility GH...
This PR adds testing support for analyzer models and node shape for both torch 1.9 and 1.12. - Each has a data directory with both `torch-1.9` and `torch-1.12` directories. -...
1. Add zoo_model.unzip() which unzips everything. (Users can still call unzip per sub directory if they want) 2. add `unzip=False` to download params so you can call `zoo_model.download(unzip=True)` _Originally posted...
This is PR is a refactor of the `sparsezoo/utils/authentication.py` module, as discussed in a previous PR. It also adds unit tests for all the functionality. Summary: - Replaced SparseZooCredentials class...