multipy
multipy copied to clipboard
dynamo + torchdeploy bug
Stack from ghstack (oldest at bottom):
- -> #265
I ran into a few bugs when trying to use deploy + dynamo. This PR adds some torchdynamo unit tests to create a minimal repro for these bugs. So far there are 2 bugs
- Outputs of using dynamo + torchscript + deploy is inconsistent with using just torchscript.
- Multithreading models which use dynamo run into errors with prims.
The output of building and running test_deploy_compat.cpp
(which contain single and multithreaded dynamo+torchscript+deploy tests using resnet) are here.
One can run these tests again by running
cd multipy
python multipy/runtime/example/generate_examples.py
python -m pip install -e .
./multipy/runtime/build/test_deploy_compat
Differential Revision: D41349350
@PaliC has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.