Dave Liddell comments

Repositories
Issues
Comments

Results 2 comments of


                                            Dave Liddell

Not able to export ONNX from llama2-7b 8 bit quantized pytorch model

It seems the op is simply not yet supported for export to onnx, as documented in the pytorch docs [here](https://pytorch.org/docs/main/onnx_torchscript_supported_aten_ops.html). I will try to file a request to add the...

Not able to export ONNX from llama2-7b 8 bit quantized pytorch model

Added pytorch issue https://github.com/pytorch/pytorch/issues/119621