Kris Hung
Kris Hung
Hi @swapnil-lader, unfortunately this is a bit outside of our scope as this isn't actually a Triton issue. One thing that is just off the top of my head that...
Closing issue due to lack of activity. Please re-open the issue if you would like to follow up with this issue.
Hi @Vinayaks117, sorry about the late reply. I've been investigating this and I'm trying to reproduce the issue. I'll comment here as soon as I have some update.
@Vinayaks117 Could you run the model using [Polygraphy](https://github.com/NVIDIA/TensorRT/tree/main/tools/Polygraphy) to confirm that the model works outside Triton? This can help us narrow down if the issue occurs inside Triton.
Closing issue due to lack of activity. Please re-open the issue if you would like to follow up with this.
@rmccorm4 Are you able to provide more context for this?
@tanmayv25 Could you chime in on this?
Hi @Tsingjie89, thanks for sharing the config and back trace. Are you able to reproduce this with our newest container? Could you also share the model you are using and...
Thank you @Tsingjie89 for the reply. Apart from the model config you shared, we would also need the model file, `model.py` in this case, to reproduce the issue. Besides, could...
Closing issue due to lack of activity. Please re-open the issue if you would like to follow up with this issue.