avickars

I am also experiencing this issue as well...I have an ensemble (pre proc in python -> onnx model -> post proc in python) that is being fired from a BLS....

@GuanLuo just wanted to check if there is any idea on the cause of this? I've noticed that it appears to only happen when it is under fairly significant load..but...

ya after some additional testing today, it doesn't appear to be due to load (seems basically random if/when it happens). For me the issue only seems to happen when I...

for me it is...the pre/post processes are python backends

this doesn't work for me...did it actually work for u?

Any update on this? @zhoujinhai

@agunapal Appreciate the response! So that example is essentially my code actually. I copied it exactly and it actually doesn't work (have tried a variety of other avenues with no...

To follow up, below is the torchserve output I am getting: `2022-07-27T22:58:17,630 [INFO ] W-9003-w1__pre_processing_1.0-stdout MODEL_LOG - video_tensor, audio_tensor, info = torchvision.io.read_video(video) 2022-07-27T22:58:17,630 [INFO ] W-9003-w1__pre_processing_1.0-stdout MODEL_LOG - File "/opt/conda/lib/python3.8/site-packages/torchvision/io/video.py",...

Just an additional comment on this, I can see that we do get the instance ID for the MIG partitions, but its kind of useless in my case since you...

would definitely be interested in this as well.