stephanbertl

any update? The serving module seems totally unstable, a model that is not working breaks the whole serving server. How is that supposed to work in prod?

@jkhenning sorry for not coming back earlier to you. I would say the culprit is the tritonserver default value of --exit-on-error=true. I quickly checked the code and I could not...