server icon indicating copy to clipboard operation
server copied to clipboard

too many open files

Open wdongdongde opened this issue 3 years ago • 3 comments

Description after running few days, there are so many tcp connection,and finally stop accepting requests. image

image

Triton Information What version of Triton are you using?

image

there are three python backend models and one pytorch model

To Reproduce Steps to reproduce the behavior.

Describe the models (framework, inputs, outputs), ideally include the model configuration file (if using an ensemble include the model configuration file for that as well).

Expected behavior A clear and concise description of what you expected to happen.

wdongdongde avatar Sep 14 '22 03:09 wdongdongde

Hi @wdongdongde, I have filed a ticket for us to investigate further.

In the meantime, can you provide us with more information:

  • Which OS (and version) are you using?
  • Are you connecting to the server using HTTP or GRPC or both?
  • Can you try with our later release (docker pull nvcr.io/nvidia/tritonserver:22.08-py3) and see if you still experience the same problem?

kthui avatar Sep 14 '22 17:09 kthui

@wdongdongde Please provide detailed steps for reproducing the issue. There are no details in the issue that you have filed.

tanmayv25 avatar Sep 19 '22 21:09 tanmayv25

@wdongdongde can you provide a small reproducible example for the client?

jbkyang-nvi avatar Sep 19 '22 22:09 jbkyang-nvi

Closing ticket because of inactivity. @wdongdongde please reopen with more information if you would like us to look at it

jbkyang-nvi avatar Sep 26 '22 22:09 jbkyang-nvi

it is the caused by nginx , not triton

wdongdongde avatar Sep 27 '22 14:09 wdongdongde