amazon-sagemaker-examples icon indicating copy to clipboard operation
amazon-sagemaker-examples copied to clipboard

[Bug Report]: shm_size issue while deploying ensemble models on triton

Open farzanehnakhaee70 opened this issue 1 year ago • 1 comments

Describe the bug I am deploying an ensemble of an NLP model. While running the code specified, I get this error:

Unable to initialize shared memory key 'triton_python_backend_shm_region_2' to requested size

Based on my investigation, each of the directories with python_backend, needs 64MB of shm. On the other hand, there isn't any option to change the shm_size of the container. Then, how we can solve the problem?

farzanehnakhaee70 avatar Jul 20 '22 13:07 farzanehnakhaee70