amazon-sagemaker-examples
amazon-sagemaker-examples copied to clipboard
[Bug Report]: shm_size issue while deploying ensemble models on triton
Describe the bug I am deploying an ensemble of an NLP model. While running the code specified, I get this error:
Unable to initialize shared memory key 'triton_python_backend_shm_region_2' to requested size
Based on my investigation, each of the directories with python_backend, needs 64MB of shm. On the other hand, there isn't any option to change the shm_size of the container. Then, how we can solve the problem?