ign4si

Multi instance a model in GPU does not increase the throughput in Triton.

1

**Description** Multi-instantiating a model in a GPU does not increase the efficiency when requesting from two different threads. **Triton Information** +----------------------------------+--------------------------------------------------------------------------------------------------------+ | Option | Value | +----------------------------------+--------------------------------------------------------------------------------------------------------+ | server_id |...