Trawinski, Dariusz
Trawinski, Dariusz
# Support for multi threading in execution? - [ ] Did you make sure to update the documentation with your changes? - [x] Did you write any new necessary tests?
# Support for execution with multi concurrency - Adding clone operation to model objects which creates new execution context without duplicating compiled_model and memory usage. It enables multi-concurrency in multithreaded...
Additional build flag --enable-intel-gpu which includes in the docker image required runtime drivers for Intel GPU Related to https://github.com/triton-inference-server/openvino_backend/pull/74/files