model_server icon indicating copy to clipboard operation
model_server copied to clipboard

A scalable inference server for models optimized with OpenVINO™

Results 147 model_server issues
Sort by recently updated
recently updated
newest added

**Describe the bug** Inference hangs when using A770 **Logs** server logs ``` [2024-02-23 15:54:44.147][2184239][serving][error][modelinstance.cpp:1193] Async caught an exception Internal inference error: Exception from src/inference/src/infer_request.cpp:256: clFlush [2024-02-23 15:55:08.725][2184301][serving][error][modelinstance.cpp:1193] Async caught an...

bug

Additionally bump aws-sdk-cpp version to 1.11.279 Encountered issues with bazel. Non ASCII filenames don't work inside bazel. Workaround is to remove test file from aws-sdk-cpp. https://github.com/bazelbuild/bazel/issues/374 Building with rules_foreign cmake...

WIP