clearml-serving

clearml-serving copied to clipboard

Deploying Models from Azure Blob

5

Models which are located on the clearML servers (created by Task.init(..., output_uri=True) ) run perfectly while models which are located on azure blob storage produce different problems in different scenarios:...

ockaro

Inconsistent argument syntax in clearml-serving client

2

Just noticed that the output type argument have a different syntax depending on which `clearml-serving model` command is run: ```bash clearml-serving --id xxxxxxxxx model auto-update [...] --output-type float32 ``` Returns...

stefano-cherchi

Inconsistent inference results from clearml-serving

1

Hello, I deployed a model using `clearml-serving`, but it generate inconsistent results across same HTTP requests. To recreate: 1. I deployed a self-hosted clearml server in my local kubernetes (from...

Muscle-Oliver

docker-compose-triton-gpu fails due to "PTX was compiled with an unsupported toolchain"

2

**Describe the bug** After following the `docker-compose-triton-gpu.yml` instructions for the pytorch example the server fails to spin up. The service fails due to the following error: ``` model_repository_manager.cc:1152] failed to...

rg314

ClearML serving design v2

8

### ClearML serving design document v2.0 **Goal: Create a simple interface to serve multiple models with scalable serving engines on top of Kubernetes** Design Diagram (edit [here](https://excalidraw.com/#json=YnP_tJVH0q5wZ8kd0ruFZ,zJOO7eW81F9H3pCXO3noNw))  **Features** -...

bmartinn

Request for unknown model: 'test_model_pytorch' version 1 is not at ready state

2

[https://github.com/allegroai/clearml-serving/tree/main/examples/pytorch](https://github.com/allegroai/clearml-serving/tree/main/examples/pytorch) I'm running examples as per readme.md, but I get the following error. What should I do? `{"detail":"Error processing request: "}` Endpoints appear to be normal.  

takumi5757