clearml-serving

clearml-serving copied to clipboard

My clearml serving deployment is stuck. No models are registered, ``` clearml-serving --id 7303713271b941f7a0b45760d45208dd model list clearml-serving - CLI for launching ClearML serving engine List model serving and endpoints, control...

stephanbertl

Docker image not up-to-date

1

Hey there, I just tried launching a new serving instance as our demands are growing. A few months ago I commited a change that resolved a [missing await](https://github.com/allegroai/clearml-serving/pull/55) allowing us...

amirhmk

[ Setup/examples ] Initial Installation Issues - docker compose errors

13

Hello clearml team, Congrats on the release of `clearml-serving` V2 🎉 I really wanted to check it out, and I'm having difficulties running the basic setup and `scikit-learn` example commands...

gaspardc-met

Unable to load onnx models into Triton

7

Hi there, I have been working on deploying our inference pipeline on `clearml-serving` using the `docker-compose` approach. I've hashed out most of the issues thus far thanks to the community,...

amirhmk

Where to find logging for preprocessing Custom model

2

Trying to create a custom model using Ultralytics' YoloV8, I got this message while using Postman for testing my endpoint.  header:  body payload: ``` { "imgString": "base64encodedImage" }...

fulankun1412

String not supported for Triotn

1

Have been working on model ensemble, continuing conversations from https://github.com/allegroai/clearml-serving/issues/53, just thought it may be a better idea to create new issues for different things that I find along the...

amirhmk

AWS S3 storage driver (boto3) not found

7

Hello! I am trying to use clearml-serving to serve my **PyTorch** pretrained model. I deploy ClearML Server and using S3 Minio on local network to store artifacts and pretrained weights....

vladseve7n

Unable to canonicalize address from Kafka

3

Getting the following error when trying to deploy to ECS using docker-compose in the Kafka service: ``` Unable to canonicalize address clearml-serving-zookeeper:2181 because it's not resolvable ``` Wondering, why are...

amirhmk

Use python 3.8 in serving container

6

Hi, my stack uses python 3.8 everywhere and I've just modified the Dockerfile and built the image locally to get my stack to work. I figured it should be easy...

milongo

Issue with pytorch preprocess code

1

Hi, I have encountered error stating that model was expecting input [1 28 28] but given [1 784] when trying out the pytorch example. I think it is due to...

okyspace