Does Seldon work similar to Node Red

[divyadilip91]

Hi @cliveseldon @RafalSkolasinski

Does seldon allow to connect two seldon deployments in gke as a pipeline instead of having a seldon inference graph connecting two components in a single deployment.

[ukclivecox]

You can call out to another Seldon Deployment but you would need to get the SVC URI from the status field

[divyadilip91]

@cliveseldon Thank you for your reply. Did you mean SVC uri as the cluster ip obtained after executing kubectl get svc command?

[ukclivecox]

No I mean the SeldonDeployment Status has a url field which could be used to find it and call it.

[ukclivecox]

Did this fix your issue @divyadilip91 Note - we are also looking in updated V2 APIs to make it easier for models to be chained together.

[divyadilip91]

Hi @cliveseldon Apologies for the delayed feedback. I found the url under the seldon deployment status field. But my doubt is whether the first deployment can make an internal call to the second deployment. If possible ,can you please share a sample deployment yaml that can do this instead of a seldon graph. I am curious about this scenario since it can avoid resource wastage. Eg: if we have a model 1 seldon graph deployment and model 2 seldon graph deployment in gke. Now I need to have a chained deployment where the input is passed to model1 and then to model2 and the final output obtained.If I create a seldon graph with model1 and model2 it becomes another deployment again which is basically resource wastage since independent deployments of model1 and model2 are already available.

[github-actions[bot]]

This issue is stale because it has been open 10 days with no activity. Remove stale label or comment or this will be closed in 5 days.

[github-actions[bot]]

This issue was closed because it has been stalled for 5 days with no activity.