One click deployment to GKE no longer works as Istio deprecated

[samsaam-thg]

Description Istio is deprecated on GKE. You cannot create a cluster with Istio add-on, and as such you cannot use the one-click deployer.

Triton Information Not applicable GKE version 1.22.8-gke.202

To Reproduce Create a GKE cluster in Standard mode and try to use the GKE Marketplace deployer.

Expected behavior Be able to deploy triton using the one-click deployment method.

Perhaps this could be updated to work with Anthos service mesh since Google supports that

[kthui]

Thanks for getting this into our attention. I have filed a ticket for us to investigate further.

[MomoHsieh]

About GKE no longer works as Istio deprecated, can we still can create cluster and poll to use GKE or not?

[achbogga]

Please update this marketplace app or give us instructions on how to build this ourselves with the latest source.

gcr.io/cloud-marketplace/nvidia-ngc-public/triton-inference-server

@deadeyegoodwin @jbkyang-nvi @kthui @dougn

[jbkyang-nvi]

Hi, we're still working on this issue with GKE about this.

[achbogga]

@jbkyang-nvi Any timeline on getting this resolved would be really appreciated as we are considering deploying this for our production.

[mengdong]

Hello, per updated instruction at https://github.com/triton-inference-server/server/tree/main/deploy/gke-marketplace-app#demo-instruction, we instead install istio to the GKE cluster.