Sujith Samuel

Hello @nealf. Thanks ffor your issue. In my flyte deployment, I have 3 clients- a user client(ndsmlclient), flytectl and flytepropeller. in the secrets section secrets: adminOauthClientCredentials: # -- If enabled...

In my case, the below setting worked out appAuth: authServerType: External externalAuthServer: allowedAudience: flytepropeller baseUrl: "" metadataUrl: ".well-known/openid-configuration" and the userauth sections has to be with the IDP address #...

Harbor UI is working fine and I am able to even fetch token from the token endpoint using the curl command

I have tried the below also spec: annotations: seldon.io/rest-timeout: "40000" seldon.io/grpc-timeout: "40000" and the timeout comes after 40 seconds samuel@samuel-dev-vm001:~/repos/dbg$ python inference-llm.py Elapsed time: 40.64111614227295 Hence I am pretty sure...

Another thing to note here is that when i try to set the timeout variable in my python requests module, it sets correctly for 1 sec, 5 secs and 10...

Running mlserver directly also gives the same timeout at 60 seconds samuel@samuel-dev-vm001:~/repos/dbg$ python inference-llm.py Elapsed time: 60.90878462791443 Is there any way to increase this setting in MLserver

I think I got the culprit @click.option( "--timeout", default=60, envvar="MLSERVER_INFER_CONNECTION_TIMEOUT", help="Connection timeout to be passed to tritonclient.", ) This piece of code in the MLServer sets default to 60 MLserver/mlserver/cli...

mlserver start does not have a --timeout option, so I am back to zero.

``` {"json":{"src":"controller.go:157"},"level":"info","msg":"==\u003e Enqueueing workflow [samuel-predictive-azure-development/ahkz2dzvcvqvzrgh85pv]","ts":"2023-09-09T04:46:18Z"} {"json":{"exec_id":"ahkz2dzvcvqvzrgh85pv","ns":"samuel-predictive-azure-development","res_ver":"26307647","routine":"worker-1","src":"executor.go:390","wf":"samuel-predictive-azure:development:predictive_azure.predictive_handover_workflow.predictive_handover_workflow"},"level":"info","msg":"Handling Workflow [ahkz2dzvcvqvzrgh85pv] Done","ts":"2023-09-09T04:46:19Z"} {"json":{"exec_id":"ahkz2dzvcvqvzrgh85pv","ns":"samuel-predictive-azure-development","routine":"worker-1","src":"passthrough.go:80"},"level":"debug","msg":"Observed FlyteWorkflow Update (maybe finalizer)","ts":"2023-09-09T04:46:19Z"} {"json":{"src":"event.go:282"},"level":"info","msg":"Event(v1.ObjectReference{Kind:\"FlyteWorkflow\", Namespace:\"samuel-predictive-azure-development\", Name:\"ahkz2dzvcvqvzrgh85pv\", UID:\"74ec839e-c936-4e77-a544-c558ab2b534a\", APIVersion:\"flyte.lyft.com/v1alpha1\", ResourceVersion:\"26307647\", FieldPath:\"\"}): type: 'Normal' reason: 'Running' Workflow began execution","ts":"2023-09-09T04:46:19Z"} {"json":{"exec_id":"ahkz2dzvcvqvzrgh85pv","ns":"samuel-predictive-azure-development","routine":"worker-1","src":"passthrough.go:95"},"level":"error","msg":"Failed to...