Deploy Script Fails for Example

[smart-patrol]

I am following the ReadMe and using all default settings.

I get the following error after running bash deploy.sh run

Runtime: kubernetes
Processor: graviton
error: error validating "STDIN": error validating data: failed to download openapi: the server has asked for the client to provide credentials; if you choose to ignore these errors, turn validation off with --validate=false
Generating ./app-bert-base-multilingual-cased-graviton-c7g.4xlarge/bert-base-multilingual-cased-graviton-0.yaml ...
error: error validating "app-bert-base-multilingual-cased-graviton-c7g.4xlarge/bert-base-multilingual-cased-graviton-0.yaml": error validating data: failed to download openapi: the server has asked for the client to provide credentials; if you choose to ignore these errors, turn validation off with --validate=false

[dzilbermanvmw]

Hello @smart-patrol thank you for reporting your issue with our project. A couple of triage questions: have you been following the README or more comprehensive implementation guidance document: https://aws-solutions-library-samples.github.io/compute/low-latency-high-throughput-inference-on-amazon-eks.html#deploy-the-guidance? They both describe the same commands but generally, we ran all of them following the 'build-trace-pack-push-deploy-test' workflow as:

./deploy.sh run

Also, can you please attach the generated ./app-bert-base-multilingual-cased-graviton-c7g.4xlarge/bert-base-multilingual-cased-graviton-0.yaml file that fails to deploy? How many Graviton nodes and of what type do you have in your EKS cluster? thanks