milvus
milvus copied to clipboard
[Feature]: Support EKS Pod Identities (Upgrade minio-client version)
Is there an existing issue for this?
- [X] I have searched the existing issues
Is your feature request related to a problem? Please describe.
I'm trying to deploy Milvus using EKS Pod Identity, however, I'm getting errors on authentication against S3:
[2024/07/22 16:07:31.748 +00:00] [ERROR] [datanode/service.go:305] ["failed to init DataNode server"] [error="uri host is not a loopback address: http://169.254.170.23/v1/credentials"] [stack="github.com/milvus-
io/milvus/internal/distributed/datanode.(*Server).init\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/datanode/service.go:305\ngithub.com/milvus-io/milvus/internal/distributed/datanode.(*Server).Run
\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/datanode/service.go:188\ngithub.com/milvus-io/milvus/cmd/components.(*DataNode).Run\n\t/go/src/github.com/milvus-io/milvus/cmd/components/data_node.go
:55\ngithub.com/milvus-io/milvus/cmd/roles.runComponent[...].func1\n\t/go/src/github.com/milvus-io/milvus/cmd/roles/roles.go:114"]
[2024/07/22 16:07:31.748 +00:00] [ERROR] [components/data_node.go:56] ["DataNode starts error"] [error="uri host is not a loopback address: http://169.254.170.23/v1/credentials"] [stack="github.com/milvus-io/mil
vus/cmd/components.(*DataNode).Run\n\t/go/src/github.com/milvus-io/milvus/cmd/components/data_node.go:56\ngithub.com/milvus-io/milvus/cmd/roles.runComponent[...].func1\n\t/go/src/github.com/milvus-io/milvus/cmd/
roles/roles.go:114"]
panic: uri host is not a loopback address: http://169.254.170.23/v1/credentials
Describe the solution you'd like.
After reviewing the traceback, it appears that the issue is related to a MinIO dependency. According to the current go.mod
file, Milvus is using MinIO version v7.0.61. However, support for EKS Pod Identities was introduced in version v7.0.69. To enable this feature, it would be beneficial to upgrade the MinIO version used in Milvus.
Describe an alternate solution.
No response
Anything else? (Additional Context)
More info about EKS Pod Identities: https://docs.aws.amazon.com/en_en/eks/latest/userguide/pod-identities.html