milvus icon indicating copy to clipboard operation
milvus copied to clipboard

[Enhancement]: Support config a complete URL for S3

Open haorenfsa opened this issue 1 year ago • 7 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

What would you like to be added?

Currently we need config 3 or more fields(if using IAM) when we want to use S3 or other cloud service for object storage. They're

  • minio.address
  • minio.port
  • minio.useSSL

These can be simplified by providing a configuration of complete URL, for example from https://s3.amazonaws.com, we can infer that its port is 443, and useSSL is true.

P.S. Further more we can take more advanvage of URL to make the configuration even simpler like: s3://bucketname, gcs://bucketname

Why is this needed?

No response

Anything else?

No response

haorenfsa avatar Feb 15 '23 05:02 haorenfsa

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Mar 17 '23 06:03 stale[bot]

/reopen

haorenfsa avatar Mar 26 '23 10:03 haorenfsa

@haorenfsa: Reopened this issue.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

sre-ci-robot avatar Mar 26 '23 10:03 sre-ci-robot

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Apr 25 '23 19:04 stale[bot]

/reopen

haorenfsa avatar May 08 '23 03:05 haorenfsa

@haorenfsa: Reopened this issue.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

sre-ci-robot avatar May 08 '23 03:05 sre-ci-robot

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Jun 08 '23 17:06 stale[bot]

right now I am having trouble even understanding the S3 config. what is supposed to go in minio.address and minio.port? https://s3.amazonaws.com and 443? or is it my own VPC endpoint created on S3?

cyrusvahidi avatar Jun 12 '23 22:06 cyrusvahidi

Use s3.amazonaws.com or regional hostname for address, and 443 for port

haorenfsa avatar Jun 17 '23 01:06 haorenfsa

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Jul 17 '23 11:07 stale[bot]

In first stage, we can use a field like minio.url to replace

  • minio.address
  • minio.port
  • minio.useSSL

The translation examples: url: https://s3.amazonaws.com -> address: s3.amazonaws.com port:443 useSSL:true

url: http://my-object-storage-host -> address: my-object-storage-host port:80 useSSL:false

haorenfsa avatar Jul 20 '23 08:07 haorenfsa

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Aug 21 '23 20:08 stale[bot]

/reopen

haorenfsa avatar Sep 07 '23 06:09 haorenfsa

@haorenfsa: Reopened this issue.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

sre-ci-robot avatar Sep 07 '23 06:09 sre-ci-robot

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Oct 07 '23 10:10 stale[bot]