ckanext-cloudstorage icon indicating copy to clipboard operation
ckanext-cloudstorage copied to clipboard

Add S3 Requester Pays support

Open jqnatividad opened this issue 9 years ago • 1 comments

Data publishers should not be penalized for success.

For data publishers that want to control their bandwidth costs, but still want to give "fast lane" access for high-volume, commercial users, S3's Requester Pays feature is a great option.

When this option is selected when publishing a file, the file will also be published in a Requester Pays bucket.

Since this is an option for advanced users, I think there's no need to go beyond exposing the file download link in the requester pays bucket, with instructions to use s3cmd CLI or a tool like s3browser.

Note this is how Cornell university is distributing bulk data from arxiv.org - https://arxiv.org/help/bulk_data_s3

jqnatividad avatar Dec 01 '16 16:12 jqnatividad

Do you have an idea/mockup of how you'd display this in the resource UI? This is simple from a functional standpoint, but harder to display without cluttering the UX. Will definitely need the "How to use" blurb next to it.

Maybe we only show it on the individual resource explorer view, and keep it off the list views?

TkTech avatar Mar 21 '17 19:03 TkTech