spark-redshift icon indicating copy to clipboard operation
spark-redshift copied to clipboard

Added support for S3 Client Side Encryption (S3 CSE)

Open same3r opened this issue 8 years ago • 7 comments

This commit adds S3 Client Side Encryption support to spark-redshfit library that allows full end-to-end data encryption over network for read/write operations.

same3r avatar Feb 04 '17 00:02 same3r

This is a good one

danielsan avatar May 17 '17 00:05 danielsan

Agreed. We need this PR merged

ghost avatar Jul 26 '17 00:07 ghost

Another +1. Super useful feature.

dedgsus avatar Sep 27 '17 13:09 dedgsus

+1. Very useful feature.

guruswan avatar Sep 27 '17 13:09 guruswan

+1 This is a great feature - what's keeping it from being merged?

szsiddiq avatar Feb 08 '18 08:02 szsiddiq

+1 for this feature!

twwildey avatar Jul 19 '19 20:07 twwildey

Would it possible to add support for KMS_KEY_ID option in UNLOAD command ?

Documentation : https://docs.aws.amazon.com/redshift/latest/dg/t_unloading_encrypted_files.html

Example:

    unload ('select venuename, venuecity from venue')
    to 's3://mybucket/encrypted/venue_' 
    iam_role 'arn:aws:iam::0123456789012:role/MyRedshiftRole'
    KMS_KEY_ID '1234abcd-12ab-34cd-56ef-1234567890ab'
    encrypted;

rumeshkrish avatar Jun 11 '20 10:06 rumeshkrish