apache-ranger-s3-plugin icon indicating copy to clipboard operation
apache-ranger-s3-plugin copied to clipboard

Published 20 hours ago • verified publisher icon ing-bank

s3 support?

Open tooptoop4 opened this issue 5 years ago • 2 comments

@arempter is AWS S3 supported?

tooptoop4 avatar Jul 27 '19 20:07 tooptoop4

Hey, The question is very wide, so not sure what exactly you are looking for. In general plugin uses AWS SDK so it should work. There may be problem with url endpoint value when constructing S3 client, sice we use host:port and in AWS you just specify https://region_url. I never tested it. So in summary it may/will with small update...

Plugin is just one part, allows Ranger to understand S3 format. You will also need authorizer on application side, which will ask Ranger, if resource to be accessed is allowed by policy

arempter avatar Jul 29 '19 06:07 arempter

have u plugged pyspark into this?

tooptoop4 avatar Dec 06 '19 11:12 tooptoop4