spark-on-aws-lambda
spark-on-aws-lambda copied to clipboard
When using VPC and S3 endpoints in Commercial and Gov cloud
Please add the region and configuration .config("spark.hadoop.fs.s3a.endpoint", "s3.us-gov- region-1.amazonaws.com") \ Based on Gov vs Commerical.