spark-on-lambda
spark-on-lambda copied to clipboard
Apache Spark on AWS Lambda
How do I run commands from the `spark-shell` so that they are executed on Lambda? Right now, the commands are being executed locally on my machine, but I would like...
As per instructions, I was trying to copy the file and errors out. aws s3 cp s3://public-qubole/lambda/spark-2.1.0-bin-spark-lambda-2.1.0.tgz s3://myBucket-xxx/spark-on-lambda/spark-2.1.0-bin-spark-lambda-2.1.0.tgz --acl bucket-owner-full-control Error: fatal error: An error occurred (403) when calling the...
Bumps [protobuf-java](https://github.com/protocolbuffers/protobuf) from 2.5.0 to 3.16.3. Release notes Sourced from protobuf-java's releases. Protobuf Release v3.16.3 Java Refactoring java full runtime to reuse sub-message builders and prepare to migrate parsing logic...
Bumps [calcite-core](https://github.com/apache/calcite) from 1.2.0-incubating to 1.32.0. Commits 413eded [CALCITE-5275] Release Calcite 1.32.0 57aafa3 Cosmetic changes to release notes 2624925 [CALCITE-5262] Add many spatial functions, including support for WKB (well-kn... 479afa6...
Bumps commons-net from 2.2 to 3.9.0. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
Bumps [jackson-databind](https://github.com/FasterXML/jackson) from 2.6.5 to 2.12.7.1. Commits See full diff in compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter...
Bumps ivy from 2.4.0 to 2.5.1. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
aws s3 cp s3://public-qubole/lambda/spark-lambda-149.zip s3://my-bucket Fatal error: An error occurred (403)when calling the Headobject operation: Forbidden when I tried this command, another error occured likes below: aws s3ls s3: //public-qubole/lambda/spark-2.1.0-bin-spark-lambda-2.1.0.tgz...