sagemaker-spark icon indicating copy to clipboard operation
sagemaker-spark copied to clipboard

Published 20 hours ago • verified publisher icon aws

Upgrade Spark and PySpark version to 3.3.0

Open navinsoni opened this issue 1 year ago • 10 comments

This commit upgrades following:

  • Spark version to 3.3.0
  • PySpark version to 3.3.0
  • Scala version to 2.12.16
  • Python version to 3.7

This commit deprecates python 3.6

Issue #, if available:

Description of changes:

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

  • [ ] I have read the CONTRIBUTING doc
  • [ ] I have added tests that prove my fix is effective or that my feature works (if appropriate)
  • [ ] I have updated the changelog with a description of my changes (if appropriate)
  • [ ] I have updated any necessary documentation (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

navinsoni avatar Aug 04 '22 20:08 navinsoni

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 5777f389f06e3bd8c32a45b3b2dcfc9170b3976f
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 04 '22 21:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 2c5f6e47143bde7779989601768b17ac58ab8c30
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 04 '22 21:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 71c7435cc777a548cb958d1f894e190a823abac2
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 16 '22 04:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 9f874fb39aefc70f8eca669f6c5023559bdb538e
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 16 '22 05:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 5518cd22eb3cd01c6fd5d713060003ebc75018d4
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 16 '22 09:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 5518cd22eb3cd01c6fd5d713060003ebc75018d4
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 16 '22 10:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 5518cd22eb3cd01c6fd5d713060003ebc75018d4
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 16 '22 16:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 5518cd22eb3cd01c6fd5d713060003ebc75018d4
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 16 '22 19:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 5518cd22eb3cd01c6fd5d713060003ebc75018d4
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 16 '22 21:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 87cab7332465bfd7b92745b89d4e42affeda445a
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 17 '22 02:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 03877d9cab13c35f6af6d17d52faaaf25a93ed0e
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 22 '22 18:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 61e2fc04abd134c901decd8afcb141dd8e9f3498
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 22 '22 19:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 61e2fc04abd134c901decd8afcb141dd8e9f3498
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 22 '22 20:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 65c235fc4989cde190e543aca08111fd2d226c84
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 23 '22 04:08 sagemaker-bot

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-spark-pr
  • Commit ID: 65c235fc4989cde190e543aca08111fd2d226c84
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot avatar Aug 23 '22 07:08 sagemaker-bot