amazon-sagemaker-examples
amazon-sagemaker-examples copied to clipboard
aws
Add GPT2 model train script with HuggingFace Trainer and SageMaker Model Parallel
Description of changes: Add GPT2 model train script with HuggingFace Trainer and SageMaker Model Parallel
Merge Checklist
- [x] I have read the CONTRIBUTING doc and adhered to the example notebook best practices
- [ ] I have updated any necessary documentation, including READMEs
- [x] I have tested my notebook(s) and ensured it runs end-to-end
- [x] I have linted my notebook(s) and code using
black-nb -l 100 {path}/{notebook-name}.ipynb
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
Check out this pull request on 
See visual diffs & provide feedback on Jupyter Notebooks.
Powered by ReviewNB
![review-notebook-app[bot] avatar](https://avatars.githubusercontent.com/in/15474?v=4 "Published by a pub.dev verified publisher"){kind=small}
AWS CodeBuild CI Report
- CodeBuild project: sagemaker-examples-link-check
- Commit ID: a1110b0daaf4266aa1509e9b68f63811d418b359
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: sagemaker-examples-code-formatting
- Commit ID: a1110b0daaf4266aa1509e9b68f63811d418b359
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: sagemaker-examples-grammar
- Commit ID: a1110b0daaf4266aa1509e9b68f63811d418b359
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: amazon-sagemaker-examples-pr
- Commit ID: a1110b0daaf4266aa1509e9b68f63811d418b359
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: sagemaker-examples-grammar
- Commit ID: 885e5ecc96513307f19fe62e6a5b1013938a09d5
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: sagemaker-examples-code-formatting
- Commit ID: 885e5ecc96513307f19fe62e6a5b1013938a09d5
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: sagemaker-examples-link-check
- Commit ID: 885e5ecc96513307f19fe62e6a5b1013938a09d5
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: amazon-sagemaker-examples-pr
- Commit ID: 885e5ecc96513307f19fe62e6a5b1013938a09d5
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: sagemaker-examples-code-formatting
- Commit ID: 8a345ad0c4ec63f9c36eb989ae286c8373d994a7
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: sagemaker-examples-link-check
- Commit ID: 8a345ad0c4ec63f9c36eb989ae286c8373d994a7
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: sagemaker-examples-grammar
- Commit ID: 8a345ad0c4ec63f9c36eb989ae286c8373d994a7
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: amazon-sagemaker-examples-pr
- Commit ID: 8a345ad0c4ec63f9c36eb989ae286c8373d994a7
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
- Commit ID: 2df25fa23785fbde9a8f6ad8a32e0de93124b1bf
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
- Commit ID: 2df25fa23785fbde9a8f6ad8a32e0de93124b1bf
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
- Commit ID: 2df25fa23785fbde9a8f6ad8a32e0de93124b1bf
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
- Commit ID: 2df25fa23785fbde9a8f6ad8a32e0de93124b1bf
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
- Commit ID: 587e84a7fca4a15b6150a778934fc8e34a0d4eda
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
- Commit ID: 587e84a7fca4a15b6150a778934fc8e34a0d4eda
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
- Commit ID: 587e84a7fca4a15b6150a778934fc8e34a0d4eda
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
- Commit ID: 587e84a7fca4a15b6150a778934fc8e34a0d4eda
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
Closing this PR since it was created a long time ago and didn't pass all the checks. Feel free to open a new pull request instead.
