amazon-sagemaker-examples
amazon-sagemaker-examples copied to clipboard
Refactor reqirements handling and model archive creation for TS MME example
Description of changes:
- Refactor Torchserve MME example to use Torchserve
v0.9.0
- Update example to use PyTorch 2.1.0 Sagemaker inference DLC
- Fix PyTorch and Cuda version incompatibility in DLC
- Fix issues with Lama model archive creation, model loading and inference
Testing done: Manual test to verify that the Notebook runs end to end
Merge Checklist
- [x] I have read the CONTRIBUTING doc and adhered to the example notebook best practices
- [x] I have updated any necessary documentation, including READMEs
- [x] I have tested my notebook(s) and ensured it runs end-to-end
- [x] I have linted my notebook(s) and code using
black-nb -l 100 {path}/{notebook-name}.ipynb
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
Check out this pull request onÂ
See visual diffs & provide feedback on Jupyter Notebooks.
Powered by ReviewNB
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
- Commit ID: 42c94e5b6082b8ac32d5f57a1c9cfe26bd2ac12c
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
- Commit ID: 42c94e5b6082b8ac32d5f57a1c9cfe26bd2ac12c
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
- Commit ID: 42c94e5b6082b8ac32d5f57a1c9cfe26bd2ac12c
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
- Commit ID: 42c94e5b6082b8ac32d5f57a1c9cfe26bd2ac12c
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
- Commit ID: fe9bc789db443861d3015f331810432db3e00589
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
- Commit ID: fe9bc789db443861d3015f331810432db3e00589
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
- Commit ID: fe9bc789db443861d3015f331810432db3e00589
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
- Commit ID: fe9bc789db443861d3015f331810432db3e00589
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
- Commit ID: 1b807968e505e1b99dbc161a66dbf63480c3c4c7
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
- Commit ID: 1b807968e505e1b99dbc161a66dbf63480c3c4c7
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
- Commit ID: 1b807968e505e1b99dbc161a66dbf63480c3c4c7
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
- Commit ID: 1b807968e505e1b99dbc161a66dbf63480c3c4c7
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
- Commit ID: 981956a79b45b279ba15ca3e3e46863140fdd0e8
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
- Commit ID: 981956a79b45b279ba15ca3e3e46863140fdd0e8
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
- Commit ID: 981956a79b45b279ba15ca3e3e46863140fdd0e8
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
- Commit ID: 981956a79b45b279ba15ca3e3e46863140fdd0e8
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
- Commit ID: c0f120faee8a1f255994425c340726cef34ef094
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
- Commit ID: c0f120faee8a1f255994425c340726cef34ef094
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
- Commit ID: c0f120faee8a1f255994425c340726cef34ef094
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
- Commit ID: c0f120faee8a1f255994425c340726cef34ef094
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
- Commit ID: 9a76c5aef00e91709b05874e7be1ae82a675c573
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
- Commit ID: 9a76c5aef00e91709b05874e7be1ae82a675c573
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
- Commit ID: 9a76c5aef00e91709b05874e7be1ae82a675c573
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
- Commit ID: 9a76c5aef00e91709b05874e7be1ae82a675c573
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
- Commit ID: 4d04b1d5772b4af284d5133f631676967b994c52
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
- Commit ID: 4d04b1d5772b4af284d5133f631676967b994c52
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
- Commit ID: 4d04b1d5772b4af284d5133f631676967b994c52
- Result: SUCCEEDED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
- Commit ID: 4d04b1d5772b4af284d5133f631676967b994c52
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository
AWS CodeBuild CI Report
- CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
- Commit ID: 4d04b1d5772b4af284d5133f631676967b994c52
- Result: FAILED
- Build Logs (available for 30 days)
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository