graphstorm
graphstorm copied to clipboard
[SageMaker] Use SageMaker local mode to launch SageMaker jobs locally, remove custom Docker compose instructions.
Issue #, if available:
Description of changes:
- Add instructions and support to launch SageMaker jobs locally use SageMaker's own local mode, instead of the customer Docker compose solution.
- Instead of having to mess with Docker compose, users are now able to test multi-instance SageMaker jobs locally, just by providing
instance-type localto the launch script(s). - This should make it easier to test features that require distributed execution
- Devs can build an image locally, and provide e.g.
--image-uri graphstorm:sagemaker-cpu --instance-type localto the launcher. This will launch local jobs with containers using the local image.
- Devs can build an image locally, and provide e.g.
- NOTE: We do not support local GSProcessing SageMaker jobs.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.