graphstorm icon indicating copy to clipboard operation
graphstorm copied to clipboard

[SageMaker] Use SageMaker local mode to launch SageMaker jobs locally, remove custom Docker compose instructions.

Open thvasilo opened this issue 8 months ago • 0 comments

Issue #, if available:

Description of changes:

  • Add instructions and support to launch SageMaker jobs locally use SageMaker's own local mode, instead of the customer Docker compose solution.
  • Instead of having to mess with Docker compose, users are now able to test multi-instance SageMaker jobs locally, just by providing instance-type local to the launch script(s).
  • This should make it easier to test features that require distributed execution
    • Devs can build an image locally, and provide e.g. --image-uri graphstorm:sagemaker-cpu --instance-type localto the launcher. This will launch local jobs with containers using the local image.
  • NOTE: We do not support local GSProcessing SageMaker jobs.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

thvasilo avatar May 02 '25 22:05 thvasilo