azureml-examples icon indicating copy to clipboard operation
azureml-examples copied to clipboard

Pipeline support for Command Job & Ray Distribution

Open afogarty85 opened this issue 2 years ago • 0 comments

Describe your suggestion

I cant find a way to run a command job as a repeatable pipeline using Ray Distribution. Ray Distribution works great with a plain command job -- but I want to submit a pipeline and run it regularly via Synapse.

Submitting command jobs through pipeline decorators turns the commands into MPI runs which fail and are incompatible.

Additional details

No response

afogarty85 avatar Jan 02 '24 22:01 afogarty85