[Synapse] `az synapse spark job submit`: Add ability to pass custom Python files to the job

[jonmclean]

Related command az synapse spark job submit

Description Synapse allows users to add Python files to Spark jobs in addition to the main job file. This may include custom .whl files, addition .py files, or anything else that is needed by the main python script. This PR allows users to specify the additional python files through the az CLI interface.

See azure-sdk-for-python SparkBatchJobOptions class

Testing Guide az synapse spark job submit --name MyJobName --workspace MySynapseWorkspace --main-definition-file "abfs://mymainfile" --python-files "abfs://custom_library1.whl" "abfs://custom_library2.whl"

History Notes

[Synapse] az synapse spark job submit: Add optional --python-files argument to job submission

---

This checklist is used to make sure that common guidelines for a pull request are followed.

• [x] The PR title and description has followed the guideline in Submitting Pull Requests.

• [x] I adhere to the Command Guidelines.

• [x] I adhere to the Error Handling Guidelines.