kedro-azureml
kedro-azureml copied to clipboard
getindata
Kedro plugin to support running workflows on Microsoft Azure ML Pipelines
Update Azure pipelines SDK to version 2. Reference docs - https://learn.microsoft.com/en-us/azure/machine-learning/migrate-to-v2-execution-pipeline?view=azureml-api-2
``` Cannot install azureml-dataprep-native. - Installing azureml-dataprep-rslex (2.22.2): Failed RuntimeError Unable to find installation candidates for azureml-dataprep-rslex (2.22.2) ``` There are no wheels for Apple Silicon available for azureml v1,...
@distributed_job(Framework.MPI, num_nodes=2, processes_per_node=1) When using MPI framework and using more nodes in azureml the shared memory (shm_size) is only 2gb by default, In my usecase, It is giving the memory...
In my usecase, one of the node returns a PartitionedDataSet that dataset need to be accessed by the following node. But I was able use AzureMLPipelineDataset with single dataframe but...
@marrrcin @fdroessler @tomasvanpottelbergh Following issue #70, I propose this PR as a base for discussion, it is not meant to be merged as is for now. Main changes is that...
Hello Team! I have some designing questions, and see if kedro-azureml is the right tool to use. My team is building a long running simulation model written using Kedro. We...
Hello, team! I am closely follow instructions for the docker image flow in https://kedro-azureml.readthedocs.io. I was able to create an Azure pipeline, but it failed with the error in std_log.txt:...
Adding as a reminder of things to do/consider
I am trying to save a data asset as a uri_file and the dataset is incorrectly saved as a uri_folder when I launch `kedro azureml run` I have the following...