I was not able to use the PartitionedDataSet as the AzureMLPipelineDataset

[snavyareddy]

In my usecase, one of the node returns a PartitionedDataSet that dataset need to be accessed by the following node. But I was able use AzureMLPipelineDataset with single dataframe but not PartitionedDataSet. As I want to use it for the parallel_processing...

downloaded_station_data: type: PartitionedDataset path: data/01_raw/downloaded_station_data dataset: pandas.CSVDataset filename_suffix: .csv

I tried this way: downloaded_station_data: type: kedro_azureml.datasets.AzureMLPipelineDataset dataset: type: PartitionedDataset path: data/01_raw/downloaded_station_data dataset: pandas.CSVDataset filename_suffix: .csv

This need to be used as the azureml pipeline data using AzureMLPipelineDataset. I was getting the error as [DatasetError: filepath]

If anyone has the solution please help me...