Antony Milne

Yeah, `pandas.GenericDataSet` isn't well known. It was added relatively recently so that we don't have to constantly be catching up with pandas when they add a new format: https://github.com/kedro-org/kedro/pull/987. It's...

Definitely that sounds like a good plan in the short term - you can easily use the custom dataset implementation without it being added to core kedro. Just copy and...

@noklam also commented that we should consider what actually belongs to `AbstractDataSet` and what belongs to the implementations. Just to bring @noklam's comment to life a bit more, since it's...

Just to be clear, I believe this is a problem only when the term to be highlighted is in the diagram. e.g. https://kedro.readthedocs.io/en/stable/deployment/deployment_guide.html?highlight=asdfsadf works fine https://kedro.readthedocs.io/en/stable/deployment/deployment_guide.html?highlight=container does not Unfortunately I...

The compiled filepath is actually already available in the data catalog, just it's quite hidden away: `catalog._get_dataset("dataset_name")._filepath` or `catalog.datasets.dataset_name._filepath`. 1. `kedro compile`: I understand the need for this and I...

Curious what @deepyaman thinks of this. He may well have the honour of being the most familiar person playing around with `io`! So hopefully he can give a more informed...

Looking back through the discussion in https://github.com/kedro-org/kedro/pull/1265, I can confirm that @Galileo-Galilei independently had the same feeling as me on this: > It makes sense for kedro itself to have...

I'm reopening this because I think it's a very good topic and I'd be interested in hearing from other users about it 🙂 It's been mentioned several times before by...

@deepyaman That is a radical thought! It does indeed seem that the pip-compile jobs are there largely for historical reasons, but I have found them quite useful for immediately flagging...

@MerelTheisenQB might have more context here on why we originally added prompts.yml and which users we should talk to if we want to change this so we can be sure...