Nok Lam Chan
Nok Lam Chan
Depending on #629, this may need to move to a contribution folder but I think this is mostly ready
@DavidRetana-TomTom Did you mean that you expect there is a `query` argument? I am not sure what's the feature request here.
I take what is described here and hopefully this can be a starting point or workaround, I only implemented the `load` method. The change is in [noklam/sparkjdbcdataset-not-working-639](https://github.com/kedro-org/kedro-plugins/tree/noklam/sparkjdbcdataset-not-working-639) The diff: https://github.com/kedro-org/kedro-plugins/compare/noklam/sparkjdbcdataset-not-working-639?expand=1...
(edited). There are some discussion of `glob` and `open` which I haven't confirmed. But I think we can simply the problem to be ```python # This work import polars as...
> As far as I remember, Polars supports remote paths with its own native methods. Maybe we should ditch fsspec for this particular dataset? This is what we do with...
Explore if the schema validation works if we keep the core Kedro dataset (LambdaDataset) and move the remaining to `kedro-datasets`
@fazilhero This is the expected behavior - https://docs.kedro.org/en/stable/kedro.io.PartitionedDataset.html#kedro.io.PartitionedDataset > overwrite – If True, any existing partitions will be removed. Could you elaborate your use case in terms of what you...
Sorry for the confusion, I think what you make sense. @stichbury
Closed as this is documented expected behavior. If this is a desired feature feel free to open a separate issue for feature request or submit a PR
The one who pick up the ticket should decide and implement which solutions work better. It was discussed that it's unclear how we use this information and it's not urgent...